I have been teaching how to parallelise computations in #python for years. I just came across this article by @itamarst @hachyderm.io which explains some important points I was not aware of regarding multiprocessing.
I need to explore this further and update my course.
https://pythonspeed.com/articles/faster-multiprocessing-pickle/
I need to explore this further and update my course.
https://pythonspeed.com/articles/faster-multiprocessing-pickle/
Python’s multiprocessing performance problem
While multiprocessing allows Python to scale to multiple CPUs, it has some performance overhead compared to threading.Itamar Turner-Trauring (Python⇒Speed)