If you think you need #Python's multiprocessing module, you really need #Golang instead.
#Python has decent support for I/O bound concurrency with asynio, threading and concurrent.futures.
For simple, “embarrassingly parallel" CPU-bound workloads, concurrent.futures.ProcessPoolExecutor is OK.
For more complex scenarios, the multiprocessing module, pretends to be as “simple" as threading but is a monster of complexity and super hard to debug.
@ramgarlic You could also use several different languages by communicating with Crossbar.io / Autobahn (routed Pub/Sub + RPC framework with clients in many languages). The server is #twisted#python (the client supports asyncio and python, and there are also Go WAMP client libraries.
Add comment