search

duckworthd / mirai

Twitter Futures for Python
58 stars 5 forks source link

Enable use of ProcessPoolExecutor #3

Open duckworthd opened 10 years ago

duckworthd commented 10 years ago

...for computational parallelization, too! This will be a pretty big step, and I'm not sure if it's even possible. I'd definitely appreciate the knowledgable eye of the more experienced among us!

duckworthd commented 10 years ago

Ends up this is a LOT harder than expected due to the lack of shared memory. This would require a very significant re-implementation of ProcessPoolExecutor in order to facilitate synchronized views of Promises across processes...