anthonydb / pneumatic

pneumatic is a bulk-upload library for DocumentCloud.
MIT License
23 stars 3 forks source link

Enable multiprocessing #1

Closed anthonydb closed 8 years ago

anthonydb commented 8 years ago

Uploading a lot of files to DocumentCloud sequentially ain't the speediest route to travel. Let's explore responsibly enabling multiprocessing in the library.

Reference: http://www.toptal.com/python/beginners-guide-to-concurrency-and-parallelism-in-python

anthonydb commented 8 years ago

Enabled via https://github.com/anthonydb/pneumatic/commit/b4a60541fd9370eb7c82e8d8432ab46569cfdb98!