search

uktrade / stream-read-xbrl

Python package to parse Companies House accounts data in a streaming way
https://stream-read-xbrl.docs.trade.gov.uk/
MIT License
19 stars 5 forks source link

feat: use multiprocessing #57

Closed michalc closed 1 year ago

michalc commented 1 year ago

This gives at least a 3x speedup

More functions have to be moved to the global scope in order to use in multiprocessing. Passing closures doesn't seem to be supported (or at least, I couldn't get it to work - there were errors with pickling)