allenai / bff

Apache License 2.0
38 stars 9 forks source link

Code should use threads to run in parallel #1

Closed dirkgr closed 1 year ago

dirkgr commented 1 year ago

You should be able to run in parallel by running multiple processes right now, but it might be faster/more accurate to run multiple threads in one process.

This necessitates some way of having each thread write to a different output file though, so it's not totally trivial.

dirkgr commented 1 year ago

This is already done.