misja / python-boilerpipe

Python interface to Boilerpipe, Boilerplate Removal and Fulltext Extraction from HTML pages
Other
539 stars 143 forks source link

boilerpipe hangs in multiprocessing program #16

Closed dpatro closed 10 years ago

dpatro commented 10 years ago

When I try to run boilerpipe in a multiprocessing pool, the code hangs after processing some links.

I have tried running the code in normal loops, and that works fine.

dpatro commented 10 years ago

Apparently got an answer on stackoverflow.com http://stackoverflow.com/a/20595641/2493132