search

knowitall / openie

Quality information extraction at web scale.
Other
457 stars 108 forks source link

Process large batch of files #22

Closed fcbr closed 9 years ago

fcbr commented 9 years ago

What would be the best practice to process a large batch of files to avoid executing openie for each one of them?

bhadramani commented 9 years ago

You may create a project which mange the files, (I & O), add OpenIE as dependency to your project. Since latest OpenIE is threadsafe you may create multiple threads for processing based on available hardware, Using single instance of OpenIETs . (and extractTs method)