cheng10 / WARC-Portal

The project is being built for digital humanities and social science researchers who wish to access web archive material in their research process.
http://warc.tech
MIT License
2 stars 2 forks source link

fetch data form Waston after all the data pushed into database #39

Closed cheng10 closed 7 years ago

cheng10 commented 7 years ago

query info from waston could take a long time for large file. to make populating data faster we should query Waston after data population.