search

at15 / forum-search

craw, store and index data for later search
MIT License
1 stars 0 forks source link

Crawler pipline #7

Closed at15 closed 8 years ago

at15 commented 8 years ago

need to save data to file, so the uploader can upload it to hadoop and then run the map reduce job