search

Informationretrieval2016 / furnito

assignment for information retrieval 2016
MIT License
1 stars 0 forks source link

[#3] make crawler better #15

Open bwanglzu opened 8 years ago

bwanglzu commented 8 years ago
  1. write path settings
  2. multi thread support
  3. robot txt filter (partially accomplished)
  4. log (partially accomplished)