Add ability to set different Nutch crawl configurations

nasa-jpl-memex / memex-explorer

Viewers for statistics and dashboarding of Domain Search Engine data

BSD 2-Clause "Simplified" License

121 stars 69 forks source link

Closed chdoig closed 9 years ago

chdoig commented 9 years ago

Nutch crawl configuration set to default and number_of_rounds set to two in all crawls:

[ ] Change default number of rounds to one.
[ ] Write nutchpy script to use a continuously running loop that is interruptible with an API call.
[ ] Nutch crawl script could be able to select the folder with the configuration to use.

Open separate issue tasks: #134, #135, #136

brittainhard commented 9 years ago

Still relevant?