scripts for submit mr jobs

at15 / forum-search

craw, store and index data for later search

MIT License

1 stars 0 forks source link

Closed at15 closed 8 years ago

at15 commented 8 years ago

[x] remove previous input and output in hdfs
[x] create input folder
[ ] upload craw data
[x] run mr job
[ ] download data from hdfs (use -get, but need to know the exact amount of files first, maybe use a cat command first)