ScottWales / metadata-db

https://scottwales.github.io/metadata-db
Apache License 2.0
0 stars 0 forks source link

Create filesystem crawler #7

Open ScottWales opened 6 years ago

ScottWales commented 6 years ago

Create a crawler that will recursively scan a directory, loading the paths it finds.

If run a second time on a directory it should add only newly created files

ScottWales commented 6 years ago
metadb collection create --collection foo /root/path /another/path
metadb collection crawl --collection foo

should crawl all files under /root/path and /another/path, adding them to collection foo.

metadb collection crawl

should crawl all collections