allenai / wimbd

What's In My Big Data (WIMBD) - a toolkit for analyzing large text datasets
Apache License 2.0
172 stars 18 forks source link

Allow directories instead of just file paths #4

Closed epwalsh closed 6 months ago

epwalsh commented 6 months ago

Allow passing directories to wimbd commands instead of just file paths. Directories will be expanded to paths using the glob **/*.json.gz.