The `--using` flag doesn't actually do anything

EleutherAI / the-pile

MIT License

1.46k stars 126 forks source link

The `--using` flag doesn't actually do anything #58

Closed StellaAthena closed 3 years ago

StellaAthena commented 3 years ago

If you run python3 the_pile/pile.py --using bibliotik then only Wikipedia will be downloaded. If you run python3 the_pile/pile.py --download --using bibliotik then the entire Pile will be downloaded.