Dataset download and size changes. - Githubissues

EleutherAI / the-pile

MIT License

1.46k stars 126 forks source link

Dataset download and size changes. #59

Closed researcher2 closed 3 years ago

researcher2 commented 3 years ago

Update Gutenberg download Add hardcodes sizes for Gutenberg and Wiki