search

EleutherAI / the-pile

MIT License
1.46k stars 126 forks source link

Multilingual Wikipedia #61

Closed StellaAthena closed 3 years ago

StellaAthena commented 3 years ago

We already have Wikipedia (en), but there's 122+ GB of content in other languages too! Link to a dump.

QazQazaq commented 3 years ago

This would be a good addition

QazQazaq commented 3 years ago

This is done without moving to the in progress?