search

EleutherAI / the-pile

MIT License
1.48k stars 129 forks source link

Could you possibly share the 825GB pile data temporarily and unofficially? #120

Open dsdanielpark opened 8 months ago

dsdanielpark commented 8 months ago

Hello, I sincerely appreciate your excellent work.

Due to copyright issues with the pile, it's no longer possible to download the 825GB of data, so I can't use the decontamination feature of harness.

I am inquiring if anyone could share the 825GB data. The data will be used solely for academic purposes to examine contamination in the dataset.

If it's possible to share in any way, I would greatly appreciate it.

Thank you.

dsdanielpark commented 8 months ago

117

magnet:?xt=urn:btih:0d366035664fdf51cfbe9f733953ba325776e667

zhouyuan888888 commented 5 months ago

117

magnet:?xt=urn:btih:0d366035664fdf51cfbe9f733953ba325776e667

Thank you guys, it seems that this link is inaccessible to downloading the dataset. Is there any other ways to download pile?