mega002 / ff-layers

The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Levy. EMNLP, 2021.
MIT License
82 stars 5 forks source link

Unable to download the WikiText-103 dataset #1

Closed Iust1n2 closed 2 months ago

Iust1n2 commented 3 months ago

I'm getting an acces denied error when i try to download the dataset from this link.

Also, the link from here is invalid too.

mega002 commented 2 months ago

Hi @Iust1n2 ,

Thanks for creating this issue.

Yes, I get this error as well. I am not sure why they restricted the download from the website. In any case, I believe the same data is available on HuggingFace: https://huggingface.co/datasets/Salesforce/wikitext

I hope this helps. Will close this issue for now as I am not able to maintain the code in this repository anymore, and specifically validate that the results are reproducible with the data on HuggingFace.

Best, Mor