search

jkallini / mission-impossible-language-models

Code repository for the paper "Mission: Impossible Language Models".
https://arxiv.org/abs/2401.06416
31 stars 2 forks source link

Request for GPT-2 models trained on impossible languages #1

Open y1ny opened 1 month ago

y1ny commented 1 month ago

Hi, excellent work! I'm interested in testing a few sentences with the GPT-2 models trained on the impossible languages. Have you considered uploading the models? While I see that you've provided the training scripts, training the models from scratch, as you mentioned in Appendix B, is quite time-consuming.

stevenwalton commented 1 month ago

I am also interested. Did you also happen to have wandb logs (I know mistral includes wandb logging in their training script)?

chunhuizng commented 1 month ago

I am interested too! That would be very helpful