fix: update the version of transformers to support in evaluating gpt-neo models

bigscience-workshop / evaluation

Code and Data for Evaluation WG

Other

41 stars 24 forks source link

fix: update the version of transformers to support in evaluating gpt-neo models #74

Open YU-Anthony opened 2 years ago

YU-Anthony commented 2 years ago

Evaluated on: GPT Neo

There is an error would happen if you want to evaluate gpt-neo related models (e.g. "EleutherAI/gpt-neo-125M") using the original version of transformers. This is due to the change of modeling_gpt_neo.py file in the latest version of transformers.

jaketae commented 2 years ago

Hey @YU-Anthony, thanks for flagging this. I agree that we want to bump outdated versions. However, it seems like bumping transformers only introduces compatibility issues with other packages. I will open a separate PR that removes hard-coded version requirements in favor of >=.