Llama3.1-8B-Instruct evaluation fails

[Isaaclgz]

Running the following command with Llama-3.1-8B-Instruct fails with a AttributeError: 'function' object has no attribute 'pad_token' error. I am using the adding_all_changess branch to replicate the leaderboard results. Any help is greatly appreciated!

lm_eval \
--output_path ./outputs \
--model hf \
--tasks leaderboard_gpqa \
--model_args pretrained=meta-llama/Llama-3.1-8B-Instruct,dtype=bfloat16 \
--batch_size auto \
--use_cache ./cache \
--log_samples \
--trust_remote_code \
--verbosity DEBUG

[baberabb]

Hi! might be able to help if you provide the full stack trace.