search

kaistAI / LangBridge

[ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision
https://aclanthology.org/2024.acl-long.405/
81 stars 7 forks source link

Question related MMLU tasks #5

Closed OmarMohammed88 closed 6 months ago

OmarMohammed88 commented 6 months ago

thanks for the amazing works. i need to test the models on MMLU task.So i need to get the last token logits by model.foward() , how can i do that ?

MattYoon commented 6 months ago

Hey @OmarMohammed88, thanks for your interest in our work.

LangBridge models inherit Transformer's PreTrainedModel and return CausalLMOutputWithPast, just like any other causal models officially supported by Huggingface Transformers.

So the code you use for other LMs will work on LangBridge models as well.

Please let me know if you have further questions!

OmarMohammed88 commented 6 months ago

ok thanks for the info