Open Kosei1227 opened 2 days ago
To be frank, I haven't taken a deep look in to this issue.
I think you can get some insights as to what happened by checking the update logs of Transformers. But at the moment, I don't have the capacity to debug LangBridge in newer versions of Transformers :( If you manage to find the issue, please let me know though.
Thank you so much for your immediate response. I will follow the updated changes of transformers to fix the issue.
Just to confirm, was tansformer=4.37.2 the latest version when you designed LangBridge?
I would like to know why the authors used the version in this paper.
Yeah, I believe that was the latest at the time.
Hi, our team wants to test LangBridge on Gemma2 but as Gemma2 is not created for transformers==4.37.2, I created the LangBridge model on Gemma2 with the transformers==4.42.0. But the result is terrible. The model cannot even produce reasonable texts.
Also, we defined the custom langbridge model as seen below.
Could you tell us why the transformer version 4.37.2 is required for LangBridge?
Thank you