Closed phatjkk closed 10 months ago
It's a mismatch with the latest version of transformers. You might want to use an older version of transformers (e.g., 4.33).
I will make a fix to work with the latest version of transformers soon.
@phatjkk code updated, please help check whether it works fine in your side with the latest transformers.
check
Hi, I met this problem with 4.36.0/1/2. I update my transformers to use mixtral-8x7b.
How can I solve this issue. Thank you.
@phatjkk code updated, please help check whether it works fine in your side with the latest transformers.
My older version is 4.31.0 and it was no problem.
Also have this issue with 4.36.2
Please clear your cache of PhoGPT, and re-download it. https://huggingface.co/vinai/PhoGPT-7B5-Instruct/blob/main/hf_prefixlm_converter.py was updated without any bloom modeling.
Please clear your cache of PhoGPT, and re-download it. https://huggingface.co/vinai/PhoGPT-7B5-Instruct/blob/main/hf_prefixlm_converter.py was updated without any bloom modeling.
Thank you, I will try this.
Hi ! Thank you for your excellent work!
I got this error when trying to run the model on Google Colab. I use the example code on README file:
The error:![image](https://github.com/VinAIResearch/PhoGPT/assets/48487157/3aa47e7e-b7b4-4bf3-8692-3c49a470c761)
I don't know how to fix it, but I found the same issue at : https://huggingface.co/mosaicml/mpt-7b/discussions/83
Can you tell me how to run it? Thanks you!