search

UbiquitousLearning / FedAdapter

"Efficient Federated Learning for Modern NLP", to appear at MobiCom 2023.
27 stars 2 forks source link

AutoModelWithHeads module not found #1

Open PaulaDelgado-Santos opened 5 months ago

PaulaDelgado-Santos commented 5 months ago

Good morning, I'm trying to run the code but the AutoModelWithHeads module is not found (and I didn't find it in the Transformers folder). Although I did find AutoModelWithLMHead inside that folder, can it be replaced? I guess this code was made with the implementation of the Hugging Face adapter,, but since Transformers is re-install with the folder in this project, that module is not found.

caidongqi commented 5 months ago

Did you install the right transformer version? The concrete transformer we used is "adapter-transformers 2.3.0", that is not an official transformer implemented by huggingface. It is implemented by adapterhub.

Please run pip install adapter-transformers 2.3.0 to re-install it.

Btw, we recommend you use the docker image to avoid any environment issues.

I hope it helps.