Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).
MIT License
123
stars
10
forks
source link
ImportError while trying to use device_map = "auto" parameter. #7
Hi. I encountered an _ImportError while trying to use _devicemap = "auto" parameter._ The builder module from the google.protobuf.internal returns with an ImportEror, blocks the usage of device_map parameter. Tested with CPU, 1xT4, 1xA100.
Python Version:
pip 23.1.2 from /usr/local/lib/python3.10/dist-packages/pip (python 3.10)
Python 3.10.12
Versions of protobuf dependencies:
protobuf in /usr/local/lib/python3.10/dist-packages (3.19.6)
grpcio in /usr/local/lib/python3.10/dist-packages (1.56.0)
Hi. I encountered an _ImportError while trying to use _devicemap = "auto" parameter._ The builder module from the google.protobuf.internal returns with an ImportEror, blocks the usage of device_map parameter. Tested with CPU, 1xT4, 1xA100.
Python Version:
pip 23.1.2 from /usr/local/lib/python3.10/dist-packages/pip (python 3.10) Python 3.10.12
Versions of protobuf dependencies:
protobuf in /usr/local/lib/python3.10/dist-packages (3.19.6) grpcio in /usr/local/lib/python3.10/dist-packages (1.56.0)