search

anikl9705 / NLP-Project-Paws

0 stars 0 forks source link

Cannot install Transformers version >2.3.0 with pip on MacOS #1

Open Yuanyuan-T opened 4 years ago

Yuanyuan-T commented 4 years ago

error: Can not find Rust compiler

see https://github.com/huggingface/transformers/issues/2980

Yuanyuan-T commented 4 years ago

Solution: https://github.com/huggingface/transformers/issues/2831

Managed to solve it and install Transformers 2.5.1 by manually install the last version of tokenizers (0.6.0) instead of 0.5.2 that is required in the transformer package.

pip install tokenizers

Git clone latest version of transformers:

git clone https://github.com/huggingface/transformers

Before running the installation edit transformers/setup.py and change requirement of tokenizers to 0.6.0

Line 93: install_requires=[ "numpy", "tokenizers == 0.6.0",

Then run as usual:

cd transformers pip install .

I assume that you could also skip the first step and just collect the package as you run the install. I'm quite new to this, so just wanted to share my take.