UKPLab / sentence-transformers

State-of-the-Art Text Embeddings
https://www.sbert.net
Apache License 2.0
15.12k stars 2.46k forks source link

Error while installing on MacOS Monterey 12.4 #1601

Open momo1606 opened 2 years ago

momo1606 commented 2 years ago

error while installing through "pip3 install sentence-transformers " command Python version 3.8.9

Terminal output -

Defaulting to user installation because normal site-packages is not writeable Collecting sentence-transformers Downloading sentence-transformers-2.2.0.tar.gz (79 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 79.7/79.7 kB 1.6 MB/s eta 0:00:00 Preparing metadata (setup.py) ... done Collecting transformers<5.0.0,>=4.6.0 Downloading transformers-4.20.0-py3-none-any.whl (4.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.4/4.4 MB 1.5 MB/s eta 0:00:00 Requirement already satisfied: tqdm in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from sentence-transformers) (4.64.0) Collecting torch>=1.6.0 Downloading torch-1.11.0-cp38-none-macosx_11_0_arm64.whl (43.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.1/43.1 MB 980.8 kB/s eta 0:00:00 Collecting torchvision Downloading torchvision-0.12.0-cp38-cp38-macosx_11_0_arm64.whl (1.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 1.3 MB/s eta 0:00:00 Requirement already satisfied: numpy in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from sentence-transformers) (1.21.2) Requirement already satisfied: scikit-learn in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from sentence-transformers) (1.1.0) Requirement already satisfied: scipy in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from sentence-transformers) (1.8.1) Requirement already satisfied: nltk in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from sentence-transformers) (3.6.5) Collecting sentencepiece Downloading sentencepiece-0.1.96.tar.gz (508 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 508.6/508.6 kB 1.6 MB/s eta 0:00:00 Preparing metadata (setup.py) ... done Collecting huggingface-hub Downloading huggingface_hub-0.7.0-py3-none-any.whl (86 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86.2/86.2 kB 1.7 MB/s eta 0:00:00 Requirement already satisfied: typing-extensions in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from torch>=1.6.0->sentence-transformers) (3.10.0.2) Collecting pyyaml>=5.1 Downloading PyYAML-6.0.tar.gz (124 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 125.0/125.0 kB 1.7 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Requirement already satisfied: requests in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers) (2.26.0) Collecting tokenizers!=0.11.3,<0.13,>=0.11.1 Downloading tokenizers-0.12.1.tar.gz (220 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 220.7/220.7 kB 1.6 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... error error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> [32 lines of output] Traceback (most recent call last): File "/Users/mohammedk/Library/Python/3.8/lib/python/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in main() File "/Users/mohammedk/Library/Python/3.8/lib/python/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main json_out['return_val'] = hook(hook_input['kwargs']) File "/Users/mohammedk/Library/Python/3.8/lib/python/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 130, in get_requires_for_build_wheel return hook(config_settings) File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/build_meta.py", line 146, in get_requires_for_build_wheel return self._get_build_requires( File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/build_meta.py", line 127, in _get_build_requires self.run_setup() File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/build_meta.py", line 142, in run_setup exec(compile(code, file, 'exec'), locals()) File "setup.py", line 8, in setup( File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/init.py", line 165, in setup return distutils.core.setup(attrs) File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 108, in setup _setup_distribution = dist = klass(attrs) File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/dist.py", line 429, in init _Distribution.init(self, { File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 293, in init self.finalize_options() File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/dist.py", line 721, in finalize_options ep(self) File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/dist.py", line 727, in _finalize_setup_keywords ep.require(installer=self.fetch_build_egg) File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/pkg_resources/init.py", line 2483, in require items = working_set.resolve(reqs, env, installer, extras=self.extras) File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/pkg_resources/init.py", line 790, in resolve raise VersionConflict(dist, req).with_context(dependent_req) pkg_resources.VersionConflict: (setuptools 49.2.1 (/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages), Requirement.parse('setuptools>=58.0')) [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

mglazarova commented 2 years ago

I also had similar problems. I followed this guide to install tokenizers. Once you install tokenizers, you should be able to install sentence-transformers.