error while installing through "pip3 install sentence-transformers " command
Python version 3.8.9
Terminal output -
Defaulting to user installation because normal site-packages is not writeable
Collecting sentence-transformers
Downloading sentence-transformers-2.2.0.tar.gz (79 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 79.7/79.7 kB 1.6 MB/s eta 0:00:00
Preparing metadata (setup.py) ... done
Collecting transformers<5.0.0,>=4.6.0
Downloading transformers-4.20.0-py3-none-any.whl (4.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.4/4.4 MB 1.5 MB/s eta 0:00:00
Requirement already satisfied: tqdm in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from sentence-transformers) (4.64.0)
Collecting torch>=1.6.0
Downloading torch-1.11.0-cp38-none-macosx_11_0_arm64.whl (43.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.1/43.1 MB 980.8 kB/s eta 0:00:00
Collecting torchvision
Downloading torchvision-0.12.0-cp38-cp38-macosx_11_0_arm64.whl (1.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 1.3 MB/s eta 0:00:00
Requirement already satisfied: numpy in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from sentence-transformers) (1.21.2)
Requirement already satisfied: scikit-learn in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from sentence-transformers) (1.1.0)
Requirement already satisfied: scipy in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from sentence-transformers) (1.8.1)
Requirement already satisfied: nltk in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from sentence-transformers) (3.6.5)
Collecting sentencepiece
Downloading sentencepiece-0.1.96.tar.gz (508 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 508.6/508.6 kB 1.6 MB/s eta 0:00:00
Preparing metadata (setup.py) ... done
Collecting huggingface-hub
Downloading huggingface_hub-0.7.0-py3-none-any.whl (86 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86.2/86.2 kB 1.7 MB/s eta 0:00:00
Requirement already satisfied: typing-extensions in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from torch>=1.6.0->sentence-transformers) (3.10.0.2)
Collecting pyyaml>=5.1
Downloading PyYAML-6.0.tar.gz (124 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 125.0/125.0 kB 1.7 MB/s eta 0:00:00
Installing build dependencies ... done
Getting requirements to build wheel ... done
Preparing metadata (pyproject.toml) ... done
Requirement already satisfied: requests in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers) (2.26.0)
Collecting tokenizers!=0.11.3,<0.13,>=0.11.1
Downloading tokenizers-0.12.1.tar.gz (220 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 220.7/220.7 kB 1.6 MB/s eta 0:00:00
Installing build dependencies ... done
Getting requirements to build wheel ... error
error: subprocess-exited-with-error
× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> [32 lines of output]
Traceback (most recent call last):
File "/Users/mohammedk/Library/Python/3.8/lib/python/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in
main()
File "/Users/mohammedk/Library/Python/3.8/lib/python/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main
json_out['return_val'] = hook(hook_input['kwargs'])
File "/Users/mohammedk/Library/Python/3.8/lib/python/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 130, in get_requires_for_build_wheel
return hook(config_settings)
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/build_meta.py", line 146, in get_requires_for_build_wheel
return self._get_build_requires(
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/build_meta.py", line 127, in _get_build_requires
self.run_setup()
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/build_meta.py", line 142, in run_setup
exec(compile(code, file, 'exec'), locals())
File "setup.py", line 8, in
setup(
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/init.py", line 165, in setup
return distutils.core.setup(attrs)
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 108, in setup
_setup_distribution = dist = klass(attrs)
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/dist.py", line 429, in init
_Distribution.init(self, {
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 293, in init
self.finalize_options()
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/dist.py", line 721, in finalize_options
ep(self)
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/dist.py", line 727, in _finalize_setup_keywords
ep.require(installer=self.fetch_build_egg)
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/pkg_resources/init.py", line 2483, in require
items = working_set.resolve(reqs, env, installer, extras=self.extras)
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/pkg_resources/init.py", line 790, in resolve
raise VersionConflict(dist, req).with_context(dependent_req)
pkg_resources.VersionConflict: (setuptools 49.2.1 (/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages), Requirement.parse('setuptools>=58.0'))
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error
× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.
I also had similar problems. I followed this guide to install tokenizers. Once you install tokenizers, you should be able to install sentence-transformers.
error while installing through "pip3 install sentence-transformers " command Python version 3.8.9
Terminal output -
Defaulting to user installation because normal site-packages is not writeable Collecting sentence-transformers Downloading sentence-transformers-2.2.0.tar.gz (79 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 79.7/79.7 kB 1.6 MB/s eta 0:00:00 Preparing metadata (setup.py) ... done Collecting transformers<5.0.0,>=4.6.0 Downloading transformers-4.20.0-py3-none-any.whl (4.4 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.4/4.4 MB 1.5 MB/s eta 0:00:00 Requirement already satisfied: tqdm in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from sentence-transformers) (4.64.0) Collecting torch>=1.6.0 Downloading torch-1.11.0-cp38-none-macosx_11_0_arm64.whl (43.1 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.1/43.1 MB 980.8 kB/s eta 0:00:00 Collecting torchvision Downloading torchvision-0.12.0-cp38-cp38-macosx_11_0_arm64.whl (1.2 MB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 1.3 MB/s eta 0:00:00 Requirement already satisfied: numpy in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from sentence-transformers) (1.21.2) Requirement already satisfied: scikit-learn in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from sentence-transformers) (1.1.0) Requirement already satisfied: scipy in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from sentence-transformers) (1.8.1) Requirement already satisfied: nltk in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from sentence-transformers) (3.6.5) Collecting sentencepiece Downloading sentencepiece-0.1.96.tar.gz (508 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 508.6/508.6 kB 1.6 MB/s eta 0:00:00 Preparing metadata (setup.py) ... done Collecting huggingface-hub Downloading huggingface_hub-0.7.0-py3-none-any.whl (86 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 86.2/86.2 kB 1.7 MB/s eta 0:00:00 Requirement already satisfied: typing-extensions in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from torch>=1.6.0->sentence-transformers) (3.10.0.2) Collecting pyyaml>=5.1 Downloading PyYAML-6.0.tar.gz (124 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 125.0/125.0 kB 1.7 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... done Preparing metadata (pyproject.toml) ... done Requirement already satisfied: requests in /Users/mohammedk/Library/Python/3.8/lib/python/site-packages (from transformers<5.0.0,>=4.6.0->sentence-transformers) (2.26.0) Collecting tokenizers!=0.11.3,<0.13,>=0.11.1 Downloading tokenizers-0.12.1.tar.gz (220 kB) ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 220.7/220.7 kB 1.6 MB/s eta 0:00:00 Installing build dependencies ... done Getting requirements to build wheel ... error error: subprocess-exited-with-error
× Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> [32 lines of output] Traceback (most recent call last): File "/Users/mohammedk/Library/Python/3.8/lib/python/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in
main()
File "/Users/mohammedk/Library/Python/3.8/lib/python/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main
json_out['return_val'] = hook(hook_input['kwargs'])
File "/Users/mohammedk/Library/Python/3.8/lib/python/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 130, in get_requires_for_build_wheel
return hook(config_settings)
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/build_meta.py", line 146, in get_requires_for_build_wheel
return self._get_build_requires(
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/build_meta.py", line 127, in _get_build_requires
self.run_setup()
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/build_meta.py", line 142, in run_setup
exec(compile(code, file, 'exec'), locals())
File "setup.py", line 8, in
setup(
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/init.py", line 165, in setup
return distutils.core.setup( attrs)
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 108, in setup
_setup_distribution = dist = klass(attrs)
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/dist.py", line 429, in init
_Distribution.init(self, {
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 293, in init
self.finalize_options()
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/dist.py", line 721, in finalize_options
ep(self)
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/setuptools/dist.py", line 727, in _finalize_setup_keywords
ep.require(installer=self.fetch_build_egg)
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/pkg_resources/init.py", line 2483, in require
items = working_set.resolve(reqs, env, installer, extras=self.extras)
File "/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages/pkg_resources/init.py", line 790, in resolve
raise VersionConflict(dist, req).with_context(dependent_req)
pkg_resources.VersionConflict: (setuptools 49.2.1 (/Library/Developer/CommandLineTools/Library/Frameworks/Python3.framework/Versions/3.8/lib/python3.8/site-packages), Requirement.parse('setuptools>=58.0'))
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip. error: subprocess-exited-with-error
× Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip.