huggingface / tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
https://huggingface.co/docs/tokenizers
Apache License 2.0
8.68k stars 746 forks source link

bugs #1450

Closed projecthorizon993 closed 4 months ago

projecthorizon993 commented 4 months ago

Traceback (most recent call last): File "/workspace/.pyenv_mirror/user/current/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in main() File "/workspace/.pyenv_mirror/user/current/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main json_out['return_val'] = hook(**hook_input['kwargs']) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/workspace/.pyenv_mirror/user/current/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 112, in get_requires_for_build_wheel backend = _build_backend() ^^^^^^^^^^^^^^^^ File "/workspace/.pyenv_mirror/user/current/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 77, in _build_backend obj = import_module(mod_path) ^^^^^^^^^^^^^^^^^^^^^^^ File "/home/gitpod/.pyenv/versions/3.12.1/lib/python3.12/importlib/init.py", line 90, in import_module return _bootstrap._gcd_import(name[level:], package, level) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "", line 1387, in _gcd_import File "", line 1360, in _find_and_load File "", line 1310, in _find_and_load_unlocked File "", line 488, in _call_with_frames_removed File "", line 1387, in _gcd_import File "", line 1360, in _find_and_load File "", line 1331, in _find_and_load_unlocked File "", line 935, in _load_unlocked File "", line 994, in exec_module File "", line 488, in _call_with_frames_removed File "/tmp/pip-build-env-kf0fbvny/overlay/lib/python3.12/site-packages/setuptools/init.py", line 16, in import setuptools.version File "/tmp/pip-build-env-kf0fbvny/overlay/lib/python3.12/site-packages/setuptools/version.py", line 1, in import pkg_resources File "/tmp/pip-build-env-kf0fbvny/overlay/lib/python3.12/site-packages/pkg_resources/init.py", line 2172, in register_finder(pkgutil.ImpImporter, find_on_path)

ArthurZucker commented 4 months ago

Could you share a reproducer, the env you are using etc? 🤗

projecthorizon993 commented 4 months ago

Could you share a reproducer, the env you are using etc? 🤗

so I run on a gitpod and env is .venv It run like 2 mins and goes down like you see now it like this

Style database not found: /workspace/file/stable-diffusion-webui/styles.csv Warning: caught exception 'Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx', memory monitor disabled Traceback (most recent call last): File "/workspace/file/stable-diffusion-webui/launch.py", line 48, in main() File "/workspace/file/stable-diffusion-webui/launch.py", line 44, in main start() File "/workspace/file/stable-diffusion-webui/modules/launch_utils.py", line 460, in start import webui File "/workspace/file/stable-diffusion-webui/webui.py", line 13, in initialize.imports() File "/workspace/file/stable-diffusion-webui/modules/initialize.py", line 37, in imports from modules import processing, gradio_extensons, ui # noqa: F401 File "/workspace/file/stable-diffusion-webui/modules/processing.py", line 14, in import cv2 File "/workspace/file/.venv/lib/python3.10/site-packages/cv2/init.py", line 181, in bootstrap() File "/workspace/file/.venv/lib/python3.10/site-packages/cv2/init.py", line 153, in bootstrap native_module = importlib.import_module("cv2") File "/usr/lib/python3.10/importlib/init.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) ImportError: libGL.so.1: cannot open shared object file: No such file or directory

projecthorizon993 commented 4 months ago

Could you share a reproducer, the env you are using etc? 🤗

now it like this

Style database not found: /workspace/file/stable-diffusion-webui/styles.csv

projecthorizon993 commented 4 months ago

sorry misclicked

my bad

ArthurZucker commented 4 months ago

this seems unrelated to tokenizers and points to cv2 package