Closed a-ml closed 2 months ago
I have these constraints:
I'm unclear why the constraint works (says has to be 2.3.1 for MAC) but the requirements.txt (that uses same constraint) thinks it needs to use 2.2.1.
Can you give more complete logs of the install?
I've deleted the env and I'm trying recreate it again... I'll update
I've created a brand-new conda environment, tried to follow the instructions and I got the same error.
Here complete install logs
❯ conda activate h2ogpt
❯ pip uninstall -y pandoc pypandoc pypandoc-binary
WARNING: Skipping pandoc as it is not installed.
WARNING: Skipping pypandoc as it is not installed.
WARNING: Skipping pypandoc-binary as it is not installed.
❯ pip install --upgrade pip
Requirement already satisfied: pip in /Users/kapenge/miniconda3/envs/h2ogpt/lib/python3.10/site-packages (24.0)
Collecting pip
Using cached pip-24.2-py3-none-any.whl.metadata (3.6 kB)
Using cached pip-24.2-py3-none-any.whl (1.8 MB)
Installing collected packages: pip
Attempting uninstall: pip
Found existing installation: pip 24.0
Uninstalling pip-24.0:
Successfully uninstalled pip-24.0
Successfully installed pip-24.2
❯ python -m pip install --upgrade setuptools
Requirement already satisfied: setuptools in /Users/kapenge/miniconda3/envs/h2ogpt/lib/python3.10/site-packages (72.1.0)
❯ pip install -r requirements.txt --extra-index https://download.pytorch.org/whl/cpu -c reqs_optional/reqs_constraints.txt
Looking in indexes: https://pypi.org/simple, https://download.pytorch.org/whl/cpu
Collecting gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl (from -r requirements.txt (line 8))
Using cached https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl (17.3 MB)
Collecting gradio_client@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio_client-0.15.1-py3-none-any.whl (from -r requirements.txt (line 9))
Using cached https://h2o-release.s3.amazonaws.com/h2ogpt/gradio_client-0.15.1-py3-none-any.whl (313 kB)
Ignoring torch: markers 'sys_platform != "darwin" and platform_machine != "arm64"' don't match your environment
Ignoring bitsandbytes: markers 'sys_platform != "darwin" and platform_machine != "arm64"' don't match your environment
Ignoring pypandoc_binary: markers 'platform_machine == "x86_64"' don't match your environment
Ignoring pypandoc_binary: markers 'platform_system == "Windows"' don't match your environment
Ignoring python-magic-bin: markers 'platform_system == "Windows"' don't match your environment
Collecting InstructorEmbedding@ https://h2o-release.s3.amazonaws.com/h2ogpt/InstructorEmbedding-1.0.1-py3-none-any.whl (from -r requirements.txt (line 74))
Using cached https://h2o-release.s3.amazonaws.com/h2ogpt/InstructorEmbedding-1.0.1-py3-none-any.whl (20 kB)
Collecting sentence_transformers_old@ https://h2o-release.s3.amazonaws.com/h2ogpt/sentence_transformers_old-2.2.2-py3-none-any.whl (from -r requirements.txt (line 75))
Using cached https://h2o-release.s3.amazonaws.com/h2ogpt/sentence_transformers_old-2.2.2-py3-none-any.whl (125 kB)
Collecting gunicorn (from -r requirements.txt (line 12))
Using cached gunicorn-22.0.0-py3-none-any.whl.metadata (4.4 kB)
Collecting fastapi-utils (from -r requirements.txt (line 13))
Using cached fastapi_utils-0.7.0-py3-none-any.whl.metadata (5.4 kB)
Collecting sse_starlette>=1.8.2 (from -r requirements.txt (line 14))
Downloading sse_starlette-2.1.3-py3-none-any.whl.metadata (5.8 kB)
Collecting huggingface_hub>=0.23.3 (from -r requirements.txt (line 16))
Using cached huggingface_hub-0.24.5-py3-none-any.whl.metadata (13 kB)
Collecting appdirs>=1.4.4 (from -r requirements.txt (line 17))
Using cached appdirs-1.4.4-py2.py3-none-any.whl.metadata (9.0 kB)
Collecting fire>=0.5.0 (from -r requirements.txt (line 18))
Downloading fire-0.6.0.tar.gz (88 kB)
Preparing metadata (setup.py) ... done
Collecting docutils>=0.20.1 (from -r requirements.txt (line 19))
Downloading docutils-0.21.2-py3-none-any.whl.metadata (2.8 kB)
Collecting torch==2.3.1 (from -r requirements.txt (line 21))
Using cached https://download.pytorch.org/whl/cpu/torch-2.3.1-cp310-none-macosx_11_0_arm64.whl (61.0 MB)
Collecting evaluate>=0.4.0 (from -r requirements.txt (line 22))
Downloading evaluate-0.4.2-py3-none-any.whl.metadata (9.3 kB)
Collecting rouge_score>=0.1.2 (from -r requirements.txt (line 23))
Using cached rouge_score-0.1.2-py3-none-any.whl
Collecting sacrebleu>=2.3.1 (from -r requirements.txt (line 24))
Downloading sacrebleu-2.4.2-py3-none-any.whl.metadata (58 kB)
Collecting scikit-learn>=1.2.2 (from -r requirements.txt (line 25))
Downloading scikit_learn-1.5.1-cp310-cp310-macosx_12_0_arm64.whl.metadata (12 kB)
Collecting numpy<2.0,>=1.23.4 (from -r requirements.txt (line 29))
Downloading numpy-1.26.4-cp310-cp310-macosx_11_0_arm64.whl.metadata (61 kB)
Collecting pandas>=2.0.2 (from -r requirements.txt (line 30))
Downloading pandas-2.2.2-cp310-cp310-macosx_11_0_arm64.whl.metadata (19 kB)
Collecting matplotlib>=3.7.1 (from -r requirements.txt (line 31))
Downloading matplotlib-3.9.1.post1-cp310-cp310-macosx_11_0_arm64.whl.metadata (11 kB)
Collecting loralib>=0.1.2 (from -r requirements.txt (line 34))
Using cached loralib-0.1.2-py3-none-any.whl.metadata (15 kB)
Collecting bitsandbytes==0.42.0 (from -r requirements.txt (line 37))
Using cached bitsandbytes-0.42.0-py3-none-any.whl.metadata (9.9 kB)
Collecting accelerate>=0.30.1 (from -r requirements.txt (line 38))
Using cached accelerate-0.33.0-py3-none-any.whl.metadata (18 kB)
Collecting peft>=0.7.0 (from -r requirements.txt (line 39))
Downloading peft-0.12.0-py3-none-any.whl.metadata (13 kB)
Collecting transformers>=4.43.2 (from -r requirements.txt (line 40))
Using cached transformers-4.44.0-py3-none-any.whl.metadata (43 kB)
Collecting jinja2>=3.1.0 (from -r requirements.txt (line 41))
Using cached jinja2-3.1.4-py3-none-any.whl.metadata (2.6 kB)
Collecting tokenizers>=0.19.0 (from -r requirements.txt (line 42))
Using cached tokenizers-0.20.0-cp310-cp310-macosx_11_0_arm64.whl.metadata (6.7 kB)
Collecting hf_transfer>=0.1.6 (from -r requirements.txt (line 43))
Downloading hf_transfer-0.1.8-cp310-cp310-macosx_11_0_arm64.whl.metadata (1.7 kB)
Collecting optimum>=1.17.1 (from -r requirements.txt (line 44))
Using cached optimum-1.21.3-py3-none-any.whl.metadata (19 kB)
Collecting datasets>=2.18.0 (from -r requirements.txt (line 45))
Using cached datasets-2.20.0-py3-none-any.whl.metadata (19 kB)
Collecting sentencepiece>=0.2.0 (from -r requirements.txt (line 46))
Using cached sentencepiece-0.2.0-cp310-cp310-macosx_11_0_arm64.whl.metadata (7.7 kB)
Collecting APScheduler>=3.10.1 (from -r requirements.txt (line 48))
Downloading APScheduler-3.10.4-py3-none-any.whl.metadata (5.7 kB)
Collecting pynvml>=11.5.0 (from -r requirements.txt (line 51))
Downloading pynvml-11.5.3-py3-none-any.whl.metadata (8.8 kB)
Collecting psutil>=5.9.5 (from -r requirements.txt (line 52))
Using cached psutil-6.0.0-cp38-abi3-macosx_11_0_arm64.whl.metadata (21 kB)
Collecting boto3>=1.26.101 (from -r requirements.txt (line 53))
Downloading boto3-1.34.158-py3-none-any.whl.metadata (6.6 kB)
Collecting botocore>=1.29.101 (from -r requirements.txt (line 54))
Downloading botocore-1.34.158-py3-none-any.whl.metadata (5.7 kB)
Collecting beautifulsoup4>=4.12.2 (from -r requirements.txt (line 55))
Using cached beautifulsoup4-4.12.3-py3-none-any.whl.metadata (3.8 kB)
Collecting markdown>=3.4.3 (from -r requirements.txt (line 56))
Downloading Markdown-3.6-py3-none-any.whl.metadata (7.0 kB)
Collecting pytest>=7.2.2 (from -r requirements.txt (line 59))
Downloading pytest-8.3.2-py3-none-any.whl.metadata (7.5 kB)
Collecting pytest-xdist>=3.2.1 (from -r requirements.txt (line 60))
Downloading pytest_xdist-3.6.1-py3-none-any.whl.metadata (4.3 kB)
Collecting nltk>=3.8.1 (from -r requirements.txt (line 61))
Using cached nltk-3.8.1-py3-none-any.whl.metadata (2.8 kB)
Collecting textstat>=0.7.3 (from -r requirements.txt (line 62))
Downloading textstat-0.7.4-py3-none-any.whl.metadata (14 kB)
Collecting pypandoc>=1.11 (from -r requirements.txt (line 64))
Using cached pypandoc-1.13-py3-none-any.whl.metadata (16 kB)
Collecting openpyxl>=3.1.2 (from -r requirements.txt (line 68))
Downloading openpyxl-3.1.5-py2.py3-none-any.whl.metadata (2.5 kB)
Collecting lm_dataformat>=0.0.20 (from -r requirements.txt (line 69))
Downloading lm_dataformat-0.0.20-py3-none-any.whl.metadata (1.2 kB)
Collecting bioc>=2.0 (from -r requirements.txt (line 70))
Downloading bioc-2.1-py3-none-any.whl.metadata (4.6 kB)
Collecting sentence_transformers>=3.0.1 (from -r requirements.txt (line 73))
Using cached sentence_transformers-3.0.1-py3-none-any.whl.metadata (10 kB)
Collecting einops>=0.6.1 (from -r requirements.txt (line 78))
Downloading einops-0.8.0-py3-none-any.whl.metadata (12 kB)
Collecting python-dotenv>=1.0.0 (from -r requirements.txt (line 81))
Using cached python_dotenv-1.0.1-py3-none-any.whl.metadata (23 kB)
Collecting json_repair>=0.21.0 (from -r requirements.txt (line 83))
Using cached json_repair-0.27.0-py3-none-any.whl.metadata (7.9 kB)
Collecting text-generation>=0.7.0 (from -r requirements.txt (line 85))
Using cached text_generation-0.7.0-py3-none-any.whl.metadata (8.5 kB)
Collecting tiktoken>=0.5.2 (from -r requirements.txt (line 88))
Using cached tiktoken-0.7.0-cp310-cp310-macosx_11_0_arm64.whl.metadata (6.6 kB)
Collecting openai>=1.40.1 (from -r requirements.txt (line 91))
Using cached openai-1.40.2-py3-none-any.whl.metadata (22 kB)
Collecting requests>=2.31.0 (from -r requirements.txt (line 93))
Using cached requests-2.32.3-py3-none-any.whl.metadata (4.6 kB)
Collecting httpx>=0.24.1 (from -r requirements.txt (line 94))
Using cached httpx-0.27.0-py3-none-any.whl.metadata (7.2 kB)
Collecting urllib3>=1.26.16 (from -r requirements.txt (line 95))
Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB)
Collecting filelock>=3.12.2 (from -r requirements.txt (line 96))
Using cached filelock-3.15.4-py3-none-any.whl.metadata (2.9 kB)
Collecting joblib>=1.3.1 (from -r requirements.txt (line 97))
Using cached joblib-1.4.2-py3-none-any.whl.metadata (5.4 kB)
Collecting tqdm>=4.65.0 (from -r requirements.txt (line 98))
Using cached tqdm-4.66.5-py3-none-any.whl.metadata (57 kB)
Collecting tabulate>=0.9.0 (from -r requirements.txt (line 99))
Using cached tabulate-0.9.0-py3-none-any.whl.metadata (34 kB)
Collecting packaging>=23.1 (from -r requirements.txt (line 100))
Using cached packaging-24.1-py3-none-any.whl.metadata (3.2 kB)
Collecting uvicorn[standard] (from -r requirements.txt (line 11))
Downloading uvicorn-0.30.5-py3-none-any.whl.metadata (6.6 kB)
Collecting typing-extensions>=4.8.0 (from torch==2.3.1->-r requirements.txt (line 21))
Using cached typing_extensions-4.12.2-py3-none-any.whl.metadata (3.0 kB)
Collecting sympy (from torch==2.3.1->-r requirements.txt (line 21))
Downloading sympy-1.13.1-py3-none-any.whl.metadata (12 kB)
Collecting networkx (from torch==2.3.1->-r requirements.txt (line 21))
Downloading networkx-3.3-py3-none-any.whl.metadata (5.1 kB)
Collecting fsspec (from torch==2.3.1->-r requirements.txt (line 21))
Using cached fsspec-2024.6.1-py3-none-any.whl.metadata (11 kB)
Collecting scipy (from bitsandbytes==0.42.0->-r requirements.txt (line 37))
Downloading scipy-1.14.0-cp310-cp310-macosx_14_0_arm64.whl.metadata (60 kB)
Collecting aiofiles<24.0,>=22.0 (from gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached aiofiles-23.2.1-py3-none-any.whl.metadata (9.7 kB)
Collecting altair<6.0,>=4.2.0 (from gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached altair-5.3.0-py3-none-any.whl.metadata (9.2 kB)
Collecting fastapi (from gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached fastapi-0.112.0-py3-none-any.whl.metadata (27 kB)
Collecting ffmpy (from gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Downloading ffmpy-0.4.0-py3-none-any.whl.metadata (2.9 kB)
Collecting importlib-resources<7.0,>=1.3 (from gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached importlib_resources-6.4.0-py3-none-any.whl.metadata (3.9 kB)
Collecting markupsafe~=2.0 (from gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Downloading https://download.pytorch.org/whl/MarkupSafe-2.1.5-cp310-cp310-macosx_10_9_universal2.whl (18 kB)
Collecting orjson~=3.0 (from gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached orjson-3.10.6-cp310-cp310-macosx_10_15_x86_64.macosx_11_0_arm64.macosx_10_15_universal2.whl.metadata (50 kB)
Collecting pillow<11.0,>=8.0 (from gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached pillow-10.4.0-cp310-cp310-macosx_11_0_arm64.whl.metadata (9.2 kB)
Collecting pydantic>=2.0 (from gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached pydantic-2.7.0-py3-none-any.whl.metadata (103 kB)
Collecting pydub (from gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Downloading pydub-0.25.1-py2.py3-none-any.whl.metadata (1.4 kB)
Collecting python-multipart>=0.0.9 (from gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached python_multipart-0.0.9-py3-none-any.whl.metadata (2.5 kB)
Collecting pyyaml<7.0,>=5.0 (from gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Downloading PyYAML-6.0.2-cp310-cp310-macosx_11_0_arm64.whl.metadata (2.1 kB)
Collecting ruff>=0.2.2 (from gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Downloading ruff-0.5.7-py3-none-macosx_11_0_arm64.whl.metadata (25 kB)
Collecting semantic-version~=2.0 (from gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Downloading semantic_version-2.10.0-py2.py3-none-any.whl.metadata (9.7 kB)
Collecting tomlkit==0.12.0 (from gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached tomlkit-0.12.0-py3-none-any.whl.metadata (2.7 kB)
Collecting typer<1.0,>=0.9 (from typer[all]<1.0,>=0.9; sys_platform != "emscripten"->gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached typer-0.12.3-py3-none-any.whl.metadata (15 kB)
Collecting websockets<12.0,>=10.0 (from gradio_client@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio_client-0.15.1-py3-none-any.whl->-r requirements.txt (line 9))
Downloading websockets-11.0.3-cp310-cp310-macosx_11_0_arm64.whl.metadata (6.6 kB)
Collecting click>=7.0 (from uvicorn[standard]->-r requirements.txt (line 11))
Using cached click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Collecting h11>=0.8 (from uvicorn[standard]->-r requirements.txt (line 11))
Using cached h11-0.14.0-py3-none-any.whl.metadata (8.2 kB)
Collecting httptools>=0.5.0 (from uvicorn[standard]->-r requirements.txt (line 11))
Using cached httptools-0.6.1-cp310-cp310-macosx_10_9_universal2.whl.metadata (3.6 kB)
Collecting uvloop!=0.15.0,!=0.15.1,>=0.14.0 (from uvicorn[standard]->-r requirements.txt (line 11))
Using cached uvloop-0.19.0-cp310-cp310-macosx_10_9_universal2.whl.metadata (4.9 kB)
Collecting watchfiles>=0.13 (from uvicorn[standard]->-r requirements.txt (line 11))
Downloading watchfiles-0.23.0-cp310-cp310-macosx_11_0_arm64.whl.metadata (4.9 kB)
Collecting psutil>=5.9.5 (from -r requirements.txt (line 52))
Using cached psutil-5.9.8-cp38-abi3-macosx_11_0_arm64.whl.metadata (21 kB)
Collecting starlette (from sse_starlette>=1.8.2->-r requirements.txt (line 14))
Downloading starlette-0.38.2-py3-none-any.whl.metadata (5.9 kB)
Collecting anyio (from sse_starlette>=1.8.2->-r requirements.txt (line 14))
Using cached anyio-4.4.0-py3-none-any.whl.metadata (4.6 kB)
Collecting six (from fire>=0.5.0->-r requirements.txt (line 18))
Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB)
Collecting termcolor (from fire>=0.5.0->-r requirements.txt (line 18))
Using cached termcolor-2.4.0-py3-none-any.whl.metadata (6.1 kB)
Collecting dill (from evaluate>=0.4.0->-r requirements.txt (line 22))
Downloading dill-0.3.8-py3-none-any.whl.metadata (10 kB)
Collecting xxhash (from evaluate>=0.4.0->-r requirements.txt (line 22))
Using cached xxhash-3.4.1-cp310-cp310-macosx_11_0_arm64.whl.metadata (12 kB)
Collecting multiprocess (from evaluate>=0.4.0->-r requirements.txt (line 22))
Downloading multiprocess-0.70.16-py310-none-any.whl.metadata (7.2 kB)
Collecting absl-py (from rouge_score>=0.1.2->-r requirements.txt (line 23))
Using cached absl_py-2.1.0-py3-none-any.whl.metadata (2.3 kB)
Collecting portalocker (from sacrebleu>=2.3.1->-r requirements.txt (line 24))
Using cached portalocker-2.10.1-py3-none-any.whl.metadata (8.5 kB)
Collecting regex (from sacrebleu>=2.3.1->-r requirements.txt (line 24))
Downloading regex-2024.7.24-cp310-cp310-macosx_11_0_arm64.whl.metadata (40 kB)
Collecting colorama (from sacrebleu>=2.3.1->-r requirements.txt (line 24))
Using cached https://download.pytorch.org/whl/colorama-0.4.6-py2.py3-none-any.whl (25 kB)
Collecting lxml (from sacrebleu>=2.3.1->-r requirements.txt (line 24))
Downloading lxml-5.2.2-cp310-cp310-macosx_10_9_universal2.whl.metadata (3.4 kB)
Collecting threadpoolctl>=3.1.0 (from scikit-learn>=1.2.2->-r requirements.txt (line 25))
Downloading threadpoolctl-3.5.0-py3-none-any.whl.metadata (13 kB)
Collecting python-dateutil>=2.8.2 (from pandas>=2.0.2->-r requirements.txt (line 30))
Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB)
Collecting pytz>=2020.1 (from pandas>=2.0.2->-r requirements.txt (line 30))
Using cached pytz-2024.1-py2.py3-none-any.whl.metadata (22 kB)
Collecting tzdata>=2022.7 (from pandas>=2.0.2->-r requirements.txt (line 30))
Using cached tzdata-2024.1-py2.py3-none-any.whl.metadata (1.4 kB)
Collecting contourpy>=1.0.1 (from matplotlib>=3.7.1->-r requirements.txt (line 31))
Downloading contourpy-1.2.1-cp310-cp310-macosx_11_0_arm64.whl.metadata (5.8 kB)
Collecting cycler>=0.10 (from matplotlib>=3.7.1->-r requirements.txt (line 31))
Using cached cycler-0.12.1-py3-none-any.whl.metadata (3.8 kB)
Collecting fonttools>=4.22.0 (from matplotlib>=3.7.1->-r requirements.txt (line 31))
Downloading fonttools-4.53.1-cp310-cp310-macosx_11_0_arm64.whl.metadata (162 kB)
Collecting kiwisolver>=1.3.1 (from matplotlib>=3.7.1->-r requirements.txt (line 31))
Using cached kiwisolver-1.4.5-cp310-cp310-macosx_11_0_arm64.whl.metadata (6.4 kB)
Collecting pyparsing>=2.3.1 (from matplotlib>=3.7.1->-r requirements.txt (line 31))
Using cached pyparsing-3.1.2-py3-none-any.whl.metadata (5.1 kB)
Collecting safetensors>=0.3.1 (from accelerate>=0.30.1->-r requirements.txt (line 38))
Downloading safetensors-0.4.4-cp310-cp310-macosx_11_0_arm64.whl.metadata (3.8 kB)
Collecting tokenizers>=0.19.0 (from -r requirements.txt (line 42))
Using cached tokenizers-0.19.1-cp310-cp310-macosx_11_0_arm64.whl.metadata (6.7 kB)
Collecting coloredlogs (from optimum>=1.17.1->-r requirements.txt (line 44))
Using cached coloredlogs-15.0.1-py2.py3-none-any.whl.metadata (12 kB)
Collecting transformers>=4.43.2 (from -r requirements.txt (line 40))
Using cached transformers-4.43.4-py3-none-any.whl.metadata (43 kB)
Collecting pyarrow>=15.0.0 (from datasets>=2.18.0->-r requirements.txt (line 45))
Using cached pyarrow-17.0.0-cp310-cp310-macosx_11_0_arm64.whl.metadata (3.3 kB)
Collecting pyarrow-hotfix (from datasets>=2.18.0->-r requirements.txt (line 45))
Using cached pyarrow_hotfix-0.6-py3-none-any.whl.metadata (3.6 kB)
Collecting fsspec (from torch==2.3.1->-r requirements.txt (line 21))
Using cached fsspec-2024.5.0-py3-none-any.whl.metadata (11 kB)
Collecting aiohttp (from datasets>=2.18.0->-r requirements.txt (line 45))
Using cached aiohttp-3.10.2-cp310-cp310-macosx_11_0_arm64.whl.metadata (7.5 kB)
Collecting tzlocal!=3.*,>=2.0 (from APScheduler>=3.10.1->-r requirements.txt (line 48))
Using cached tzlocal-5.2-py3-none-any.whl.metadata (7.8 kB)
Collecting jmespath<2.0.0,>=0.7.1 (from boto3>=1.26.101->-r requirements.txt (line 53))
Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB)
Collecting s3transfer<0.11.0,>=0.10.0 (from boto3>=1.26.101->-r requirements.txt (line 53))
Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB)
Collecting soupsieve>1.2 (from beautifulsoup4>=4.12.2->-r requirements.txt (line 55))
Using cached soupsieve-2.5-py3-none-any.whl.metadata (4.7 kB)
Collecting iniconfig (from pytest>=7.2.2->-r requirements.txt (line 59))
Using cached iniconfig-2.0.0-py3-none-any.whl.metadata (2.6 kB)
Collecting pluggy<2,>=1.5 (from pytest>=7.2.2->-r requirements.txt (line 59))
Using cached pluggy-1.5.0-py3-none-any.whl.metadata (4.8 kB)
Collecting exceptiongroup>=1.0.0rc8 (from pytest>=7.2.2->-r requirements.txt (line 59))
Downloading exceptiongroup-1.2.2-py3-none-any.whl.metadata (6.6 kB)
Collecting tomli>=1 (from pytest>=7.2.2->-r requirements.txt (line 59))
Using cached tomli-2.0.1-py3-none-any.whl.metadata (8.9 kB)
Collecting execnet>=2.1 (from pytest-xdist>=3.2.1->-r requirements.txt (line 60))
Downloading execnet-2.1.1-py3-none-any.whl.metadata (2.9 kB)
Collecting pyphen (from textstat>=0.7.3->-r requirements.txt (line 62))
Downloading pyphen-0.16.0-py3-none-any.whl.metadata (3.2 kB)
Requirement already satisfied: setuptools in /Users/kapenge/miniconda3/envs/h2ogpt/lib/python3.10/site-packages (from textstat>=0.7.3->-r requirements.txt (line 62)) (72.1.0)
Collecting et-xmlfile (from openpyxl>=3.1.2->-r requirements.txt (line 68))
Downloading et_xmlfile-1.1.0-py3-none-any.whl.metadata (1.8 kB)
Collecting jsonlines (from lm_dataformat>=0.0.20->-r requirements.txt (line 69))
Using cached jsonlines-4.0.0-py3-none-any.whl.metadata (1.6 kB)
Collecting ujson (from lm_dataformat>=0.0.20->-r requirements.txt (line 69))
Downloading ujson-5.10.0-cp310-cp310-macosx_11_0_arm64.whl.metadata (9.3 kB)
Collecting zstandard (from lm_dataformat>=0.0.20->-r requirements.txt (line 69))
Downloading zstandard-0.23.0-cp310-cp310-macosx_11_0_arm64.whl.metadata (3.0 kB)
Collecting intervaltree (from bioc>=2.0->-r requirements.txt (line 70))
Using cached intervaltree-3.1.0-py2.py3-none-any.whl
Collecting docopt (from bioc>=2.0->-r requirements.txt (line 70))
Downloading docopt-0.6.2.tar.gz (25 kB)
Preparing metadata (setup.py) ... done
Collecting torchvision (from sentence_transformers_old@ https://h2o-release.s3.amazonaws.com/h2ogpt/sentence_transformers_old-2.2.2-py3-none-any.whl->-r requirements.txt (line 75))
Using cached https://download.pytorch.org/whl/cpu/torchvision-0.19.0-cp310-cp310-macosx_11_0_arm64.whl (1.7 MB)
Collecting distro<2,>=1.7.0 (from openai>=1.40.1->-r requirements.txt (line 91))
Using cached distro-1.9.0-py3-none-any.whl.metadata (6.8 kB)
Collecting jiter<1,>=0.4.0 (from openai>=1.40.1->-r requirements.txt (line 91))
Using cached jiter-0.5.0-cp310-cp310-macosx_11_0_arm64.whl.metadata (3.6 kB)
Collecting sniffio (from openai>=1.40.1->-r requirements.txt (line 91))
Using cached sniffio-1.3.1-py3-none-any.whl.metadata (3.9 kB)
Collecting charset-normalizer<4,>=2 (from requests>=2.31.0->-r requirements.txt (line 93))
Using cached charset_normalizer-3.3.2-cp310-cp310-macosx_11_0_arm64.whl.metadata (33 kB)
Collecting idna<4,>=2.5 (from requests>=2.31.0->-r requirements.txt (line 93))
Using cached idna-3.7-py3-none-any.whl.metadata (9.9 kB)
Collecting certifi>=2017.4.17 (from requests>=2.31.0->-r requirements.txt (line 93))
Using cached certifi-2024.7.4-py3-none-any.whl.metadata (2.2 kB)
Collecting httpcore==1.* (from httpx>=0.24.1->-r requirements.txt (line 94))
Using cached httpcore-1.0.5-py3-none-any.whl.metadata (20 kB)
Collecting aiohappyeyeballs>=2.3.0 (from aiohttp->datasets>=2.18.0->-r requirements.txt (line 45))
Using cached aiohappyeyeballs-2.3.5-py3-none-any.whl.metadata (5.8 kB)
Collecting aiosignal>=1.1.2 (from aiohttp->datasets>=2.18.0->-r requirements.txt (line 45))
Using cached aiosignal-1.3.1-py3-none-any.whl.metadata (4.0 kB)
Collecting attrs>=17.3.0 (from aiohttp->datasets>=2.18.0->-r requirements.txt (line 45))
Downloading attrs-24.2.0-py3-none-any.whl.metadata (11 kB)
Collecting frozenlist>=1.1.1 (from aiohttp->datasets>=2.18.0->-r requirements.txt (line 45))
Using cached frozenlist-1.4.1-cp310-cp310-macosx_11_0_arm64.whl.metadata (12 kB)
Collecting multidict<7.0,>=4.5 (from aiohttp->datasets>=2.18.0->-r requirements.txt (line 45))
Downloading multidict-6.0.5-cp310-cp310-macosx_11_0_arm64.whl.metadata (4.2 kB)
Collecting yarl<2.0,>=1.0 (from aiohttp->datasets>=2.18.0->-r requirements.txt (line 45))
Using cached yarl-1.9.4-cp310-cp310-macosx_11_0_arm64.whl.metadata (31 kB)
Collecting async-timeout<5.0,>=4.0 (from aiohttp->datasets>=2.18.0->-r requirements.txt (line 45))
Using cached async_timeout-4.0.3-py3-none-any.whl.metadata (4.2 kB)
Collecting jsonschema>=3.0 (from altair<6.0,>=4.2.0->gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached jsonschema-4.23.0-py3-none-any.whl.metadata (7.9 kB)
Collecting toolz (from altair<6.0,>=4.2.0->gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached toolz-0.12.1-py3-none-any.whl.metadata (5.1 kB)
Collecting starlette (from sse_starlette>=1.8.2->-r requirements.txt (line 14))
Using cached starlette-0.37.2-py3-none-any.whl.metadata (5.9 kB)
Collecting annotated-types>=0.4.0 (from pydantic>=2.0->gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached annotated_types-0.7.0-py3-none-any.whl.metadata (15 kB)
Collecting pydantic-core==2.18.1 (from pydantic>=2.0->gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached pydantic_core-2.18.1-cp310-cp310-macosx_11_0_arm64.whl.metadata (6.5 kB)
Collecting protobuf (from transformers[sentencepiece]<4.44.0,>=4.29.0->optimum>=1.17.1->-r requirements.txt (line 44))
Downloading protobuf-5.27.3-cp38-abi3-macosx_10_9_universal2.whl.metadata (592 bytes)
Collecting shellingham>=1.3.0 (from typer<1.0,>=0.9->typer[all]<1.0,>=0.9; sys_platform != "emscripten"->gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached shellingham-1.5.4-py2.py3-none-any.whl.metadata (3.5 kB)
Collecting rich>=10.11.0 (from typer<1.0,>=0.9->typer[all]<1.0,>=0.9; sys_platform != "emscripten"->gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached rich-13.7.1-py3-none-any.whl.metadata (18 kB)
WARNING: typer 0.12.3 does not provide the extra 'all'
Collecting humanfriendly>=9.1 (from coloredlogs->optimum>=1.17.1->-r requirements.txt (line 44))
Using cached humanfriendly-10.0-py2.py3-none-any.whl.metadata (9.2 kB)
Collecting sortedcontainers<3.0,>=2.0 (from intervaltree->bioc>=2.0->-r requirements.txt (line 70))
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl.metadata (10 kB)
Collecting mpmath<1.4,>=1.1.0 (from sympy->torch==2.3.1->-r requirements.txt (line 21))
Using cached https://download.pytorch.org/whl/mpmath-1.3.0-py3-none-any.whl (536 kB)
INFO: pip is looking at multiple versions of torchvision to determine which version is compatible with other requirements. This could take a while.
Collecting torchvision (from sentence_transformers_old@ https://h2o-release.s3.amazonaws.com/h2ogpt/sentence_transformers_old-2.2.2-py3-none-any.whl->-r requirements.txt (line 75))
Using cached https://download.pytorch.org/whl/cpu/torchvision-0.18.1-cp310-cp310-macosx_11_0_arm64.whl (1.6 MB)
Collecting jsonschema-specifications>=2023.03.6 (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached jsonschema_specifications-2023.12.1-py3-none-any.whl.metadata (3.0 kB)
Collecting referencing>=0.28.4 (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached referencing-0.35.1-py3-none-any.whl.metadata (2.8 kB)
Collecting rpds-py>=0.7.1 (from jsonschema>=3.0->altair<6.0,>=4.2.0->gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Downloading rpds_py-0.20.0-cp310-cp310-macosx_11_0_arm64.whl.metadata (4.2 kB)
Collecting markdown-it-py>=2.2.0 (from rich>=10.11.0->typer<1.0,>=0.9->typer[all]<1.0,>=0.9; sys_platform != "emscripten"->gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached markdown_it_py-3.0.0-py3-none-any.whl.metadata (6.9 kB)
Collecting pygments<3.0.0,>=2.13.0 (from rich>=10.11.0->typer<1.0,>=0.9->typer[all]<1.0,>=0.9; sys_platform != "emscripten"->gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached pygments-2.18.0-py3-none-any.whl.metadata (2.5 kB)
Collecting mdurl~=0.1 (from markdown-it-py>=2.2.0->rich>=10.11.0->typer<1.0,>=0.9->typer[all]<1.0,>=0.9; sys_platform != "emscripten"->gradio@ https://h2o-release.s3.amazonaws.com/h2ogpt/gradio-4.26.0-py3-none-any.whl->-r requirements.txt (line 8))
Using cached mdurl-0.1.2-py3-none-any.whl.metadata (1.6 kB)
Using cached bitsandbytes-0.42.0-py3-none-any.whl (105.0 MB)
Using cached tomlkit-0.12.0-py3-none-any.whl (37 kB)
Using cached gunicorn-22.0.0-py3-none-any.whl (84 kB)
Using cached fastapi_utils-0.7.0-py3-none-any.whl (18 kB)
Downloading sse_starlette-2.1.3-py3-none-any.whl (9.4 kB)
Using cached huggingface_hub-0.24.5-py3-none-any.whl (417 kB)
Using cached appdirs-1.4.4-py2.py3-none-any.whl (9.6 kB)
Downloading docutils-0.21.2-py3-none-any.whl (587 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 587.4/587.4 kB 3.5 MB/s eta 0:00:00
Downloading evaluate-0.4.2-py3-none-any.whl (84 kB)
Downloading sacrebleu-2.4.2-py3-none-any.whl (106 kB)
Downloading scikit_learn-1.5.1-cp310-cp310-macosx_12_0_arm64.whl (11.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.0/11.0 MB 2.9 MB/s eta 0:00:00
Downloading numpy-1.26.4-cp310-cp310-macosx_11_0_arm64.whl (14.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.0/14.0 MB 3.0 MB/s eta 0:00:00
Downloading pandas-2.2.2-cp310-cp310-macosx_11_0_arm64.whl (11.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.3/11.3 MB 3.1 MB/s eta 0:00:00
Downloading matplotlib-3.9.1.post1-cp310-cp310-macosx_11_0_arm64.whl (7.8 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.8/7.8 MB 2.3 MB/s eta 0:00:00
Using cached loralib-0.1.2-py3-none-any.whl (10 kB)
Using cached accelerate-0.33.0-py3-none-any.whl (315 kB)
Downloading peft-0.12.0-py3-none-any.whl (296 kB)
Using cached jinja2-3.1.4-py3-none-any.whl (133 kB)
Using cached tokenizers-0.19.1-cp310-cp310-macosx_11_0_arm64.whl (2.4 MB)
Downloading hf_transfer-0.1.8-cp310-cp310-macosx_11_0_arm64.whl (1.4 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.4/1.4 MB 2.2 MB/s eta 0:00:00
Using cached optimum-1.21.3-py3-none-any.whl (421 kB)
Using cached transformers-4.43.4-py3-none-any.whl (9.4 MB)
Using cached datasets-2.20.0-py3-none-any.whl (547 kB)
Using cached sentencepiece-0.2.0-cp310-cp310-macosx_11_0_arm64.whl (1.2 MB)
Downloading APScheduler-3.10.4-py3-none-any.whl (59 kB)
Downloading pynvml-11.5.3-py3-none-any.whl (53 kB)
Using cached psutil-5.9.8-cp38-abi3-macosx_11_0_arm64.whl (249 kB)
Downloading boto3-1.34.158-py3-none-any.whl (139 kB)
Downloading botocore-1.34.158-py3-none-any.whl (12.5 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 2.5 MB/s eta 0:00:00
Using cached beautifulsoup4-4.12.3-py3-none-any.whl (147 kB)
Downloading Markdown-3.6-py3-none-any.whl (105 kB)
Downloading pytest-8.3.2-py3-none-any.whl (341 kB)
Downloading pytest_xdist-3.6.1-py3-none-any.whl (46 kB)
Using cached nltk-3.8.1-py3-none-any.whl (1.5 MB)
Downloading textstat-0.7.4-py3-none-any.whl (105 kB)
Using cached pypandoc-1.13-py3-none-any.whl (21 kB)
Downloading openpyxl-3.1.5-py2.py3-none-any.whl (250 kB)
Using cached lm_dataformat-0.0.20-py3-none-any.whl (5.8 kB)
Downloading bioc-2.1-py3-none-any.whl (33 kB)
Using cached sentence_transformers-3.0.1-py3-none-any.whl (227 kB)
Downloading einops-0.8.0-py3-none-any.whl (43 kB)
Using cached python_dotenv-1.0.1-py3-none-any.whl (19 kB)
Using cached json_repair-0.27.0-py3-none-any.whl (12 kB)
Using cached text_generation-0.7.0-py3-none-any.whl (12 kB)
Using cached tiktoken-0.7.0-cp310-cp310-macosx_11_0_arm64.whl (906 kB)
Using cached openai-1.40.2-py3-none-any.whl (360 kB)
Using cached requests-2.32.3-py3-none-any.whl (64 kB)
Using cached httpx-0.27.0-py3-none-any.whl (75 kB)
Using cached httpcore-1.0.5-py3-none-any.whl (77 kB)
Using cached urllib3-2.2.2-py3-none-any.whl (121 kB)
Using cached filelock-3.15.4-py3-none-any.whl (16 kB)
Using cached joblib-1.4.2-py3-none-any.whl (301 kB)
Using cached tqdm-4.66.5-py3-none-any.whl (78 kB)
Using cached tabulate-0.9.0-py3-none-any.whl (35 kB)
Using cached packaging-24.1-py3-none-any.whl (53 kB)
Using cached aiofiles-23.2.1-py3-none-any.whl (15 kB)
Using cached aiohttp-3.10.2-cp310-cp310-macosx_11_0_arm64.whl (387 kB)
Using cached altair-5.3.0-py3-none-any.whl (857 kB)
Using cached anyio-4.4.0-py3-none-any.whl (86 kB)
Using cached certifi-2024.7.4-py3-none-any.whl (162 kB)
Using cached charset_normalizer-3.3.2-cp310-cp310-macosx_11_0_arm64.whl (120 kB)
Using cached click-8.1.7-py3-none-any.whl (97 kB)
Downloading contourpy-1.2.1-cp310-cp310-macosx_11_0_arm64.whl (244 kB)
Using cached cycler-0.12.1-py3-none-any.whl (8.3 kB)
Downloading dill-0.3.8-py3-none-any.whl (116 kB)
Using cached distro-1.9.0-py3-none-any.whl (20 kB)
Downloading exceptiongroup-1.2.2-py3-none-any.whl (16 kB)
Downloading execnet-2.1.1-py3-none-any.whl (40 kB)
Using cached fastapi-0.112.0-py3-none-any.whl (93 kB)
Downloading fonttools-4.53.1-cp310-cp310-macosx_11_0_arm64.whl (2.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.2/2.2 MB 2.6 MB/s eta 0:00:00
Using cached fsspec-2024.5.0-py3-none-any.whl (316 kB)
Using cached h11-0.14.0-py3-none-any.whl (58 kB)
Using cached httptools-0.6.1-cp310-cp310-macosx_10_9_universal2.whl (149 kB)
Using cached idna-3.7-py3-none-any.whl (66 kB)
Using cached importlib_resources-6.4.0-py3-none-any.whl (38 kB)
Using cached jiter-0.5.0-cp310-cp310-macosx_11_0_arm64.whl (299 kB)
Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Using cached jsonlines-4.0.0-py3-none-any.whl (8.7 kB)
Using cached kiwisolver-1.4.5-cp310-cp310-macosx_11_0_arm64.whl (66 kB)
Downloading lxml-5.2.2-cp310-cp310-macosx_10_9_universal2.whl (8.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.1/8.1 MB 2.2 MB/s eta 0:00:00
Using cached orjson-3.10.6-cp310-cp310-macosx_10_15_x86_64.macosx_11_0_arm64.macosx_10_15_universal2.whl (250 kB)
Using cached pillow-10.4.0-cp310-cp310-macosx_11_0_arm64.whl (3.4 MB)
Using cached pluggy-1.5.0-py3-none-any.whl (20 kB)
Using cached pyarrow-17.0.0-cp310-cp310-macosx_11_0_arm64.whl (27.2 MB)
Using cached pydantic-2.7.0-py3-none-any.whl (407 kB)
Using cached pydantic_core-2.18.1-cp310-cp310-macosx_11_0_arm64.whl (1.8 MB)
Using cached pyparsing-3.1.2-py3-none-any.whl (103 kB)
Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Using cached python_multipart-0.0.9-py3-none-any.whl (22 kB)
Using cached pytz-2024.1-py2.py3-none-any.whl (505 kB)
Downloading PyYAML-6.0.2-cp310-cp310-macosx_11_0_arm64.whl (171 kB)
Downloading regex-2024.7.24-cp310-cp310-macosx_11_0_arm64.whl (278 kB)
Downloading ruff-0.5.7-py3-none-macosx_11_0_arm64.whl (8.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.3/8.3 MB 1.1 MB/s eta 0:00:00
Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB)
Downloading safetensors-0.4.4-cp310-cp310-macosx_11_0_arm64.whl (381 kB)
Downloading scipy-1.14.0-cp310-cp310-macosx_14_0_arm64.whl (23.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23.1/23.1 MB 762.5 kB/s eta 0:00:00
Using cached semantic_version-2.10.0-py2.py3-none-any.whl (15 kB)
Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Using cached sniffio-1.3.1-py3-none-any.whl (10 kB)
Using cached soupsieve-2.5-py3-none-any.whl (36 kB)
Using cached starlette-0.37.2-py3-none-any.whl (71 kB)
Downloading threadpoolctl-3.5.0-py3-none-any.whl (18 kB)
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Using cached typer-0.12.3-py3-none-any.whl (47 kB)
Using cached typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Using cached tzdata-2024.1-py2.py3-none-any.whl (345 kB)
Using cached tzlocal-5.2-py3-none-any.whl (17 kB)
Downloading uvicorn-0.30.5-py3-none-any.whl (62 kB)
Using cached uvloop-0.19.0-cp310-cp310-macosx_10_9_universal2.whl (1.4 MB)
Downloading watchfiles-0.23.0-cp310-cp310-macosx_11_0_arm64.whl (369 kB)
Using cached websockets-11.0.3-cp310-cp310-macosx_11_0_arm64.whl (121 kB)
Using cached absl_py-2.1.0-py3-none-any.whl (133 kB)
Using cached coloredlogs-15.0.1-py2.py3-none-any.whl (46 kB)
Using cached et_xmlfile-1.1.0-py3-none-any.whl (4.7 kB)
Downloading ffmpy-0.4.0-py3-none-any.whl (5.8 kB)
Using cached iniconfig-2.0.0-py3-none-any.whl (5.9 kB)
Downloading multiprocess-0.70.16-py310-none-any.whl (134 kB)
Downloading networkx-3.3-py3-none-any.whl (1.7 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 909.3 kB/s eta 0:00:00
Using cached portalocker-2.10.1-py3-none-any.whl (18 kB)
Using cached pyarrow_hotfix-0.6-py3-none-any.whl (7.9 kB)
Using cached pydub-0.25.1-py2.py3-none-any.whl (32 kB)
Downloading pyphen-0.16.0-py3-none-any.whl (2.1 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 MB 918.1 kB/s eta 0:00:00
Downloading sympy-1.13.1-py3-none-any.whl (6.2 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.2/6.2 MB 921.7 kB/s eta 0:00:00
Using cached termcolor-2.4.0-py3-none-any.whl (7.7 kB)
Downloading ujson-5.10.0-cp310-cp310-macosx_11_0_arm64.whl (51 kB)
Using cached xxhash-3.4.1-cp310-cp310-macosx_11_0_arm64.whl (30 kB)
Downloading zstandard-0.23.0-cp310-cp310-macosx_11_0_arm64.whl (633 kB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 633.7/633.7 kB 861.3 kB/s eta 0:00:00
Using cached aiohappyeyeballs-2.3.5-py3-none-any.whl (12 kB)
Using cached aiosignal-1.3.1-py3-none-any.whl (7.6 kB)
Using cached annotated_types-0.7.0-py3-none-any.whl (13 kB)
Using cached async_timeout-4.0.3-py3-none-any.whl (5.7 kB)
Downloading attrs-24.2.0-py3-none-any.whl (63 kB)
Using cached frozenlist-1.4.1-cp310-cp310-macosx_11_0_arm64.whl (52 kB)
Using cached humanfriendly-10.0-py2.py3-none-any.whl (86 kB)
Using cached jsonschema-4.23.0-py3-none-any.whl (88 kB)
Downloading multidict-6.0.5-cp310-cp310-macosx_11_0_arm64.whl (30 kB)
Using cached rich-13.7.1-py3-none-any.whl (240 kB)
Using cached shellingham-1.5.4-py2.py3-none-any.whl (9.8 kB)
Using cached sortedcontainers-2.4.0-py2.py3-none-any.whl (29 kB)
Using cached yarl-1.9.4-cp310-cp310-macosx_11_0_arm64.whl (79 kB)
Downloading protobuf-5.27.3-cp38-abi3-macosx_10_9_universal2.whl (412 kB)
Using cached toolz-0.12.1-py3-none-any.whl (56 kB)
Using cached jsonschema_specifications-2023.12.1-py3-none-any.whl (18 kB)
Using cached markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
Using cached pygments-2.18.0-py3-none-any.whl (1.2 MB)
Using cached referencing-0.35.1-py3-none-any.whl (26 kB)
Downloading rpds_py-0.20.0-cp310-cp310-macosx_11_0_arm64.whl (311 kB)
Using cached mdurl-0.1.2-py3-none-any.whl (10.0 kB)
Building wheels for collected packages: fire, docopt
Building wheel for fire (setup.py) ... done
Created wheel for fire: filename=fire-0.6.0-py2.py3-none-any.whl size=117030 sha256=7185a126050d4222c7b567a05444f5ee59c01d506a821f71e871b44a7d189e18
Stored in directory: /Users/kapenge/Library/Caches/pip/wheels/d6/6d/5d/5b73fa0f46d01a793713f8859201361e9e581ced8c75e5c6a3
Building wheel for docopt (setup.py) ... done
Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13705 sha256=be75b6164fc47568d338658282162b0ee172034cd5ecb69285c9e7a743845da3
Stored in directory: /Users/kapenge/Library/Caches/pip/wheels/fc/ab/d4/5da2067ac95b36618c629a5f93f809425700506f72c9732fac
Successfully built fire docopt
Installing collected packages: sortedcontainers, sentencepiece, pytz, pydub, mpmath, InstructorEmbedding, docopt, appdirs, zstandard, xxhash, websockets, uvloop, urllib3, ujson, tzlocal, tzdata, typing-extensions, tqdm, toolz, tomlkit, tomli, threadpoolctl, termcolor, tabulate, sympy, soupsieve, sniffio, six, shellingham, semantic-version, safetensors, ruff, rpds-py, regex, pyyaml, python-multipart, python-dotenv, pyphen, pyparsing, pypandoc, pynvml, pygments, pyarrow-hotfix, psutil, protobuf, portalocker, pluggy, pillow, packaging, orjson, numpy, networkx, multidict, mdurl, markupsafe, markdown, lxml, loralib, kiwisolver, json_repair, joblib, jmespath, jiter, intervaltree, iniconfig, importlib-resources, idna, humanfriendly, httptools, hf_transfer, h11, fsspec, frozenlist, fonttools, filelock, ffmpy, execnet, exceptiongroup, et-xmlfile, einops, docutils, distro, dill, cycler, colorama, click, charset-normalizer, certifi, attrs, async-timeout, annotated-types, aiohappyeyeballs, aiofiles, absl-py, yarl, uvicorn, textstat, scipy, sacrebleu, requests, referencing, python-dateutil, pytest, pydantic-core, pyarrow, openpyxl, nltk, multiprocess, markdown-it-py, jsonlines, jinja2, httpcore, gunicorn, fire, contourpy, coloredlogs, beautifulsoup4, APScheduler, anyio, aiosignal, watchfiles, torch, tiktoken, starlette, scikit-learn, rouge_score, rich, pytest-xdist, pydantic, pandas, matplotlib, lm_dataformat, jsonschema-specifications, huggingface_hub, httpx, botocore, bitsandbytes, bioc, aiohttp, typer, torchvision, tokenizers, text-generation, sse_starlette, s3transfer, openai, jsonschema, gradio_client, fastapi, accelerate, transformers, fastapi-utils, datasets, boto3, altair, sentence_transformers_old, sentence_transformers, peft, gradio, evaluate, optimum
Successfully installed APScheduler-3.10.4 InstructorEmbedding-1.0.1 absl-py-2.1.0 accelerate-0.33.0 aiofiles-23.2.1 aiohappyeyeballs-2.3.5 aiohttp-3.10.2 aiosignal-1.3.1 altair-5.3.0 annotated-types-0.7.0 anyio-4.4.0 appdirs-1.4.4 async-timeout-4.0.3 attrs-24.2.0 beautifulsoup4-4.12.3 bioc-2.1 bitsandbytes-0.42.0 boto3-1.34.158 botocore-1.34.158 certifi-2024.7.4 charset-normalizer-3.3.2 click-8.1.7 colorama-0.4.6 coloredlogs-15.0.1 contourpy-1.2.1 cycler-0.12.1 datasets-2.20.0 dill-0.3.8 distro-1.9.0 docopt-0.6.2 docutils-0.21.2 einops-0.8.0 et-xmlfile-1.1.0 evaluate-0.4.2 exceptiongroup-1.2.2 execnet-2.1.1 fastapi-0.112.0 fastapi-utils-0.7.0 ffmpy-0.4.0 filelock-3.15.4 fire-0.6.0 fonttools-4.53.1 frozenlist-1.4.1 fsspec-2024.5.0 gradio-4.26.0 gradio_client-0.15.1 gunicorn-22.0.0 h11-0.14.0 hf_transfer-0.1.8 httpcore-1.0.5 httptools-0.6.1 httpx-0.27.0 huggingface_hub-0.24.5 humanfriendly-10.0 idna-3.7 importlib-resources-6.4.0 iniconfig-2.0.0 intervaltree-3.1.0 jinja2-3.1.4 jiter-0.5.0 jmespath-1.0.1 joblib-1.4.2 json_repair-0.27.0 jsonlines-4.0.0 jsonschema-4.23.0 jsonschema-specifications-2023.12.1 kiwisolver-1.4.5 lm_dataformat-0.0.20 loralib-0.1.2 lxml-5.2.2 markdown-3.6 markdown-it-py-3.0.0 markupsafe-2.1.5 matplotlib-3.9.1.post1 mdurl-0.1.2 mpmath-1.3.0 multidict-6.0.5 multiprocess-0.70.16 networkx-3.3 nltk-3.8.1 numpy-1.26.4 openai-1.40.2 openpyxl-3.1.5 optimum-1.21.3 orjson-3.10.6 packaging-24.1 pandas-2.2.2 peft-0.12.0 pillow-10.4.0 pluggy-1.5.0 portalocker-2.10.1 protobuf-5.27.3 psutil-5.9.8 pyarrow-17.0.0 pyarrow-hotfix-0.6 pydantic-2.7.0 pydantic-core-2.18.1 pydub-0.25.1 pygments-2.18.0 pynvml-11.5.3 pypandoc-1.13 pyparsing-3.1.2 pyphen-0.16.0 pytest-8.3.2 pytest-xdist-3.6.1 python-dateutil-2.9.0.post0 python-dotenv-1.0.1 python-multipart-0.0.9 pytz-2024.1 pyyaml-6.0.2 referencing-0.35.1 regex-2024.7.24 requests-2.32.3 rich-13.7.1 rouge_score-0.1.2 rpds-py-0.20.0 ruff-0.5.7 s3transfer-0.10.2 sacrebleu-2.4.2 safetensors-0.4.4 scikit-learn-1.5.1 scipy-1.14.0 semantic-version-2.10.0 sentence_transformers-3.0.1 sentence_transformers_old-2.2.2 sentencepiece-0.2.0 shellingham-1.5.4 six-1.16.0 sniffio-1.3.1 sortedcontainers-2.4.0 soupsieve-2.5 sse_starlette-2.1.3 starlette-0.37.2 sympy-1.13.1 tabulate-0.9.0 termcolor-2.4.0 text-generation-0.7.0 textstat-0.7.4 threadpoolctl-3.5.0 tiktoken-0.7.0 tokenizers-0.19.1 tomli-2.0.1 tomlkit-0.12.0 toolz-0.12.1 torch-2.3.1 torchvision-0.18.1 tqdm-4.66.5 transformers-4.43.4 typer-0.12.3 typing-extensions-4.12.2 tzdata-2024.1 tzlocal-5.2 ujson-5.10.0 urllib3-2.2.2 uvicorn-0.30.5 uvloop-0.19.0 watchfiles-0.23.0 websockets-11.0.3 xxhash-3.4.1 yarl-1.9.4 zstandard-0.23.0
❯
❯
❯ pip install -r reqs_optional/requirements_optional_langchain.txt -c reqs_optional/reqs_constraints.txt
Ignoring torch: markers 'sys_platform != "darwin" and platform_machine != "arm64"' don't match your environment
Collecting InstructorEmbedding@ https://h2o-release.s3.amazonaws.com/h2ogpt/InstructorEmbedding-1.0.1-py3-none-any.whl (from -r reqs_optional/requirements_optional_langchain.txt (line 23))
Using cached https://h2o-release.s3.amazonaws.com/h2ogpt/InstructorEmbedding-1.0.1-py3-none-any.whl (20 kB)
Collecting sentence_transformers_old@ https://h2o-release.s3.amazonaws.com/h2ogpt/sentence_transformers_old-2.2.2-py3-none-any.whl (from -r reqs_optional/requirements_optional_langchain.txt (line 26))
Using cached https://h2o-release.s3.amazonaws.com/h2ogpt/sentence_transformers_old-2.2.2-py3-none-any.whl (125 kB)
Collecting llava@ https://h2o-release.s3.amazonaws.com/h2ogpt/llava-1.7.0.dev0-py3-none-any.whl (from -r reqs_optional/requirements_optional_langchain.txt (line 41))
Using cached https://h2o-release.s3.amazonaws.com/h2ogpt/llava-1.7.0.dev0-py3-none-any.whl (87 kB)
Ignoring jq: markers 'platform_machine == "x86_64"' don't match your environment
ERROR: Cannot install torch==2.2.1 because these package versions have conflicting dependencies.
The conflict is caused by:
The user requested torch==2.2.1
The user requested (constraint) torch==2.3.1
To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip to attempt to solve the dependency conflict
ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts
Tried the container option with no luck at all, at this moment.
changed this part of the build as the document suggest.
# if building for CPU, would remove CMAKE_ARGS and avoid GPU image as base image
# Choose llama_cpp_python ARGS for your system according to [llama_cpp_python backend documentation](https://github.com/abetlen/llama-cpp-python?tab=readme-ov-file#supported-backends), e.g. for CUDA:
# export GGML_CUDA=1
# export CMAKE_ARGS="-DGGML_CUDA=on -DCMAKE_CUDA_ARCHITECTURES=all"
# for Metal MAC M1/M2 comment out above two lines and uncomment out the below line
export CMAKE_ARGS="-DLLAMA_METAL=on"
export FORCE_CMAKE=1
Build Error
❯ docker build -t h2ogpt .
[+] Building 2.4s (9/13) docker:desktop-linux
=> [internal] load build definition from Dockerfile 0.0s
=> => transferring dockerfile: 1.15kB 0.0s
=> [internal] load metadata for docker.io/nvidia/cuda:12.1.1-cudnn8-devel-ubuntu20.04 2.3s
=> [internal] load .dockerignore 0.0s
=> => transferring context: 236B 0.0s
=> CANCELED [1/9] FROM docker.io/nvidia/cuda:12.1.1-cudnn8-devel-ubuntu20.04@sha256:db71d4ff90d59028b6d364df7400ea65601d673b96a49cf81e7cda85cf7cbc31 0.0s
=> => resolve docker.io/nvidia/cuda:12.1.1-cudnn8-devel-ubuntu20.04@sha256:db71d4ff90d59028b6d364df7400ea65601d673b96a49cf81e7cda85cf7cbc31 0.0s
=> => sha256:f68369b047ebfe2343393aae2a6996206e0bacf574c543685bebd92f55f59267 16.34kB / 16.34kB 0.0s
=> => sha256:db71d4ff90d59028b6d364df7400ea65601d673b96a49cf81e7cda85cf7cbc31 743B / 743B 0.0s
=> => sha256:9f8fb265f5a9d3188a0d3ad13288b06edaf7e89a7dc2aaa89b732a1e57071627 2.84kB / 2.84kB 0.0s
=> [internal] load build context 0.0s
=> => transferring context: 38.15kB 0.0s
=> CACHED [2/9] WORKDIR /workspace 0.0s
=> CACHED [3/9] COPY . /workspace/ 0.0s
=> CACHED [4/9] COPY build_info.txt /workspace/ 0.0s
=> ERROR [5/9] COPY git_hash.txt /workspace/ 0.0s
------
> [5/9] COPY git_hash.txt /workspace/:
------
Dockerfile:21
--------------------
19 | COPY build_info.txt /workspace/
20 |
21 | >>> COPY git_hash.txt /workspace/
22 |
23 | RUN cd /workspace && ./docker_build_script_ubuntu.sh
--------------------
ERROR: failed to solve: failed to compute cache key: failed to calculate checksum of ref 238fd63f-a388-4d60-8789-00a308c0d7e5::wla783xpjl7r6j5p8rnu2xnmi: "/git_hash.txt": not found
View build details: docker-desktop://dashboard/build/desktop-linux/desktop-linux/v6r8wk5ry197rqvzd39h4hh4y
git_hash.txt
comes from the Makefile step.
make git_hash.txt build_info.txt
i.e. one would do:
make docker_build
But I agree needing Makefile is bad. @achraf-mer can we avoid so Dockerfile builds on its own?
I removed it's need here: 282aec97e9a8f3dc4b513f33afb00e187ae857ec
The Docker Build ends with this error. Should I change the Miniconda image?
266.6 2024-08-10 14:26:56 (2.84 MB/s) - 'Miniconda3-latest-Linux-x86_64.sh' saved [146836934/146836934]
266.6
266.6 + mkdir -p /h2ogpt_conda
266.6 + bash ./Miniconda3-latest-Linux-x86_64.sh -b -u -p /h2ogpt_conda
266.6 PREFIX=/h2ogpt_conda
267.0 Unpacking payload ...
267.0 rosetta error: failed to open elf at /lib64/ld-linux-x86-64.so.2
267.0 ./Miniconda3-latest-Linux-x86_64.sh: line 442: 8661 Exit 141 extract_range $boundary1 $boundary2
267.0 8662 Trace/breakpoint trap | CONDA_QUIET="$BATCH" "$CONDA_EXEC" constructor --extract-tarball --prefix "$PREFIX"
267.0 + export CMAKE_ARGS=-DLLAMA_METAL=on
267.0 + CMAKE_ARGS=-DLLAMA_METAL=on
267.0 + export FORCE_CMAKE=1
267.0 + FORCE_CMAKE=1
267.0 + bash docs/linux_install.sh
267.0 + shopt -s expand_aliases
267.0 + test -f /usr/bin/sudo
267.0 + echo 'No sudo'
267.0 + alias 'sudo= '
267.0 No sudo
267.0 + [[ -z '' ]]
267.0 + conda install weasyprint pygobject -c conda-forge -y
267.0 docs/linux_install.sh: line 15: conda: command not found
------
Dockerfile:21
--------------------
19 | COPY build_info.txt /workspace/
20 |
21 | >>> RUN cd /workspace && ./docker_build_script_ubuntu.sh
22 |
23 | RUN chmod -R a+rwx /workspace
--------------------
ERROR: failed to solve: process "/bin/sh -c cd /workspace && ./docker_build_script_ubuntu.sh" did not complete successfully: exit code: 127
To build the docker image for MAC, I expect some changes may be required, I'm unsure. Thanks for the feedback.
I was abe to get it successfully installed. Instead of running the line bellow:
pip install -r reqs_optional/requirements_optional_langchain.txt -c reqs_optional/reqs_constraints.txt
I installed the langchain requirements by running the reqs_optional/requirements_optional_langchain.txt
Hello,
I've installed H2O on Macbook M1, when installing the dependencies I'm receiving the error bellow.
I don't know if this error is impediment to run the application which I'm trying with the command bellow:
python generate.py --base_model=llama --model_path_llama=https://huggingface.co/bartowski/Meta-Llama-3.1-8B-Instruct-GGUF/resolve/main/Meta-Llama-3.1-8B-Instruct-Q6_K_L.gguf?download=true --tokenizer_base_model=meta-llama/Meta-Llama-3.1-8B-Instruct --max_seq_len=8192
When trying to run I've this error:
Any hint?