search

pytorch / torchchat

Run PyTorch LLMs locally on servers, desktop and mobile
BSD 3-Clause "New" or "Revised" License
3.38k stars 221 forks source link

install requirements fails #1173

Open sunshinesfbay opened 1 month ago

sunshinesfbay commented 1 month ago

🐛 Describe the bug

(pt) sunshine@raspberrypi:~/torchchat $ ./install/install_requirements.sh
+ pip3 install -r install/requirements.txt --extra-index-url https://download.pytorch.org/whl/nightly/cu121
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple, https://download.pytorch.org/whl/nightly/cu121
Ignoring tomli: markers 'python_version < "3.11"' don't match your environment
Requirement already satisfied: huggingface_hub in /home/sunshine/pt/lib/python3.11/site-packages (from -r install/requirements.txt (line 4)) (0.24.6)
Requirement already satisfied: gguf in /home/sunshine/pt/lib/python3.11/site-packages (from -r install/requirements.txt (line 7)) (0.10.0)
Requirement already satisfied: tiktoken in /home/sunshine/pt/lib/python3.11/site-packages (from -r install/requirements.txt (line 10)) (0.7.0)
Requirement already satisfied: snakeviz in /home/sunshine/pt/lib/python3.11/site-packages (from -r install/requirements.txt (line 13)) (2.2.0)
Requirement already satisfied: sentencepiece in /home/sunshine/pt/lib/python3.11/site-packages (from -r install/requirements.txt (line 14)) (0.2.0)
Requirement already satisfied: numpy<2.0 in /home/sunshine/pt/lib/python3.11/site-packages (from -r install/requirements.txt (line 15)) (1.26.4)
Requirement already satisfied: lm-eval==0.4.2 in /home/sunshine/pt/lib/python3.11/site-packages (from -r install/requirements.txt (line 17)) (0.4.2)
Requirement already satisfied: blobfile in /home/sunshine/pt/lib/python3.11/site-packages (from -r install/requirements.txt (line 18)) (3.0.0)
Requirement already satisfied: openai in /home/sunshine/pt/lib/python3.11/site-packages (from -r install/requirements.txt (line 20)) (1.44.0)
Requirement already satisfied: wheel in /home/sunshine/pt/lib/python3.11/site-packages (from -r install/requirements.txt (line 23)) (0.44.0)
Requirement already satisfied: cmake>=3.24 in /home/sunshine/pt/lib/python3.11/site-packages (from -r install/requirements.txt (line 24)) (3.30.2)
Requirement already satisfied: ninja in /home/sunshine/pt/lib/python3.11/site-packages (from -r install/requirements.txt (line 25)) (1.11.1.1)
Requirement already satisfied: zstd in /home/sunshine/pt/lib/python3.11/site-packages (from -r install/requirements.txt (line 26)) (1.5.5.1)
Requirement already satisfied: streamlit in /home/sunshine/pt/lib/python3.11/site-packages (from -r install/requirements.txt (line 29)) (1.38.0)
Requirement already satisfied: flask in /home/sunshine/pt/lib/python3.11/site-packages (from -r install/requirements.txt (line 32)) (3.0.3)
Requirement already satisfied: accelerate>=0.21.0 in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (0.34.2)
Requirement already satisfied: evaluate in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (0.4.2)
Requirement already satisfied: datasets>=2.16.0 in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (2.21.0)
Requirement already satisfied: jsonlines in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (4.0.0)
Requirement already satisfied: numexpr in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (2.10.1)
Requirement already satisfied: peft>=0.2.0 in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (0.12.0)
Requirement already satisfied: pybind11>=2.6.2 in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (2.13.5)
Requirement already satisfied: pytablewriter in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (1.2.0)
Requirement already satisfied: rouge-score>=0.0.4 in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (0.1.2)
Requirement already satisfied: sacrebleu>=1.5.0 in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (2.4.3)
Requirement already satisfied: scikit-learn>=0.24.1 in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (1.5.1)
Requirement already satisfied: sqlitedict in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (2.1.0)
Requirement already satisfied: torch>=1.8 in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (2.5.0.dev20240716)
Requirement already satisfied: tqdm-multiprocess in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (0.0.11)
Requirement already satisfied: transformers>=4.1 in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (4.42.4)
Requirement already satisfied: zstandard in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (0.23.0)
Requirement already satisfied: dill in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (0.3.8)
Requirement already satisfied: word2number in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (1.1)
Requirement already satisfied: more-itertools in /home/sunshine/pt/lib/python3.11/site-packages (from lm-eval==0.4.2->-r install/requirements.txt (line 17)) (10.5.0)
Requirement already satisfied: filelock in /home/sunshine/pt/lib/python3.11/site-packages (from huggingface_hub->-r install/requirements.txt (line 4)) (3.15.4)
Requirement already satisfied: fsspec>=2023.5.0 in /home/sunshine/pt/lib/python3.11/site-packages (from huggingface_hub->-r install/requirements.txt (line 4)) (2024.6.1)
Requirement already satisfied: packaging>=20.9 in /home/sunshine/pt/lib/python3.11/site-packages (from huggingface_hub->-r install/requirements.txt (line 4)) (24.1)
Requirement already satisfied: pyyaml>=5.1 in /home/sunshine/pt/lib/python3.11/site-packages (from huggingface_hub->-r install/requirements.txt (line 4)) (6.0.2)
Requirement already satisfied: requests in /home/sunshine/pt/lib/python3.11/site-packages (from huggingface_hub->-r install/requirements.txt (line 4)) (2.32.3)
Requirement already satisfied: tqdm>=4.42.1 in /home/sunshine/pt/lib/python3.11/site-packages (from huggingface_hub->-r install/requirements.txt (line 4)) (4.66.5)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /home/sunshine/pt/lib/python3.11/site-packages (from huggingface_hub->-r install/requirements.txt (line 4)) (4.12.2)
Requirement already satisfied: regex>=2022.1.18 in /home/sunshine/pt/lib/python3.11/site-packages (from tiktoken->-r install/requirements.txt (line 10)) (2024.7.24)
Requirement already satisfied: tornado>=2.0 in /home/sunshine/pt/lib/python3.11/site-packages (from snakeviz->-r install/requirements.txt (line 13)) (6.4.1)
Requirement already satisfied: pycryptodomex>=3.8 in /home/sunshine/pt/lib/python3.11/site-packages (from blobfile->-r install/requirements.txt (line 18)) (3.20.0)
Requirement already satisfied: urllib3<3,>=1.25.3 in /home/sunshine/pt/lib/python3.11/site-packages (from blobfile->-r install/requirements.txt (line 18)) (2.2.2)
Requirement already satisfied: lxml>=4.9 in /home/sunshine/pt/lib/python3.11/site-packages (from blobfile->-r install/requirements.txt (line 18)) (5.3.0)
Requirement already satisfied: anyio<5,>=3.5.0 in /home/sunshine/pt/lib/python3.11/site-packages (from openai->-r install/requirements.txt (line 20)) (4.4.0)
Requirement already satisfied: distro<2,>=1.7.0 in /home/sunshine/pt/lib/python3.11/site-packages (from openai->-r install/requirements.txt (line 20)) (1.9.0)
Requirement already satisfied: httpx<1,>=0.23.0 in /home/sunshine/pt/lib/python3.11/site-packages (from openai->-r install/requirements.txt (line 20)) (0.27.2)
Requirement already satisfied: jiter<1,>=0.4.0 in /home/sunshine/pt/lib/python3.11/site-packages (from openai->-r install/requirements.txt (line 20)) (0.5.0)
Requirement already satisfied: pydantic<3,>=1.9.0 in /home/sunshine/pt/lib/python3.11/site-packages (from openai->-r install/requirements.txt (line 20)) (2.9.0)
Requirement already satisfied: sniffio in /home/sunshine/pt/lib/python3.11/site-packages (from openai->-r install/requirements.txt (line 20)) (1.3.1)
Requirement already satisfied: altair<6,>=4.0 in /home/sunshine/pt/lib/python3.11/site-packages (from streamlit->-r install/requirements.txt (line 29)) (5.4.1)
Requirement already satisfied: blinker<2,>=1.0.0 in /home/sunshine/pt/lib/python3.11/site-packages (from streamlit->-r install/requirements.txt (line 29)) (1.8.2)
Requirement already satisfied: cachetools<6,>=4.0 in /home/sunshine/pt/lib/python3.11/site-packages (from streamlit->-r install/requirements.txt (line 29)) (5.5.0)
Requirement already satisfied: click<9,>=7.0 in /home/sunshine/pt/lib/python3.11/site-packages (from streamlit->-r install/requirements.txt (line 29)) (8.1.7)
Requirement already satisfied: pandas<3,>=1.3.0 in /home/sunshine/pt/lib/python3.11/site-packages (from streamlit->-r install/requirements.txt (line 29)) (2.2.2)
Requirement already satisfied: pillow<11,>=7.1.0 in /home/sunshine/pt/lib/python3.11/site-packages (from streamlit->-r install/requirements.txt (line 29)) (10.4.0)
Requirement already satisfied: protobuf<6,>=3.20 in /home/sunshine/pt/lib/python3.11/site-packages (from streamlit->-r install/requirements.txt (line 29)) (5.28.0)
Requirement already satisfied: pyarrow>=7.0 in /home/sunshine/pt/lib/python3.11/site-packages (from streamlit->-r install/requirements.txt (line 29)) (17.0.0)
Requirement already satisfied: rich<14,>=10.14.0 in /home/sunshine/pt/lib/python3.11/site-packages (from streamlit->-r install/requirements.txt (line 29)) (13.8.0)
Requirement already satisfied: tenacity<9,>=8.1.0 in /home/sunshine/pt/lib/python3.11/site-packages (from streamlit->-r install/requirements.txt (line 29)) (8.5.0)
Requirement already satisfied: toml<2,>=0.10.1 in /home/sunshine/pt/lib/python3.11/site-packages (from streamlit->-r install/requirements.txt (line 29)) (0.10.2)
Requirement already satisfied: gitpython!=3.1.19,<4,>=3.0.7 in /home/sunshine/pt/lib/python3.11/site-packages (from streamlit->-r install/requirements.txt (line 29)) (3.1.43)
Requirement already satisfied: pydeck<1,>=0.8.0b4 in /home/sunshine/pt/lib/python3.11/site-packages (from streamlit->-r install/requirements.txt (line 29)) (0.9.1)
Requirement already satisfied: watchdog<5,>=2.1.5 in /home/sunshine/pt/lib/python3.11/site-packages (from streamlit->-r install/requirements.txt (line 29)) (4.0.2)
Requirement already satisfied: Werkzeug>=3.0.0 in /home/sunshine/pt/lib/python3.11/site-packages (from flask->-r install/requirements.txt (line 32)) (3.0.4)
Requirement already satisfied: Jinja2>=3.1.2 in /home/sunshine/pt/lib/python3.11/site-packages (from flask->-r install/requirements.txt (line 32)) (3.1.4)
Requirement already satisfied: itsdangerous>=2.1.2 in /home/sunshine/pt/lib/python3.11/site-packages (from flask->-r install/requirements.txt (line 32)) (2.2.0)
Requirement already satisfied: psutil in /home/sunshine/pt/lib/python3.11/site-packages (from accelerate>=0.21.0->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (6.0.0)
Requirement already satisfied: safetensors>=0.4.3 in /home/sunshine/pt/lib/python3.11/site-packages (from accelerate>=0.21.0->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (0.4.5)
Requirement already satisfied: jsonschema>=3.0 in /home/sunshine/pt/lib/python3.11/site-packages (from altair<6,>=4.0->streamlit->-r install/requirements.txt (line 29)) (4.23.0)
Requirement already satisfied: narwhals>=1.5.2 in /home/sunshine/pt/lib/python3.11/site-packages (from altair<6,>=4.0->streamlit->-r install/requirements.txt (line 29)) (1.6.2)
Requirement already satisfied: idna>=2.8 in /home/sunshine/pt/lib/python3.11/site-packages (from anyio<5,>=3.5.0->openai->-r install/requirements.txt (line 20)) (3.8)
Requirement already satisfied: xxhash in /home/sunshine/pt/lib/python3.11/site-packages (from datasets>=2.16.0->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (3.5.0)
Requirement already satisfied: multiprocess in /home/sunshine/pt/lib/python3.11/site-packages (from datasets>=2.16.0->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (0.70.16)
Requirement already satisfied: aiohttp in /home/sunshine/pt/lib/python3.11/site-packages (from datasets>=2.16.0->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (3.10.5)
Requirement already satisfied: gitdb<5,>=4.0.1 in /home/sunshine/pt/lib/python3.11/site-packages (from gitpython!=3.1.19,<4,>=3.0.7->streamlit->-r install/requirements.txt (line 29)) (4.0.11)
Requirement already satisfied: certifi in /home/sunshine/pt/lib/python3.11/site-packages (from httpx<1,>=0.23.0->openai->-r install/requirements.txt (line 20)) (2024.8.30)
Requirement already satisfied: httpcore==1.* in /home/sunshine/pt/lib/python3.11/site-packages (from httpx<1,>=0.23.0->openai->-r install/requirements.txt (line 20)) (1.0.5)
Requirement already satisfied: h11<0.15,>=0.13 in /home/sunshine/pt/lib/python3.11/site-packages (from httpcore==1.*->httpx<1,>=0.23.0->openai->-r install/requirements.txt (line 20)) (0.14.0)
Requirement already satisfied: MarkupSafe>=2.0 in /home/sunshine/pt/lib/python3.11/site-packages (from Jinja2>=3.1.2->flask->-r install/requirements.txt (line 32)) (2.1.5)
Requirement already satisfied: python-dateutil>=2.8.2 in /home/sunshine/pt/lib/python3.11/site-packages (from pandas<3,>=1.3.0->streamlit->-r install/requirements.txt (line 29)) (2.9.0.post0)
Requirement already satisfied: pytz>=2020.1 in /home/sunshine/pt/lib/python3.11/site-packages (from pandas<3,>=1.3.0->streamlit->-r install/requirements.txt (line 29)) (2024.1)
Requirement already satisfied: tzdata>=2022.7 in /home/sunshine/pt/lib/python3.11/site-packages (from pandas<3,>=1.3.0->streamlit->-r install/requirements.txt (line 29)) (2024.1)
Requirement already satisfied: annotated-types>=0.4.0 in /home/sunshine/pt/lib/python3.11/site-packages (from pydantic<3,>=1.9.0->openai->-r install/requirements.txt (line 20)) (0.7.0)
Requirement already satisfied: pydantic-core==2.23.2 in /home/sunshine/pt/lib/python3.11/site-packages (from pydantic<3,>=1.9.0->openai->-r install/requirements.txt (line 20)) (2.23.2)
Requirement already satisfied: charset-normalizer<4,>=2 in /home/sunshine/pt/lib/python3.11/site-packages (from requests->huggingface_hub->-r install/requirements.txt (line 4)) (3.3.2)
Requirement already satisfied: markdown-it-py>=2.2.0 in /home/sunshine/pt/lib/python3.11/site-packages (from rich<14,>=10.14.0->streamlit->-r install/requirements.txt (line 29)) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /home/sunshine/pt/lib/python3.11/site-packages (from rich<14,>=10.14.0->streamlit->-r install/requirements.txt (line 29)) (2.18.0)
Requirement already satisfied: absl-py in /home/sunshine/pt/lib/python3.11/site-packages (from rouge-score>=0.0.4->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (2.1.0)
Requirement already satisfied: nltk in /home/sunshine/pt/lib/python3.11/site-packages (from rouge-score>=0.0.4->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (3.9.1)
Requirement already satisfied: six>=1.14.0 in /home/sunshine/pt/lib/python3.11/site-packages (from rouge-score>=0.0.4->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (1.16.0)
Requirement already satisfied: portalocker in /home/sunshine/pt/lib/python3.11/site-packages (from sacrebleu>=1.5.0->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (2.10.1)
Requirement already satisfied: tabulate>=0.8.9 in /home/sunshine/pt/lib/python3.11/site-packages (from sacrebleu>=1.5.0->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (0.9.0)
Requirement already satisfied: colorama in /home/sunshine/pt/lib/python3.11/site-packages (from sacrebleu>=1.5.0->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (0.4.6)
Requirement already satisfied: scipy>=1.6.0 in /home/sunshine/pt/lib/python3.11/site-packages (from scikit-learn>=0.24.1->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (1.14.1)
Requirement already satisfied: joblib>=1.2.0 in /home/sunshine/pt/lib/python3.11/site-packages (from scikit-learn>=0.24.1->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (1.4.2)
Requirement already satisfied: threadpoolctl>=3.1.0 in /home/sunshine/pt/lib/python3.11/site-packages (from scikit-learn>=0.24.1->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (3.5.0)
Requirement already satisfied: sympy in /home/sunshine/pt/lib/python3.11/site-packages (from torch>=1.8->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (1.13.1)
Requirement already satisfied: networkx in /home/sunshine/pt/lib/python3.11/site-packages (from torch>=1.8->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (3.3)
Requirement already satisfied: tokenizers<0.20,>=0.19 in /home/sunshine/pt/lib/python3.11/site-packages (from transformers>=4.1->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (0.19.1)
Requirement already satisfied: attrs>=19.2.0 in /home/sunshine/pt/lib/python3.11/site-packages (from jsonlines->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (24.2.0)
Requirement already satisfied: setuptools>=38.3.0 in /home/sunshine/pt/lib/python3.11/site-packages (from pytablewriter->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (70.3.0)
Requirement already satisfied: DataProperty<2,>=1.0.1 in /home/sunshine/pt/lib/python3.11/site-packages (from pytablewriter->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (1.0.1)
Requirement already satisfied: mbstrdecoder<2,>=1.0.0 in /home/sunshine/pt/lib/python3.11/site-packages (from pytablewriter->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (1.1.3)
Requirement already satisfied: pathvalidate<4,>=2.3.0 in /home/sunshine/pt/lib/python3.11/site-packages (from pytablewriter->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (3.2.1)
Requirement already satisfied: tabledata<2,>=1.3.1 in /home/sunshine/pt/lib/python3.11/site-packages (from pytablewriter->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (1.3.3)
Requirement already satisfied: tcolorpy<1,>=0.0.5 in /home/sunshine/pt/lib/python3.11/site-packages (from pytablewriter->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (0.1.6)
Requirement already satisfied: typepy<2,>=1.3.2 in /home/sunshine/pt/lib/python3.11/site-packages (from typepy[datetime]<2,>=1.3.2->pytablewriter->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (1.3.2)
Requirement already satisfied: aiohappyeyeballs>=2.3.0 in /home/sunshine/pt/lib/python3.11/site-packages (from aiohttp->datasets>=2.16.0->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (2.4.0)
Requirement already satisfied: aiosignal>=1.1.2 in /home/sunshine/pt/lib/python3.11/site-packages (from aiohttp->datasets>=2.16.0->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (1.3.1)
Requirement already satisfied: frozenlist>=1.1.1 in /home/sunshine/pt/lib/python3.11/site-packages (from aiohttp->datasets>=2.16.0->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (1.4.1)
Requirement already satisfied: multidict<7.0,>=4.5 in /home/sunshine/pt/lib/python3.11/site-packages (from aiohttp->datasets>=2.16.0->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (6.0.5)
Requirement already satisfied: yarl<2.0,>=1.0 in /home/sunshine/pt/lib/python3.11/site-packages (from aiohttp->datasets>=2.16.0->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (1.10.0)
Requirement already satisfied: smmap<6,>=3.0.1 in /home/sunshine/pt/lib/python3.11/site-packages (from gitdb<5,>=4.0.1->gitpython!=3.1.19,<4,>=3.0.7->streamlit->-r install/requirements.txt (line 29)) (5.0.1)
Requirement already satisfied: jsonschema-specifications>=2023.03.6 in /home/sunshine/pt/lib/python3.11/site-packages (from jsonschema>=3.0->altair<6,>=4.0->streamlit->-r install/requirements.txt (line 29)) (2023.12.1)
Requirement already satisfied: referencing>=0.28.4 in /home/sunshine/pt/lib/python3.11/site-packages (from jsonschema>=3.0->altair<6,>=4.0->streamlit->-r install/requirements.txt (line 29)) (0.35.1)
Requirement already satisfied: rpds-py>=0.7.1 in /home/sunshine/pt/lib/python3.11/site-packages (from jsonschema>=3.0->altair<6,>=4.0->streamlit->-r install/requirements.txt (line 29)) (0.20.0)
Requirement already satisfied: mdurl~=0.1 in /home/sunshine/pt/lib/python3.11/site-packages (from markdown-it-py>=2.2.0->rich<14,>=10.14.0->streamlit->-r install/requirements.txt (line 29)) (0.1.2)
Requirement already satisfied: chardet<6,>=3.0.4 in /home/sunshine/pt/lib/python3.11/site-packages (from mbstrdecoder<2,>=1.0.0->pytablewriter->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (5.2.0)
Requirement already satisfied: mpmath<1.4,>=1.1.0 in /home/sunshine/pt/lib/python3.11/site-packages (from sympy->torch>=1.8->lm-eval==0.4.2->-r install/requirements.txt (line 17)) (1.3.0)
+ pip3 uninstall -y triton
WARNING: Skipping triton as it is not installed.
+ pip3 install --extra-index-url https://download.pytorch.org/whl/nightly/cpu torch==2.5.0.dev20240814 torchvision==0.20.0.dev20240814 torchtune==0.3.0.dev20240916
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple, https://download.pytorch.org/whl/nightly/cpu
Collecting torch==2.5.0.dev20240814
  Using cached https://download.pytorch.org/whl/nightly/cpu/torch-2.5.0.dev20240814-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl (91.4 MB)
ERROR: Ignored the following yanked versions: 0.1.6, 0.1.7, 0.1.8, 0.1.9, 0.2.0, 0.2.1, 0.2.2, 0.2.2.post2, 0.2.2.post3, 0.15.0
ERROR: Could not find a version that satisfies the requirement torchvision==0.20.0.dev20240814 (from versions: 0.15.1, 0.15.2, 0.16.0, 0.16.1, 0.16.2, 0.17.0.dev20231010, 0.17.0, 0.17.1, 0.17.2, 0.18.0, 0.18.1, 0.19.0, 0.19.1, 0.20.0.dev20240723, 0.20.0.dev20240724, 0.20.0.dev20240725, 0.20.0.dev20240726, 0.20.0.dev20240727, 0.20.0.dev20240728, 0.20.0.dev20240729, 0.20.0.dev20240730, 0.20.0.dev20240731, 0.20.0.dev20240801, 0.20.0.dev20240802, 0.20.0.dev20240803, 0.20.0.dev20240804, 0.20.0.dev20240805, 0.20.0.dev20240806, 0.20.0.dev20240807, 0.20.0.dev20240808, 0.20.0.dev20240809, 0.20.0.dev20240810, 0.20.0.dev20240811, 0.20.0.dev20240812, 0.20.0.dev20240813, 0.20.0.dev20240815, 0.20.0.dev20240816, 0.20.0.dev20240818, 0.20.0.dev20240819, 0.20.0.dev20240820, 0.20.0.dev20240821, 0.20.0.dev20240822, 0.20.0.dev20240823, 0.20.0.dev20240824, 0.20.0.dev20240825, 0.20.0.dev20240826, 0.20.0.dev20240827, 0.20.0.dev20240828, 0.20.0.dev20240829, 0.20.0.dev20240830, 0.20.0.dev20240831, 0.20.0.dev20240901, 0.20.0.dev20240902, 0.20.0.dev20240903, 0.20.0.dev20240904, 0.20.0.dev20240905, 0.20.0.dev20240906, 0.20.0.dev20240907, 0.20.0.dev20240908, 0.20.0.dev20240909, 0.20.0.dev20240910, 0.20.0.dev20240911, 0.20.0.dev20240912, 0.20.0.dev20240913, 0.20.0.dev20240914, 0.20.0.dev20240915, 0.20.0.dev20240916, 0.20.0.dev20240917, 0.20.0.dev20240918, 0.20.0.dev20240919, 0.20.0.dev20240920)
ERROR: No matching distribution found for torchvision==0.20.0.dev20240814

Versions

(pt) sunshine@raspberrypi:~/torchchat $ wget https://raw.githubusercontent.com/pytorch/pytorch/main/torch/utils/collect_env.py
# For security purposes, please check the contents of collect_env.py before running it.
python collect_env.py
--2024-09-20 19:43:09--  https://raw.githubusercontent.com/pytorch/pytorch/main/torch/utils/collect_env.py
Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 185.199.111.133, 185.199.108.133, 185.199.109.133, ...
Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|185.199.111.133|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 23357 (23K) [text/plain]
Saving to: â

collect_env.py      100%[===================>]  22.81K  --.-KB/s    in 0.007s  

2024-09-20 19:43:09 (3.30 MB/s) - â saved [23357/23357]

Collecting environment information...
PyTorch version: 2.5.0.dev20240716
Is debug build: False
CUDA used to build PyTorch: None
ROCM used to build PyTorch: N/A

OS: Debian GNU/Linux trixie/sid (aarch64)
GCC version: (Debian 13.3.0-6) 13.3.0
Clang version: 16.0.6 (27+b1)
CMake version: version 3.30.2
Libc version: glibc-2.40

Python version: 3.11.2 (main, Aug 26 2024, 07:20:54) [GCC 12.2.0] (64-bit runtime)
Python platform: Linux-6.6.31+rpt-rpi-v8-aarch64-with-glibc2.40
Is CUDA available: False
CUDA runtime version: No CUDA
CUDA_MODULE_LOADING set to: N/A
GPU models and configuration: No CUDA
Nvidia driver version: No CUDA
cuDNN version: No CUDA
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

CPU:
Architecture:                         aarch64
CPU op-mode(s):                       32-bit, 64-bit
Byte Order:                           Little Endian
CPU(s):                               4
On-line CPU(s) list:                  0-3
Vendor ID:                            ARM
Model name:                           Cortex-A76
Model:                                1
Thread(s) per core:                   1
Core(s) per cluster:                  4
Socket(s):                            -
Cluster(s):                           1
Stepping:                             r4p1
CPU(s) scaling MHz:                   100%
CPU max MHz:                          2400.0000
CPU min MHz:                          1500.0000
BogoMIPS:                             108.00
Flags:                                fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm lrcpc dcpop asimddp
L1d cache:                            256 KiB (4 instances)
L1i cache:                            256 KiB (4 instances)
L2 cache:                             2 MiB (4 instances)
L3 cache:                             2 MiB (1 instance)
Vulnerability Gather data sampling:   Not affected
Vulnerability Itlb multihit:          Not affected
Vulnerability L1tf:                   Not affected
Vulnerability Mds:                    Not affected
Vulnerability Meltdown:               Not affected
Vulnerability Mmio stale data:        Not affected
Vulnerability Reg file data sampling: Not affected
Vulnerability Retbleed:               Not affected
Vulnerability Spec rstack overflow:   Not affected
Vulnerability Spec store bypass:      Mitigation; Speculative Store Bypass disabled via prctl
Vulnerability Spectre v1:             Mitigation; __user pointer sanitization
Vulnerability Spectre v2:             Mitigation; CSV2, BHB
Vulnerability Srbds:                  Not affected
Vulnerability Tsx async abort:        Not affected

Versions of relevant libraries:
[pip3] executorch==0.4.0a0+9129892
[pip3] numpy==1.26.4
[pip3] torch==2.5.0.dev20240716
[pip3] torchao==0.4.0+gite11201a
[pip3] torchaudio==2.4.0.dev20240716
[pip3] torchsr==1.0.4
[pip3] torchvision==0.20.0.dev20240716
[conda] Could not collect
sunshinesfbay commented 1 month ago

Also (after commenting out torchvision):

+ pip3 install torchao==0.5.0
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
ERROR: Could not find a version that satisfies the requirement torchao==0.5.0 (from versions: 0.0.1, 0.0.3, 0.1)
ERROR: No matching distribution found for torchao==0.5.0
Jack-Khuu commented 1 month ago

Thanks for flagging!

I haven't tested much on ARM64 machines, so this is a helpful find

jerryzh168 commented 1 month ago

Also (after commenting out torchvision):

+ pip3 install torchao==0.5.0
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
ERROR: Could not find a version that satisfies the requirement torchao==0.5.0 (from versions: 0.0.1, 0.0.3, 0.1)
ERROR: No matching distribution found for torchao==0.5.0

cc @atalman can you take a look? I can install "Downloading torchao-0.5.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)" in my devserver but probably this is not available in some platforms

atalman commented 3 weeks ago

Hi @sunshinesfbay The topmost comment is about nightly builds. torch+torchvision For aarch64 please monitor: https://hud2.pytorch.org/hud/pytorch/vision/nightly/1?per_page=50&name_filter=aarch After it completes with the green state, nightly should become available.

We do have validation worklfows that we run after nightly is complete here an example for aarch64: https://github.com/pytorch/builder/actions/runs/11489051491/job/31977088265

mikekgfb commented 1 week ago

We do have validation worklfows that we run after nightly is complete here an example for aarch64: https://github.com/pytorch/builder/actions/runs/11489051491/job/31977088265

Could we run an aarch64 linux flavor of https://github.com/pytorch/torchchat/blob/main/.github/workflows/run-readme-pr.yml, or at least a subset as a "smoke test" (e.g., just test-readme-any, and possibly test-quantization-any ?) if there are not enough linux-aarch64 runners