search

dusty-nv / NanoLLM

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.
https://dusty-nv.github.io/NanoLLM/
MIT License
171 stars 25 forks source link

pip3 install -r requirements.txt does not work #1

Open bryanhughes opened 5 months ago

bryanhughes commented 5 months ago

I cloned the repo and created the venv virtual environment using python3.10.12. Got the following error:

(venv) bryan@mimzy-jetson:~/git/NanoLLM$ pip3 install -r requirements.txt
Requirement already satisfied: torch in ./venv/lib/python3.10/site-packages (from -r requirements.txt (line 1)) (2.2.2)
Requirement already satisfied: torchvision in ./venv/lib/python3.10/site-packages (from -r requirements.txt (line 2)) (0.17.2)
Requirement already satisfied: torchaudio in ./venv/lib/python3.10/site-packages (from -r requirements.txt (line 3)) (2.2.2)
Requirement already satisfied: transformers in ./venv/lib/python3.10/site-packages (from -r requirements.txt (line 4)) (4.39.3)
Requirement already satisfied: tvm in ./venv/lib/python3.10/site-packages (from -r requirements.txt (line 5)) (1.0.0)
ERROR: Could not find a version that satisfies the requirement faiss (from versions: none)
ERROR: No matching distribution found for faiss
dusty-nv commented 5 months ago

@bryanhughes sorry yea still working through the bring-up of this outside of container, I think for now it will just need container because of the myriad of complex dependencies (faiss is a custom install, as are others)