search

NousResearch / Hermes-Function-Calling

MIT License
673 stars 87 forks source link

Requirements issue with torch==2.1.2 #16

Closed lightningRalf closed 5 months ago

lightningRalf commented 5 months ago

Hello, just wanted to try this out, but I receive the following issue:

ERROR: Could not find a version that satisfies the requirement torch==2.1.2 (from versions: 2.2.0, 2.2.1, 2.2.2) ERROR: No matching distribution found for torch==2.1.2

Steps I performed before: git clone https://github.com/NousResearch/Hermes-Function-Callin python -m venv .venv pip install -r requirements.txt

suparious commented 5 months ago

Yeah, if you are not on an Nvidia CUDA system with python 3.11, then you may need to build your own torch. This 2.1.2 requirement is related Flash_Attn.

It is likely you are trying this on a MacBook or in Windows, I would guess. If that is the case, you can run the Nous Hermes 2 Pro model in an inference backend that is compatible with your system, such as ollama.

For reference, here is a notebook: https://github.com/NousResearch/Hermes-Function-Calling/blob/main/examples/instructor_ollama.ipynb