search

MDK8888 / GPTFast

Accelerate your Hugging Face Transformers 7.6-9x. Native to Hugging Face and PyTorch.
Apache License 2.0
687 stars 65 forks source link

ERROR: No matching distribution found for triton==2.1.0 #15

Closed Zephyruss1 closed 7 months ago

Zephyruss1 commented 7 months ago

Hello, I'm trying to run demo in my local PyCharm. I try to install requirements but receiving error:

Traceback:

Traceback (most recent call last):
  File "C:\Users\user\OneDrive\Desktop\pythonProject\main.py", line 4, in <module>
    from GPTFast.Core import gpt_fast
ModuleNotFoundError: No module named 'GPTFast'

What I tried:

(venv) PSC:\Users\user\OneDrive\Desktop\pythonProject>C:\Users\user\OneDrive\Desktop\pythonProject\venv\Scripts\activate.bat
(venv) PS C:\Users\user\OneDrive\Desktop\pythonProject> pip install GPTFast

Issue output:

Collecting GPTFast
  Obtaining dependency information for GPTFast from https://files.pythonhosted.org/packages/4d/e6/cd51a5643dd17b8f2f8c870d384ff11912e717eb3976f720db2a78f25500/gptfast-0.1.0-py3-none-any.whl.metadata
  Using cached gptfast-0.1.0-py3-none-any.whl.metadata (1.0 kB)
Collecting torch==2.1.2 (from GPTFast)
  Obtaining dependency information for torch==2.1.2 from https://files.pythonhosted.org/packages/16/bf/2ba0f0f7c07b9a14c027e181e44c58824e13f7352607ed32db18321599a2/torch-2.1.2-cp310-cp310-win_amd64.whl.metadata
  Using cached torch-2.1.2-cp310-cp310-win_amd64.whl.metadata (26 kB)
Requirement already satisfied: sympy==1.12 in c:\users\user\onedrive\desktop\pythonproject\venv\lib\site-packages (from GPTFast) (1.12)
Collecting typing-extensions==4.9.0 (from GPTFast)
  Obtaining dependency information for typing-extensions==4.9.0 from https://files.pythonhosted.org/packages/b7/f4/6a90020cd2d93349b442bfcb657d0dc91eee65491600b2cb1d388bc98e6b/typing_extensions-4.9.0-py3-none-any.whl.metadata
  Using cached typing_extensions-4.9.0-py3-none-any.whl.metadata (3.0 kB)
Requirement already satisfied: networkx==3.2.1 in c:\users\user\onedrive\desktop\pythonproject\venv\lib\site-packages (from GPTFast) (3.2.1)
Requirement already satisfied: jinja2==3.1.3 in c:\users\user\onedrive\desktop\pythonproject\venv\lib\site-packages (from GPTFast) (3.1.3)
INFO: pip is looking at multiple versions of gptfast to determine which version is compatible with other requirements. This could take a while.
ERROR: Could not find a version that satisfies the requirement triton==2.1.0 (from gptfast) (from versions: none)
ERROR: No matching distribution found for triton==2.1.0
MDK8888 commented 7 months ago

Hey, apologies for the late response! GPTFast was designed for linux, but I see that you are on windows-I recommend using WSL with Ubuntu 22.04.1 as that is what I used to develop GPTFast :)

Zephyruss1 commented 7 months ago

Hey, thanks for response. I will :) 👍