Open vsesha opened 4 months ago
@vsesha, i think there's a small typo in the branch name. It should be arctic
instead of artic
. Can you try again with this command?
!pip install git+https://github.com/Snowflake-Labs/vllm@arctic
Another question though, what type of GPUs are you trying to use in colab? You will need roughly 8xA100-80GB or 8xH100-80GBs to run Arctic.
Hello, I am trying to play around with snowflake’s artic llm in google co-lab and using Hugging face version. I tried following the instructions on snowflake-artic github and got the errors mentioned below:
Finally I removed the branch option !pip install git+https://github.com/Snowflake-Labs/vllm, starts to clone and towards the end throws the error: _Building wheels for collected packages: vllm error: subprocess-exited-with-error
× Building wheel for vllm (pyproject.toml) did not run successfully. │ exit code: 1 ╰─> See above for output.
note: This error originates from a subprocess, and is likely not a problem with pip. Building wheel for vllm (pyproject.toml) … error ERROR: Failed building wheel for vllm Failed to build vllm ERROR: Could not build wheels for vllm, which is required to install pyproject.toml-based projects_
I am referring to an incorrect branch ? could someone help me here pls?