-
### Topic
package dependencies
### Relevant information
i am using `llama-index-core`. the package conflicted with nltk's version.
[nltk update ](https://github.com/nltk/nltk/issues/3305) …
-
Hello, thank you for providing this excellent model and repository. I encountered an issue while conducting my experiments with your codebase, and I’d appreciate your insights.
In my experiments, I…
-
Hello! Thank you very much for your excellent work, which enables the distributed running of large models on heterogeneous devices! I was wondering if this project supports Android devices. I am curre…
-
I am getting the following error:
> llama distribution install --spec local --name local-llama-8b
```
Using local-llama-8b as the Conda environment for this distribution
Conda environment 'loc…
-
### Your current environment
vLLM Version: 0.6.3.post2.dev256+g4be3a451
The output of `python collect_env.py`
```text
Collecting environment information... …
-
### Version
Command-line (Python) version
### Operating System
Windows 11
### Your question
Hello,
am trying to setup the gpt pilot in my local system where am trying to use the model Meta-Lla…
-
pip install "unsloth[cu121-ampere-torch240] @ git+https://github.com/unslothai/unsloth.git"
pip install "unsloth[cu118-ampere-torch240] @ git+https://github.com/unslothai/unsloth.git"
pip install "u…
-
What I did this week:
-
On Mac Sonoma. Just installed the software from the latest release (1.1.2 (4)), and downloaded the LLama-3.2-3B-8bit from the MLX community panel. Then see this error.
-
Do you plan on supporting Llama3.2 (text/multimodal) on Qualcomm A100?
I saw this post (https://www.qualcomm.com/news/onq/2024/09/qualcomm-partners-with-meta-to-support-llama-3-point-2-big-deal-for-o…
alew3 updated
3 weeks ago