-
### System Info
lorax_version=0.12.0
Using Docker to host the 11b model it runs perfectly for Llama3.1-8b
But with LLama3.2-11b I am getting the following error
ModuleNotFoundError: No module…
-
**Describe the bug**
I use Nemo 2.0 to train my model and get Nemo 2.0 checkpoint like this with .distcp files:
model_name
├── context
│ ├── model_config.yaml
│ ├── io.json
│ └── tokenizer
├── …
-
### Disappointing Performance
It's really strange that I have tried many **LLMs with vision** in `GGUF` format, listed in the official website, such as `Llama3.2-vision`, `llava`, `llava-llama3`, `ll…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…
-
I have downloaded LLAMA 3.2 1B Model from Hugging face with optimum-cli
optimum-cli export openvino --model meta-llama/Llama-3.2-1B-Instruct llama3.2-1b/1
Below are files downloaded
!…
-
### 🐛 Describe the bug
llama3.2 1B model run on QNN backend produce wrong result
### Versions
llama3.2 1B model run on QNN backend produce wrong result
-
### Have you searched existing issues? 🔎
- [X] I have searched and found no existing issues
### Desribe the bug
I am using beropic with llama3.1 for topic modelling. My text is long, so I use doc_…
-
Error using llama3.2-vision:11b
- Model is downloaded
-
你好，请问一下能否公布一下LLaMA3-8B-F.T.模型微调的细节或者将模型发布到huggingface，万分感激！
-
## Goal
- Enables: https://github.com/janhq/jan/issues/2845
- Cortex is able to apply model presets
- e.g. llama3.1 presets for any llama3.1 finetune
- e.g. cortex can add a default field for `…