-
### Bug Description
---------------------------------------------------------------------------
HFValidationError Traceback (most recent call last)
[](https://localhost:8080…
-
I'm having trouble getting this model to run on mac m1 16gb ram:
ollama run deepseek-coder:6.7b-base-q8_0
but this model work without any troubles:
ollama run neural-chat:7b-v3.1-q8_0
it has m…
-
I have changed some parameters in the training code as instructed, but when I run dpo on 8*A6000, I get these errors.
If I understand correctly, habana is only used for hpu training.
Details
Tr…
-
This has been discussed repeatedly, but it's important to get right if we want widespread adoption. Some references:
https://github.com/Evizero/MLModels.jl/issues/12
https://github.com/Evizero/MLMod…
-
Hey,
thanks for this, but on my system when i try to run the model i get this error, do you have any solutions to this.
```
(venv) PS D:\intel\LLM\openvino-llm-minimal-code> optimum-cli export…
-
Hi,
I am getting this Seg fault error.
My code is:
import time
from transformers import AutoTokenizer
from intel_extension_for_transformers.transformers import AutoModelForCausalLM, We…
-
### System Info
I have downloaded the setup from "https://gpt4all.io/installers/gpt4all-installer-win64.exe" and installed it as requested. However, after running the GPT4ALL from start menu, nothing…
-
**Created a virtual environment using the following commands.**
git clone https://github.com/intel/neural-speed.git
python3 -m venv itrex_env
source itrex_env/bin/activate
cd neural-speed
pip i…
-
Hey!
Thanks for the great project and for sharing it with the community.
I am trying to inference with the HF [neural-chat](https://huggingface.co/Intel/neural-chat-7b-v3-1) model.
## What I t…
dopc updated
9 months ago
-
## 🐛 Bug
Running `mlc_chat compile` command for the `gemma-2-it` model on Linux with Vulkan target results in this error:
```
InternalError: Check failed: shared_memory_bytes_used_