-
### **Description:**
When running the llm inference example, the application crashed.
### **Steps to Reproduce:**
1. Run the example from the repository
2. Once the model is loaded, give input.
…
-
### What is the issue?
I use codegemma with continue.dev extension on vscode, it works fine on version 0.1.39. but on the last two releases it doesn't generate completions and behave very strangely i…
-
1) Load the Gemma2 2B model with Unsloth - OK
2) Perform fine tuning - OK
3) Test the resulting model - OK, responses indicate fine tuning is successful
4) Save 16 bit `model.save_pretrained_merged…
-
ValueError: Ollama call failed with status code 500. Details: llama runner: failed to load model '/root/.ollama/models/blobs/sha256:c1864a5eb19305c40519da12cc543519e48a0697ecd30e15d5ac228644957d12': …
-
Hi,
I am running llama-cpp-python on surface book 2 having i7 with nvidea geforce gtx 1060.
I installed vc++, cuda drivers 12.4
Running on Python 3.11.3
Compiled llama using below command on Min…
-
### Feature request
Generalize the functionality in [processing_llava.py](https://github.com/huggingface/transformers/blob/main/src/transformers/models/llava/processing_llava.py) to include other t…
-
Any plans to support conversion of ```StableLmForCausalLM" models? I've noticed that they're very good; for example the new Zephyr model here:
https://huggingface.co/stabilityai/stablelm-zephyr-3b…
-
### Issues Policy acknowledgement
- [X] I have read and agree to submit bug reports in accordance with the [issues policy](https://www.github.com/mlflow/mlflow/blob/master/ISSUE_POLICY.md)
### W…
-
### What is the issue?
Upon running "ollama run gemma:2b" (though this happens for all tested models: llama3, phi, tinyllama), the loading animation appears and after ~5 minutes (estimate, untimed)…
-
### Please check that this issue hasn't been reported before.
- [X] I searched previous [Bug Reports](https://github.com/OpenAccess-AI-Collective/axolotl/labels/bug) didn't find any similar reports.
…