-
Hi i am struggling on how to create an ollama Modelfile for training mistral 7b with unsloth.
Or are they any additional steps?
I have finetuned the llm and push it to hub as gguf q4. However if i t…
-
### What is the issue?
I am working on a modelfile and did the following...
```
ollama run --verbose llama3.1:8b
/set parameter num_ctx 131072
/set parameter num_predict -2
/save llama3.1:8b…
-
I'm currently writing a webui for ollama but I find the API quite limited/cumbersome.
What is your vision/plan regarding it? Is it in a frozen state, or are you planning to improve it?
Here's som…
-
api参考文档写了可以发送文档，为什么用llava等多模态大模型时只能识别到列表最后一张图片？或者需要修改modelfile中的template吗
-
I get a "segmentation fault" when I try to convert the ONNX model in MNN model:
```
MNNConvert -f ONNX --modelFile voxceleb_resnet34.onnx --MNNModel model.mnn --bizCode MNN
```
```
The device…
-
Hello,
I train the One Class SVC in Python and port it to C++ as follows:
import micromlgen
from micromlgen import port
classmap = {
-1: 'Fault',
1: 'No fault'
}
c_code_OC…
-
Support for custom actions to cal custom API/Code as part of llama response. possibly part of modelfiles via python scripts? chatGPT has similar with integrations with Zapier
-
### System Info
llama_recipes funetuning.py for finetuning
ollama + modelfile for inferencing.
### Information
- [x] The official example scripts
- [ ] My own modified scripts
### 🐛 Describe the …
-
### Señala los requisitos cumplidos
- [X] Mi aplicación usa Vercel SDK AI de alguna forma
- [X] Mi aplicación está desplegada y funciona
### Escribe tu nombre o el del equipo
Camilo Tapias
### No…
-
I've been considering using mistral.rs for vision models as it's the only choice other than llama.cpp that support partial offloading; however one thing I quickly noticed was that
* UQFF models are n…