-
### Describe the feature you'd like
I currently use Ollama via Open-WebUI in Docker. That provides a Ollama API but behind a per-user API key. That is more secure that having an open, unauthenticated…
-
**Description**
Sometimes you have crashes like the ones below.
`ui_model_menu.py` is quite nice and dandy by reporting the python stack when it can, but as you can see below if you were only to …
mirh updated
2 months ago
-
问题：通过webui.py运行，推理模式选择预训练音色，点击生成音频报错，服务端显示：RuntimeError: "addmm_impl_cpu_" not implemented for 'Half'，具体报错信息如下：
2024-09-27 16:32:01,942 INFO get sft inference request
tn 我是通义实验室语音团队全新推出的生成式语音大模型，提…
-
When using this plugin for Obsidian, I can't change LLMs without uninstalling the plugin first. Then it seems that what ever model I load first gets stuck. I can select other models from the drop-down…
-
**_When launching a search in the webui, ollama API responses are working correctly for the generation steps, but not for the embeddings._**
1. `ollama serve`
2. `python -m uvicorn main:app --relo…
-
Greetings, thank you for your work.
After successful running the nvidia default variant, I tried to run the TensorRT variant (`default-nvidia-tensorrtllm`). But it does not start.
No modifications t…
ht-sp updated
1 month ago
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
"ValueError: a cannot be empty unless no samples are taken"
…
-
I have i5-6400, 16gb ram, rtx 3060ti 8gb
i'm trying to load model:
LLaMA2-13B-Tiefighter.Q4_K_S.gguf
i launch program koboldcpp.exe (exactly this version) and setting Gpu Layers to 41 as recomm…
-
我在微调CosyVoice-300M-25Hz模型，但微调后的模型无法加载。我按照examples/libritts里面cosyvoice.yaml的注释，修改了text_token_size、input_frame_rate和get_tokenizer，开始训练后，exp中保存了init.pt，然后把init.pt移动到pretrained_models/CosyVoice-300M-25Hz，…
-
I don't know why but I'm encountering this problem with the library. Here I show my simple script:
```python
import ollama
client = ollama.Client(host=llm_config["base_url"], timeout=600)
clie…