-
(yuna2) (base) adm@Adms-MacBook-Pro yuna-ai % python index.py
ggml_metal_init: error: Error Domain=MTLLibraryErrorDomain Code=3 "program_source:3:10: fatal error: 'ggml-common.h' file not found
#inc…
-
Got this while running from main branch in Podman AI Lab:
```
�llama_model_loader: loaded meta data with 25 key-value pairs and 291 tensors from /granite-7b-lab-Q4_K_M.gguf (version GGUF V3 (lates…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [ x ] I am running the latest code. Development is very rapid so there are no tagged versions as …
-
Once the text generation finishes, there actually appears to be no way to continue generating, the submit button is greyed out and clicking it just errors out. I am using OpenAI endpoint in Koboldcpp …
-
Hello author, I am glad that you have made contributions to Jetson users. I have a question I would like to ask
Some errors occurred when I used the command to build the docker image. Why?
![ima…
-
### Bug description
For some reason, the tensor parallel implementation generates non-sensical outputs
```
⚡ python-api-tensor-parallel ~/litgpt litgpt generate_tp checkpoints/microsoft/phi-2
…
rasbt updated
1 month ago
-
### Description
After upgrading from KM 0.61 and LLamaSharp 0.13 to the latest versions, the processing ImportDocumentAsync/AskAsync speed has significantly decreased, almost 2 times.
All settings a…
-
### What is the issue?
error when trying to compile for windows on MSYS2
```console
cd /c/
cd my_cpp_projects/
git clone -b minicpm-v2.5 https://github.com/OpenBMB/ollama.git
cd ollama/llm…
-
Hello, I'm not sure if multi GPU is supported yet. I didn't find parameters for tensor parallel, and the "num_device_layers" parameter seems not work. Please let me know if it supports or has plans to…
-
Hi,
I fine-tuned the LLaMA-3-8b-Instruct on "llama3-ultrafeedback-armorm" in different gradient accumulation (other hyperparameters are the same with llama-3-8b-instruct-simpo-v2.yaml). For fine-t…