-
I tried #26 and gguf model type didn't get picked up by llm until I registered a model with "llm llama-cpp add-model". I'm not sure if this is working as intended - I expected that gguf would appear …
-
-
C:\Users\PC\miniconda3\Lib\site-packages\mmengine\optim\optimizer\zero_optimizer.py:11: DeprecationWarning: `TorchScript` support for functional optimizers is deprecated and will be removed in a futur…
-
I'm using a server with Ubuntu 20.04.6 LTS with a V100 GPU. I'm not admin, and I can't install cudatoolkit at system level. I installed pytorch (with conda), which uses its own cudatoolkit. I have no…
-
The `h2ogpt` linux installation method as [given here](https://github.com/h2oai/h2ogpt?tab=readme-ov-file#get-started) is as follows:
### A. Variable export instructions:
`export PIP_EXTRA_INDEX_…
-
Hi:
I am a newbie and curious about how these configs come out.
![image](https://github.com/ollama/ollama/assets/2839943/699df0ca-4d48-48e8-9fcb-ff081fb1ed12)
Someone can tell me how to chane…
-
When trying to use chat feature got this error:
Error invoking remote method 'create-session': Error: fatal: could not create leading directories of 'C:\Program Files\Reor\resources\app.asar\node_mod…
-
This epic is a major tracker for all the backends additions that should be part of LocalAI v2 and ongoing efforts.
The objective is to release a v2 which deprecates old models which are now superse…
-
### Description
Hi, I am using the latest version of LLamaSharp and my model is Llama-3 70b gguf version, when the number of GpuLayerCount is 0 to 5, although it is not very fast, I get the answer, b…
-
### Prerequisites
- [X] I am running the latest code. Mention the version if possible as well.
- [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md)…