-
**LocalAI version:**
V1.21
root@63429046747f:/build# ./local-ai --version LocalAI version 4548473 (4548473acf4f57ff149492272cc1fdba3521f83a) llmai-api-1 | 3:04AM DBG Loading model '
**Environment, C…
-
**LocalAI version:**
`quay.io/go-skynet/local-ai:master-cublas-cuda12-core`
**Environment, CPU architecture, OS, and Version:**
`Linux user-Z68X-UD3P-B3 6.2.0-39-generic #40~22.04.1-Ubunt…
-
For characters with both rapid jabs and gentlemen's jabs (such as captain falcon), it would be nice to have a toggle menu option to select which one is performed.
Special cases to consider:
* If …
-
My VRAM continues to fill up over the course of inference (using the server) until OOMing.
I'm not sure what else to say. Just do `watch nvidia-smi` and watch it fail to free old memory.
I'm not…
-
Guardrails seemingly supports other LLM providers over manifest, and even with custom LLM APIs. However, I haven't been able to use guardrails with a single open-source LLM in practice. I have tried t…
-
我使用了本地编译、直接下载你们最新的可执行文件,但是运行之后出现了以下错误(如图所示),之后使用了poweroff命令关闭软路由系统,准备再次进入软路由系统时,却无法进入(无法正常开机)。
```
root@iStoreOS:~# chmod a+x OpenGFW
root@iStoreOS:~# ls
OpenGFW config.yaml geosite.dat r…
BQvQB updated
6 months ago
-
https://github.com/alingse/go-linter-runner/blob/main/jobs/testifylint.yaml
```
name: testifylint
linter: testifylint
workdir: .
install: go install github.com/Antonboom/testifylint@latest
inc…
-
### System Info
AWS Sagemaker v.2.163.0
Target Sagemaker endpoint compute configuration settings
- instance_type = ml.g5.12xlarge
- number_of_gpu = 4
Full AWS Sagemaker notebook setup co…
-
I tried two different benchmarks.
1. examples/t5 vs examples/quantized-t5 for flan-t5-xxl. Both of them run at the same speed.
2. [mistral](https://huggingface.co/TheBloke/Mistralic-7B-1-GGUF) wit…
-