-
- Start LLM
- Close laptop
- Sleep 8 hours
- Open laptop
- Issue command to LLM
-
### What happened?
command of compilation:
` cmake .. -DGGML_VULKAN=ON -DCMAKE_BUILD_TYPE=Release`
command of running:
`./bin/llama-cli -m ggml-model-q4_k.gguf -c 512 -b 1024 -n 256 --keep 48 -…
-
This is not a feature/bug, just a question, since there is no discussion board I'll leave it here.
I have multiple hugging face models hosted and running OpenAI compatible endpoints.
After hookin…
-
### Feature Description
I just deployed my first Azure ML Studio Serverless endpoint and I had to realise, that there is no matching LLM type in llama_index. Am I missing something? Or does llama_ind…
-
I am trying to use Crew ai tools such as CSVSearchTool, TXTSearchTool, RagTool using mistral 7b. But when i try to upload the data using the tools, the data is not read by the tools. It gives me some …
-
# 平台(如果交叉编译请再附上交叉编译目标平台): orin-CPU
# Platform(Include target platform as well if cross-compiling): orin-cpu(支持sdot指令)
# 复现概率:较高
# Github Version: MNN tag 2.9.1
# 编译方式:
# Compiling Method
…
-
I created ebot, a Discord bot backed by open-source LLMs.
It is already deployed on our Discord Server. Join https://discord.com/channels/1180387931614085130/1236935814567690250 if you are interes…
-
### System Info
OS version: macOS Sonoma 14.0
python version: 3.11.3
pandasai version: 2.2.10
### 🐛 Describe the bug
I try to create charts using pandas-ai and saving them in a custom locat…
-
### What is the issue?
Error while loading models since version 1.44 models like mixtral, llama3 70b, etc,. I have 72GB Memory with my 3 gpus and can not load this models.
This is the second week …
-
Since security is a priority and data sharing in some cases in not an option. I was thinking about using local hosted open source LLMs.
Is that achievable and which LLMs do you recommend?
wtfc2 updated
1 month ago