-
### System Info
-CPU architecture: amd64
-Operating System: Windows 11
-Python version: 3.11.5
-TensorRT-LLM version: 0.10.0
-CUDA version: 12.5
-torch version: 2.2.0+cu121
### Who can help?
_…
-
## Describe the bug
LLM returned the result correctly, but the error is as follows. Is it because the model did not generate output in the correct format?
INFO:httpx:HTTP Request: POST http://lo…
-
### Problem
Jupyter Notebooks (`.ipynb`) are serialized to disk as a JSON object. However, this object is not in a natural language format preferable to an LLM and includes various metadata that …
dlqqq updated
1 month ago
-
## Description:
I'm encountering an error when running the llm chat command on Windows. The error appears to be related to key bindings in the pyreadline3 library, where key descriptions are conve…
-
### Issue summary
no recognizing API key
### Detailed description
I've been trying to put my open AI API key in for a couple of hours now with now luck. I've confirmed secrets.yaml is up to date, a…
-
Most of the major benchmarks would have leaderboard to rank LLMs against one another other, but not this one? Where could I find such a result?
-
### Describe the bug
When starting the project via Docker and having filled in the .env.local file with API keys and URLs of local LLM systems, the environment variables are not being picked up. Th…
-
### System Info
python=3.11.7
### 🐛 Describe the bug
from pandasai.llm.local_llm import LocalLLM
llm = LocalLLM(api_base="http://localhost:11434/v1",
model="llama3")
db = Agent(scm…
-
In this project, I'll build an AI-driven chat application leveraging Google’s Gemini Pro LLM model using Python. The application will allow users to interact with the large language model (LLM) throug…
-
### System Info
CPU: X86
Memory size: 2TB
GPU Name: H20
TensorRT-LLM: 0.10.0
OS：Alibaba Cloud Linux release 3 (Soaring Falcon)
GPU Driver：550.54.15
CUDA：cuda_12.4.r12.4/compiler.33961263_0
Do…