-
## 🐛 Bug
Hello team,
Thanks for creating such an amazing engine. I ran Llama-3-8B-Instruct-q4f16_1-MLC in server mode with different batch sizes (2-128) but I still see my requests are being run …
-
### Organization Name
SWIRL Corporation
### Main office location
235 Bear Hill Rd, Suite 201, Waltham MA 02451
### What regions of the world do you serve?
Global, North America
### Business desc…
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch…
-
I can only see how to test an existing LLM directly - eg openAI etc.
what if i want to test the results of my own app, which includes RAG etc features.
is there a way to connect to an API endpoint…
-
Artificial Intelligence (AI) is no longer a futuristic concept; it is already shaping the way industries operate today. From healthcare and finance to education and entertainment, AI is revolutionizin…
-
On AI/ML projects page (or elsewhere), can add:
* Talk slides and recordings
* venomx - https://github.com/cmungall/venomx
* robot assistant
* OAK and LinkML features/applications involving LLMs…
-
hi. adding support for cloud LLMs via API (chatGPT, Claude, Gemini, Grok) would be easy?
PS: thanks for the cool extension!
-
Hi, I run the code locally not docker. And I have been stuck with the qt package for a long time. The error message says: qt.qpa.xcb: could not connect to display :0
qt.qpa.plugin: Could not load the…
-
### Search before asking
- [X] I had searched in the [issues](https://github.com/eosphoros-ai/DB-GPT/issues?q=is%3Aissue) and found no similar issues.
### Operating system information
MacOS…
-
### Describe the bug
The docs suggest creating a `yaml` file for profile but it not longer works: https://docs.openinterpreter.com/settings/profiles
### Reproduce
1. Create a `yaml` file in the fol…