-
### Feature description
Global cache via monkeypatching, [just like in `requests-cache`](https://requests-cache.readthedocs.io/en/stable/#patching)
```python
import requests
import requests_ca…
-
Hi, when I try to run AI assistance, it promoted API error. But there is no error code so not sure what is the issue. Please help.
-
### Project name
CHEFBOT
### Description
Hi friends,
This project is a simple RAG chatapp aimed to be a cooking assistant specialized in the Brazilian cousine.
I created my own webscraping scri…
-
### Your current environment
vllm docker image: vllm/vllm-openai:latest
### 🐛 Describe the bug
It works for the first time then stops generating responses, as shown below.
ChatCompletion(id='c…
-
I have faced an error with the VLLM framework when I tried to inferencing an Unsloth fine-tuned LLAMA3-8b model...
### Error:
(venv) ubuntu@ip-192-168-68-10:~/ans/vllm-server$ python -O -u -m vl…
-
### Required prerequisites
- [X] I have searched the [Issue Tracker](https://github.com/camel-ai/camel/issues) and [Discussions](https://github.com/camel-ai/camel/discussions) that this hasn't alre…
-
When using vllm + ChatGLM3 and accessing the openai API, it cannot generate content. The reason is that:
1. In `conversation.py`, the ChatGLM3 template has a `stop_token_ids` with ID `2`:
```pytho…
-
### 🚀 The feature, motivation and pitch
Hi, I'm deploying vLLM distributed serving in a Kubernetes environment. To make it work, I installed [KubeRay](https://github.com/ray-project/kuberay) to help …
-
Running end-to-end for 4xA10 machine, on an 8xL4 machine.
`./scripts/basic-workflow-tests.sh -mevFMT`
Current HEAD commit: `426a1941a6fb3edaee3963dcf6c6849bfdaa0165`
Current container: `quay.…
-
ChatGPT example provided by ScriptKit does not work
After installed required npm packages, and entered OpenAI API Key, I can see the chat interface, but after entering my question, nothing return a…