-
Im having an issue with langchain receiving more than one request at once (send one request, send another before getting a response). My setup:
Im using VLLM as inference engine with ray (head on…
-
I'm opening this issue as an easy way to interested parties to track development progress of the next major APScheduler release (v4.0).
## Terminology changes in v4.0
The old term of "Job", as i…
-
안녕하세요, 팀 한울의 Jun(@json9101)입니다.
# 🧑🏭 개요
dockfkerfile에 맞는 docker-compose.yml 작성한 내용 공유해드립니다.
-
I have previously used APScheduler in Flask for some things I need to do in background.
The problem with flask is if you load it in gunicorn, or debug mode and have multiple threads, the tasks will…
-
### Your current environment
vllm container v0.6.2 (vllm/vllm-openai:v0.6.2)
Models: LLama-3-70b-Instruct, LLama-3-8b-Instruct, Qwen-2.5-32b-Instruct
GPUs: A100, A30
### Model Input Dumps
_No …
-
The model address is::https://huggingface.co/Qwen/CodeQwen1.5-7B
The deployment method is:vllm
Request example is:
```
curl -X POST "http://127.0.0.1:9188/v1/completions" \
-H "Content-Type: …
-
All libraries are installed. following the instructions here : https://huggingface.co/h94/IP-Adapter-FaceID
the error is
```
Traceback (most recent call last):
File "G:\IP-Adapter-FaceID\v…
-
### Description of the bug | 错误描述
处理表格报错,参考issue#659处理问题仍然无法成功
2024-10-10 06:01:02.508 | INFO | magic_pdf.libs.pdf_check:detect_invalid_chars:57 - cid_count: 0, text_len: 1303, cid_chars_radio: …
-
Support needs to be added for bhyvectl --suspend and bhyve -r
-
**Describe the issue**:
FastAPI is known to can't be pickled by default pickle and dill.
Click [here](https://github.com/encode/starlette/discussions/2308) for the details.
However, Ray pickle…