Closed xxm1668 closed 7 months ago
I want start this demo
This endpoint isn't supported, see https://github.com/vllm-project/vllm/blob/main/vllm/entrypoints/openai/api_server.py for the available endpoints
Please checkout other projects like MemGPT where the assistants API is fully implemented.
Has this been updated?
Hi @xxm1668 which tools are you using? vLLM currently do not support OpenAI assistant or threads API, which does require higher level orchestration. I would to learn more about your feature request.