-
### Your current environment
vllm 0.5.1
2*A100
python -m vllm.entrypoints.openai.api_server --host 0.0.0.0 --port 7861 --max-model-len 9000 --served-model-name chat-v2.0 --model /workspace/sdata/q…
-
### Anything you want to discuss about vllm.
I'm experiencing a segmentation fault while running the vLLM API server with Ray for distributed inference. The issue seems to be related to NCCL initiali…
-
- Add Api endpoint to Vitarum
- Integration with Chatbot
-
### Self Checks
- [X] I have searched for existing issues [search for existing issues](https://github.com/langgenius/dify/issues), including closed ones.
- [X] I confirm that I am using English to su…
-
Yi Coder 1.5b is potentially a great model for fine-tuning on one's own codebase. It'd be great if you could release some SAMPLE portions of the dataset used for base training & instruction tuning (an…
-
톡톡 api를 활용하여 ai 챗봇을 개발중에 있습니다.
현재 해결해야하는 부분이 상담원 연결 부분이었는데, 이는 handover api 문서를 참고하여 passThread 로 잘 처리하였고, standby 를 이용해서 챗봇이 구동 될때, 구동되지 않아야 할때를 구분하였습니다.
한가지 문제점이 남이있는데 알림 부분입니다.
문서에 보면 챗봇이 …
-
## ⚙️ 기능 설명
변환 페이지의 챗봇 컴포넌트를 만듭니다.
## ✅ To-do
### 디자인
- [x] flotting button으로 drawer 레이아웃 토글 애니메이션
- [x] user, chatbot 각각 말풍선 생성
- [x] 답변 대기 중 보내기 버튼 비활성화
- [x] 챗봇 대답 타이핑 효과 [react-typing…
-
I am experiencing an issue when trying to add members to a chat using the imbot.chat.user.add method. Although I have passed all the required parameters correctly, I am receiving the following error:
…
-
I can't seem to get this extension to work with LM Studio. I've successfully used my server with other software, so I know the server works.
I have CORS enabled. I'm serving on the local network. I'v…
-
Hi, I am develop an system with options for chatbot in aspnet core I need know if I can use this library instead of use nodejs whatsapp-web.js lib api calls, for integrate with my app run in linux ub…