-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
设置1小时采集一次
容器日志:
ml is more like an article list page, find 33 urls with the same netloc
2024-10-09 01:09:28 2024-10-09 01:09:28.634 | INFO | insights:pipeline:39 - get new url list, add to work…
-
### Bug Description
HuggingFaceEmbedding 依赖于llama-index-core-0.10.68.post1。OpenLLM 依赖于llama-index-core-0.11.9。
运行OpenLLm成功,则HuggingFaceEmbedding报错:
ile [~/anaconda3/envs/llama_factory/lib/python3.1…
-
### Checklist
- [ ] 1. I have searched related issues but cannot get the expected help.
- [ ] 2. The bug has not been fixed in the latest version.
### Describe the bug
lmdeploy chat /root/share/new…
-
I have a few problem.
1. when requesting to create asimple web app it writes down the code in the chat but not making the main files as it should do.
2. it doesnt save chat history
![Pro…
-
- [ ] [MoA/README.md at main · togethercomputer/MoA](https://github.com/togethercomputer/MoA/blob/main/README.md?plain=1)
# Mixture-of-Agents (MoA)
[![License](https://img.shields.io/badge/License-A…
-
![Uploading issue1.jpg…]()
-
**Describe the bug**
A clear and concise description of what the bug is.
run start cmd :
```
CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 python -m mii.entrypoints.openai_api_server \
--mode="./v…
-
### Your current environment
(venv-vllm-54) (base) root@I1ba088648b009018e4:/hy-tmp# nvidia-smi
Tue Aug 6 10:29:16 2024
+--------------------------------------------------------------------…
-
### What happened?
When using vision language model, I noticed different providers (inference engine) can have un-matched prompt token counts in the usage in streaming v.s. non-streaming request. I'm…