-
Why is Qwen's API not supported yet?
-
### 🥰 需求描述
对于一些渠道的API,可能会有默认选项之外的API请求的参数需求,例如当我使用Ollama API时,需要添加num_ctx参数来设置模型的上下文窗口,否则模型默认只有2k或1k tokens。
### 🧐 解决方案
添加一个textarea 让用户可以输入自定义的额外的请求参数,例如
```
num_ctx: 32768,
num_predict: …
-
### Bug Description
Integrated with langchain, Qwen-7B-Chat model is deployed under FastChat and vLLM, which OpenAI API is employed. When the number of input tokens is more than 2048, it raise
```…
Hspix updated
7 months ago
-
### Initial Checks
- [ ] I have searched GitHub for a duplicate issue and I'm sure this is something new
- [ ] I have read and followed [the docs & demos](https://github.com/modelscope/modelscope-age…
-
-
![image](https://github.com/lm-sys/FastChat/assets/40717349/e56498e8-8fb0-49f7-ac14-0b6bc4842c05)
![image](https://github.com/lm-sys/FastChat/assets/40717349/c51c328e-a7a8-471d-b821-65d0992cbc7c)
-
Hi, I'm developing langchain and I've found that the latest version of doctran has compatibility issues with pydantic. ipynb keeps prompting ModuleNotFoundError.
No module named 'pydantic._internal._…
-
### System Info
2* A100
tensorrtllm 0.8.0
### Who can help?
@byshiue @ncomly-nvidia @jun
### Information
- [X] The official example scripts
- [ ] My own modified scripts
### Tasks
…
-
### Describe the bug
![image](https://github.com/oobabooga/text-generation-webui/assets/96732179/3b7f46e8-d59b-4d56-bfb3-95c7ecd73887)
![image](https://github.com/oobabooga/text-generation-webui/ass…
-
### 起始日期 | Start Date
_No response_
### 实现PR | Implementation PR
_No response_
### 相关Issues | Reference Issues
_No response_
### 摘要 | Summary
请问如何支持 Qwen/Qwen-VL-Chat
### 基本示例 | Basic Example
…