-
When running benchmark_inference_latency for bitnet I got this exception:
```
self.bitblas_matmul = self._get_or_create_bitblas_operator(matmul_config, ENABLE_TUNING)
^^…
-
OS: Debian 9 amd64
```
/build/servo/target/release/deps/libgstreamer_player-47ed31aa97c38542.rlib(gstreamer_player-47ed31aa97c38542.gstreamer_player.1u6u9zpa-cgu.8.rcgu.o):gstreamer_player.1u6u9zp…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### Reproduction
之前提过Issue
https://github.com/hiyouga/LLaMA-Factory/issues/2084
还有测试后的现象
![image](https://github…
-
I was running the following command to start an api server using predownloaded Baichuan model:
python3 -m vllm.entrypoints.openai.api_server --model ./baichuan-inc/Baichuan2-13B-Chat-4bits --trust-re…
-
### System Info / 系統信息
win10
### Who can help? / 谁可以帮助到您?
_No response_
### Information / 问题信息
- [X] The official example scripts / 官方的示例脚本
- [ ] My own modified scripts / 我自己修改的脚本和任务
### Reprod…
-
## 任务背景
此次任务为 [为 Paddle 框架 API 添加类型提示(Type Hints)](https://github.com/PaddlePaddle/community/blob/master/hackathon/hackathon_6th/%E3%80%90Hackathon%206th%E3%80%91FundableProject%E4%BB%BB%E5%8A%A1%E…
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
Hi guys !
**Describe the Bug**
/scrape [this page](https://www.jabra.com/fr-fr/bluetooth-headsets/jabra-elite-4/buy#%23100-99183700-98) with "wait for" (tried from 1ms to 10000ms) returns the content…
-
### System Info / 系統信息
accelerate 0.32.1
aiofiles 23.2.1
annotated-types 0.7.0
anyio …
-
The performance tab says that it runs on almost 1 token per second, mine takes a few minutes only for one word, and it's not consistent. How do I make it faster?