-
### System Info
- `transformers` version: 4.38.2
- Platform: Linux-6.1.58+-x86_64-with-glibc2.35
- Python version: 3.10.12
- Huggingface_hub version: 0.20.3
- Safetensors version: 0.4.2
- Accele…
-
python 3.10
cuda 12.1
I just pip install bitblas and run :` python -c "import bitblas; print(bitblas.__version__)" `, and it gives me:
`0.0.1.dev13`
and I run this basic code:
```
import…
-
Les variantes qui me semblent plus simplement mériter d'être intégrées comme corrections de V3, clairement fautif :
(Cela rejoint en fait le plus souvent nos "sic" dans la transcription, tant et si …
-
### 🐛 Describe the bug
see: https://github.com/pytorch/ao/pull/300
### Versions
pytorch nightly
cc @ezyang @bdhirsh @anijain2305 @chauhang @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen…
-
* docker image`vllm/vllm-openai:v0.2.7`, startup command:
```
docker run -it -d -p 5003:8000 \
--name vllm-api \
-v $(pwd)/huggingface:/root/.cache/huggingface \
-v $(pwd)/Qwen-14B-Chat-Int4:/wor…
-
I am trying to run action recognition in real time using webcam/external camera but I'm getting this error.
Code:
```
from ppvideo import PaddleVideo
import cv2
import numpy as np
clas =…
-
### 提交前必须检查以下项目
- [X] 请确保使用的是仓库最新代码(git pull)
- [X] 已阅读[项目文档](https://github.com/ymcui/Chinese-LLaMA-Alpaca-3/wiki)和[FAQ章节](https://github.com/ymcui/Chinese-LLaMA-Alpaca-3/wiki/常见问题)并且已在Issue中对问题进…
-
**Describe the bug**
微调好了qwen1.5-7b-chat-awq模型,合并权重时报错
```
PS D:\github\swift> $env:CUDA_VISIBLE_DEVICES="0"
>> swift export `
>> --ckpt_dir "D:\github\swift\output\qwen1half-7b-chat-awq\v6-2…
-
### Checklist
- [x] 1. I have searched related issues but cannot get the expected help.
- [x] 2. The bug has not been fixed in the latest version.
### Describe the bug
我想用lmdeploy推理qwen1.5-32-awq,但…
-
Quantizing the K cache (-ctk) works, however quantizing the V cache (-ctv) does not, I've tried with q4_0, q4_1, q8 etc...
Using the cublas- cu12.2.0 release build I get the following error:
lla…
CISC updated
2 months ago