-
mlc_chat convert_weight --model-type ${MODEL_TYPE} ./dist/models/${MODEL_NAME}/ --quantization $QUANTIZATION -o dist/$MODEL_NAME/
[2024-02-15 11:19:53] INFO auto_config.py:115: Found model configur…
-
Where can I download the model file manually? Because automatic downloads always time out. Thank you!
```log
(MiniCPMV) PS C:\work\github\MiniCPM-V> python web_demo_2.5.py --device cuda
C:\Users\Ad…
-
如题,想在边缘设备上使用,算力不高1.5 TOPS
-
迁移第一张的时候可以出图,再执行的时候就报错了!
![微信截图_20241124155520](https://github.com/user-attachments/assets/ca8da032-ceef-41c3-972d-ec0168d1fec2)
![微信截图_20241124155503](https://github.com/user-attachments/assets/aa4…
-
-
### What happened?
Failed to load a 4-bit model with
```
python3 ./examples/minicpmv/minicpmv-convert-image-encoder-to-gguf.py --model ../Vision-8B-MiniCPM-2_5-Uncensored-and-Detailed-4bit/ --minic…
-
如题
-
本地运行int4版本时候出现报错:
(MiniCPMV) yushen@user-MS-7E06:~/ai/MiniCPM-V$ python web_demo_2.5_gy.py --device cuda
Unused kwargs: ['_load_in_4bit', '_load_in_8bit', 'quant_method']. These kwargs are not use…
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
### Is there an existing issue ? / 是否已有相关的 issue ?
- [X] I have searched, and there is no existing issue. / 我已经搜索过了,没有相关的 issue。
### Describe the bug / 描述这个 bug
当我运行
```bash
mlc_chat gen_config -…