-
### Your current environment
```text
PyTorch version: N/A
Is debug build: N/A
CUDA used to build PyTorch: N/A
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.4 LTS (x86_64)
GCC version: (Ubu…
-
Hi 2 quick questions,
1. From the paper algorithm1, I get a sense that the algorithm can work in an online divide-n-conquer manner with updated model and I am just curious when the self-feedback co…
-
### Describe the bug
A800 80G
内存32G
已经部署了一个Qwen-57B-q5的模型用了40G显存,再部署deepseek-coder-6.7b-instruct 就报资源不足
![deeseek38](https://github.com/xorbitsai/inference/assets/36878412/6fa0e127-94ea-4a2d-b7…
xxch updated
2 months ago
-
After updating to latest main from March 24 version of main, I can no longer run 72b without some kind of OOM.
```
pip uninstall sglang
git pull
cd python
pip install -e ".[all]"
```
then
``…
-
Hello, I’m the author of TextHawk. I have noticed that TokenPacker shares the same starting points as TextHawk, including token compression and multi-level features. It's great to see more people gett…
-
### System Info
- transformers 4.45.0.dev0 (up-to-date with github repo)
### Who can help?
@zucchini-nlp @amyeroberts
### Reproduction
If we save an instance of LlavaOnevisionProcessor…
-
Which Llava models are supported? The mlx-examples repo supports only v1.5. Does this one support v1.6? Does it generate keywords for an image , for example?
-
### 软件环境
```Markdown
- paddlepaddle-gpu: 3.0.0.dev20240728
- paddlenlp: 3.0.0b0.post0
```
### 重复问题
- [X] I have searched the existing issues
### 错误描述
```Markdown
运行示例代码开启block_attn时,动态图报错如下:
T…
-
Hi!
FIrst of all, congrats and thanks for opensourcing Colpali.
I see everywhere in the colpali model cards that it has been trained only in english and only on single page A4-sized PDF document…
-
Hello, I would like to ask you if you ever thought to add Computer Vision with object detection and clasification to micropython. That would be great feature for many other project I think. But I am n…