-
### System Info
Although this method is un-useful, but it's little wrong
![image](https://github.com/user-attachments/assets/5a56c06b-0932-481e-8386-56789151a551)
### Who can help?
_No response_…
-
Problem Description:
I attempted to use the Colpali model for PDF document question answering, aiming to index the PDF file only once when the program starts and then reuse this index for retrieval w…
-
我按照:python3.9 -m vllm.entrypoints.openai.api_server --dtype auto --api-key $api_key --model $model_name_or_path --tensor-parallel-size 8部署qwen2训练的reward模型后,请求接口返回的是回复内容,怎么设置参数才能只获取reward的打分呢?
-
Currently, many things are hacked around, which makes `colpali-engine` frustrating to build on.
The abstractions of the following need to be improved:
- tokenization via AutoProcessor. Queries ca…
-
### The model to consider.
I am interested in deploying the HuatuoGPT-Vision 7B model, as detailed in the repository [HuatuoGPT-Vision](https://github.com/FreedomIntelligence/HuatuoGPT-Vision). Howev…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
![Snipaste_2024-08-30_01-20-17](https://github.com/user-attachments/assets/29edc0c4-ac44-4ccf-b8d3-e82d…
-
The current timeout for InvokeEndpoint is 60 seconds as specified here: https://docs.aws.amazon.com/en_pv/sagemaker/latest/dg/API_runtime_InvokeEndpoint.html
Is there any way we can increase this l…
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: 2.5.1+cu124
Is debug build: False
CUDA used to build PyTorch…
-
当我在`https://huggingface.co/spaces/Qwen/Qwen2-VL`中上传了一张图片:
![Treatise_On_Calligraphy](https://github.com/user-attachments/assets/751fe8de-9d93-41e4-be3f-41447e73d7a4)
并使用prompt`请你帮我OCR出来`
提交后,…
-
In [this colab](https://colab.research.google.com/drive/17XEqL1JcmVWjHkT-WczdYkJlNINacwG7?usp=sharing#scrollTo=2QK51MtdsMLu) you show how to load adapter and merge it with initial model. Notice it loa…