search

OpenBMB / MiniCPM-V

MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone
Apache License 2.0
12.49k stars 878 forks source link

How to use the forward call? #586

Closed wj210 closed 4 weeks ago

wj210 commented 1 month ago

How can we use the forward call of the openbmb/MiniCPM-V-2_6 model?

It requires position_ids, may i know how can i derive this? The processor does not produce the position_ids.

LDLINGLINGLING commented 1 month ago

Hello, you may need to use the dataset method in our github to process the data, and then pass it to the model. This way you can use the model.forward method more conveniently.