search

SakanaAI / evolutionary-model-merge

Official repository of Evolutionary Optimization of Model Merging Recipes
Apache License 2.0
1.23k stars 90 forks source link

How to use your EvoVLM in transformer? KeyError: 'input_ids' #9

Closed yiyiwwang closed 5 months ago

yiyiwwang commented 5 months ago

Dear authors,

I test your EvoVML in transformer in the following way:

# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("image-to-text", model="SakanaAI/EvoVLM-JP-v1-7B")
pipe("xxx.jpg")

, but I got the problem: KeyError: 'input_ids'.

Could you please tell me how to solve it? Thank you very much.

yiyiwwang commented 5 months ago

I find the usage in https://huggingface.co/SakanaAI/EvoVLM-JP-v1-7B.