search

CERC-AAI / Robin

Apache License 2.0
62 stars 8 forks source link

multiple images per prompt #5

Open LuketheDukeBates opened 8 months ago

LuketheDukeBates commented 8 months ago

Hello there!

Is it possible to prompt with multiple images? If so, it's not obvious to me how this can be done without altering your code. For example

from robin.serve.pipeline import LlavaMistralPipeline

pipe = LlavaMistralPipeline( model_path="agi-collective/mistral-7b-oh-siglip-so400m-finetune-lora", model_base="teknium/OpenHermes-2.5-Mistral-7B", )

messages = [ {"role": "USER", "content": "compare and contrast these images", "image": ['path/to/img/1.jpg', 'path/to/img/2.jpg']}, ] messages = pipe(messages)

I can make a PR if this has not been implemented yet :)

Thank you!

daniel-z-kaplan commented 8 months ago

Hello!

We do not support multiple images this exact second, but would love to in the future. If you'd like to create a PR for this, we would welcome it!