search

valentinfrlch / ha-llmvision

Let Home Assistant see!
Apache License 2.0
187 stars 10 forks source link

Allow attachment of static images to any video based request #77

Open helicalchris opened 2 weeks ago

helicalchris commented 2 weeks ago

Is your feature request related to a problem? Please describe. No

Describe the solution you'd like I would be able to attach static images to any video based request

Describe alternatives you've considered N/A

Additional context The use case is based on one I saw done by others where they sum it images of key people with names on the image then get the AI engine to say by name if any of them are recognised in reviewed footage. I just remembered I mentioned this on the forums but forgot to raise the feature request

valentinfrlch commented 2 weeks ago

I will add a reference_image field which will also be a local file path to that image. The filename will be added to the request for context. It will be added to both video and stream analyzer.

Good idea!

helicalchris commented 2 weeks ago

Can you make it so multiple images can be attached not one. I don't know how well engines will understand multiple images in one file so independent images will probably work better (eg for use case, one image per family member)

valentinfrlch commented 2 weeks ago

Yes of course! I will basically copy the existing logic for image_paths which also allows multiple images.