SUGGESTION: Use AI to produce descriptions of image

roflcoopter / viseron

Self-hosted, local only NVR and AI Computer Vision software. With features such as object detection, motion detection, face recognition and more, it gives you the power to keep an eye on your home, office or any other place you want to monitor.

MIT License

1.77k stars 179 forks source link

SUGGESTION: Use AI to produce descriptions of image #821

Open ulanking opened 4 weeks ago

ulanking commented 4 weeks ago

There's a cool project that uses AI to generate image descriptions that I thought would be cool as an option here.

here is the URL for the information regarding how to set it up in HA. https://community.home-assistant.io/t/guide-for-cctv-snapshot-on-motion-send-to-google-generative-ai-get-notification-with-description-snapshot/706358

roflcoopter commented 3 weeks ago

Cool project! But where would you expect the descriptions to end up?

ulanking commented 2 weeks ago

Cool project! But where would you expect the descriptions to end up?

As a part of the metadata associated with the detected object. Currently binary_sensor.CAMERA_object_detected_OBJECT has device_class, count and friendly_name. Could add "AI_description"