SgtBatten / HA_blueprints

Somewhere to store automation blueprints
151 stars 55 forks source link

[Feature Request]: Implement generative ai (gemini) as an option to caption photos from Frigate #214

Open theBasher91 opened 1 month ago

theBasher91 commented 1 month ago

Describe what you are trying to accomplish and why in non technical terms Google generative AI is available with a free tier for usage. Include the option to automatically generate the 'Notification Message' field with AI, as opposed to hardcoded messages

Describe the solution you'd like There is a reddit post where a user was able to grap a snapshot from a camera and then use gemini to caption said photo. However the automations available aren't as in depth as what your frigate notification offers. So my thought is to integrate what they've done into the frigate notification blueprint in order to generate better notification messages

Describe alternatives you've considered Keep frigate notification as-is and include the option to automatically generate the 'Notification Message' field, as opposed to only being given 'short', 'long' and 'default' captions

Additional context N/A