blakeblackshear / frigate

NVR with realtime local object detection for IP cameras
https://frigate.video
MIT License
18.11k stars 1.65k forks source link

Intelligent mask anchoring, invalidation, and adaptation #13314

Open markfrancisonly opened 2 weeks ago

markfrancisonly commented 2 weeks ago

Describe what you are trying to accomplish and why in non technical terms

Security cameras are typically installed to monitor specific areas where the background remains largely static (e.g., driveways, trees, bushes in exterior settings, or furniture, walls, and windows indoors). Any movement within these static scenes is considered an event for analysis and object detection. However, when the camera's field of view changes, the previously configured masks no longer align with the intended areas, leading to false alerts or missed detections. Even minor shifts in the camera's position can invalidate existing motion, zone, and object masks. Changes in perspective may go unnoticed for some time, generating false alerts, and ultimately result in tedious mask reconfiguration.

Proposed Solution: introduce a feature that allows mask lines to intelligently anchor or snap to the contours or features of static elements within the camera's image. Enable the mask to dynamically adjust to the natural boundaries of objects like walls, furniture, trees, driveways, or other fixed structures within the camera's view. The key benefits of this approach include:

Describe the solution you'd like Camera masks that can 'auto-snap' using image outline tracing or other anchoring techniques. Alerts, auto reconfiguration, and/or enhanced mask editor capability.

Other thoughts Intelligent zone masking is not a new concept, self-driving cars algorithms do this type of work in real-time without user configuration.

markfrancisonly commented 2 weeks ago

Intelligent mask anchoring feature request is related to the following enhancement requests: