search

jasonjmcghee / rem

An open source approach to locally record and enable searching everything you view on your Mac.
https://rem.ing
MIT License
2.18k stars 60 forks source link

Skip processing identical screens #50

Closed lotas closed 5 months ago

lotas commented 5 months ago

I noticed that videos and search returns quite a lot of similar images which are not worth recording and OCRing.

Probably the trick here is to detect how much has changed between frames. But this could potentially save lots of processing resources and make disk footprint smaller.

jasonjmcghee commented 5 months ago

Agree on UX front.

We could likely do a diff against the last and if it's within some tolerance, don't OCR.

Curious how much we'd actually save on disk - h264 is damn good at diffing.

lotas commented 5 months ago

I'm not sure about video, but I see that in db there are also multiple similar documents recorded one after another.

There is probably some value to still record time and the fact that contents didn't change, in case there are plans to extract that information into some stats. I mean it would be easy to show how much time was spent per app or so, and for this knowing the app was active is still important. But for storage purposes similar content could be avoided.

just some ideas :) thanks