reduce memory usage of apple native OCR

mediar-ai / screenpipe

Library to build personalized AI powered by what you've seen, said, or heard. Works with Ollama. Alternative to Rewind.ai. Open. Secure. You own your data. Rust.

https://screenpi.pe

MIT License

1.41k stars 108 forks source link

reduce memory usage of apple native OCR #344

Open louis030195 opened 1 day ago

louis030195 commented 1 day ago

i noticed at 0.5 fps it takes 10 GB

we should aim for < 5gb 1fps

(surprisingly windows native OCR is much more efficient)

linear[bot] commented 1 day ago

MED-108 reduce memory usage of apple native OCR

louis030195 commented 1 day ago

low hanging fruits:

use in memory binary data structures instead of JSON
reduce clones (use pointer, Arc, something else)
other stuff