search

nchudleigh / vimac

Productive macOS keyboard-driven navigation
https://vimacapp.com
GNU General Public License v3.0
3.41k stars 124 forks source link

Crazy idea: Core ML Vimac #442

Open blackketter opened 3 years ago

blackketter commented 3 years ago

MacOS has some pretty powerful machine learning capabilities.

What if Vimac used Core ML vision to learn what are clickable items on the screen and created hints for them. This would work with any app that could be trained on.

Might even be faster than iterating through the accessibility apis. :)

eret9616 commented 3 years ago

I'm using a completion tool named TabNine, those AI-based app really cool

eret9616 commented 3 years ago

I'm using a completion tool named TabNine, those AI-based app really cool