search

jomjol / AI-on-the-edge-device

Easy to use device for connecting "old" measuring units (water, power, gas, ...) to the digital world
https://jomjol.github.io/AI-on-the-edge-device-docs/
5.92k stars 647 forks source link

Moondream.ai as LLM #3241

Open lazmo88 opened 1 month ago

lazmo88 commented 1 month ago

The Feature

Any chance we could consider using alternative LLM instead of Tensorflow? Moondream.ai claims to run "everywhere" so why not ESP32? Moondream removes a lot of complexity and is able to extract data from images without breaking sweat. Just an idea as you already have the hw/sw setup going, it could be easy to implement option for alternative LLM models.

RaHehl commented 1 month ago

https://moondream.ai/docs/faq -> Are there limitations? -> "Because images are sampled down to 378x378, it may not be able to answer questions about very small details in the image. This also limits its ability to perform OCR."

caco3 commented 1 month ago

This would we a huge change of the implementation, so I guess it is unlikely it will ever get done.