search

nazrinharris / pecunia

Massively ambitious personal finance app.
1 stars 0 forks source link

Evaluate the use of Google's Vertex AI (Gemini) for possible useful usecase #181

Open nazrinharris opened 1 week ago

nazrinharris commented 1 week ago

Kind of want to implement an actually useful feature. As of now, what I want to do is a natural language processing into a transaction, so the user can just use the on-device annotation, speak their mind for the transaction, and the app will process it into an actual transaction

nazrinharris commented 1 week ago
  1. Maybe this should be in Discussions
  2. It doesn't seem like (as of my very short research) that running LLMs on-device is much of a viable option for now.
nazrinharris commented 1 week ago

Or I could employ both. An on-device LLM for trying to get context and understanding (if it's even possible with a small model), and it'll decide if a larger LLM needs to be used, of which it'll connnect to a larger LLM API. Kinda like how Apple is supposedly doing.