search

lucagrippa / obsidian-ai-tagger

Simplify tagging in Obsidian. Instantly analyze and tag your document with one click for efficient note organization. OpenAI or MistralAI API key required
MIT License
26 stars 4 forks source link

Other LLMS? #3

Open LostFool opened 2 months ago

LostFool commented 2 months ago

Can we use other APIs and LLMs? I'm trying to not get stuck in the OpenAI world.

lucagrippa commented 2 months ago

What other LLM providers were you looking to use? Or do you want to be able to use your own locally hosted model?

LostFool commented 2 months ago

For tagging, ideally local (or remotely hosted). But the anthropic or groq(hardware, not X) is always a consideration.

On Mon, Apr 1, 2024, 12:33 PM Luca Grippa @.***> wrote:

What other LLM providers were you looking to use? Or do you want to be able to use your own locally hosted model?

— Reply to this email directly, view it on GitHub https://github.com/lucagrippa/obsidian-ai-tagger/issues/3#issuecomment-2030215802, or unsubscribe https://github.com/notifications/unsubscribe-auth/AIIPGWOQGCG2IP4BKT4TQ4LY3GK7NAVCNFSM6AAAAABFP6JKEOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMZQGIYTKOBQGI . You are receiving this because you authored the thread.Message ID: @.***>

ShriyanshCode commented 2 months ago

Try out ollama, it runs locally and has a bunch of libraries. Mistral and Meta 7b api via hugging face is pretty decent

LostFool commented 2 months ago

I've got that one on my list. I also like the librechat interface. My real problem is time. 50 hour job and a baby = no time. I just watch all this AI stuff getting anxious wanting to build stuff haha.

On Fri, Apr 5, 2024, 7:41 AM ShriyanshCode @.***> wrote:

Try out ollama, it runs locally and has a bunch of libraries. Mistral and Meta 7b api via hugging face is pretty decent

— Reply to this email directly, view it on GitHub https://github.com/lucagrippa/obsidian-ai-tagger/issues/3#issuecomment-2039707383, or unsubscribe https://github.com/notifications/unsubscribe-auth/AIIPGWILIOYPKBIFJYYBB73Y32LXNAVCNFSM6AAAAABFP6JKEOVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDAMZZG4YDOMZYGM . You are receiving this because you authored the thread.Message ID: @.***>

lucagrippa commented 2 months ago

Going to try to add support for

Would like to look into supporting locally hosted models after that.

Thank you for all the feedback!

lucagrippa commented 1 month ago

The latest release comes with support for MistralAI Small and Large models. Will hopefully be adding support for Groq and Anthropic soon

Dr-DW commented 1 month ago

This plugin would be perfect for locally hosted. I don't feel like tagging is a complex gpt task. Info in --> minimal summary output, a perfect task for it. Therefore, even weak models should do an okay job and can easily be cleaned up after. Elimination of cost and privacy prohibition .

lucagrippa commented 1 month ago

Just added support for GPT-4o