[FEATURE] Add support for local & other LLMs

ozdemir08 / youtube-video-summarizer

MIT License

25 stars 4 forks source link

[FEATURE] Add support for local & other LLMs #3

Open LBF38 opened 5 months ago

LBF38 commented 5 months ago

This is a great idea for getting the core of a YT video inside our vaults.

It would be great if we could change the LLM for another one or for local ones.

Thanks for considering this feature !

ozdemir08 commented 5 months ago

Thanks for the kind words @LBF38.

I will explore using Google's Gemini, which should be easy.

I am not sure about the local LLMs yet, mainly because I don't have much knowledge about them. If you have any links/pointers to a useful resource, I would be happy to read and may prioritize supporting local LLMs.

LBF38 commented 5 months ago

Thanks for considering it !

I haven't browsed your implementation, but I think that you could create an abstraction of the LLM by adding an adapter that allows to be changed for different LLMs.

For local LLMs, you can start by looking at https://github.com/ollama/ollama

rshmhrj commented 3 months ago

Started work on this in PR #12 -- feel free to take a look @ozdemir08 & @LBF38

Most of the settings scaffolding is in place, just need to iron out the request portion

I have been referencing this from obsidian.d.ts to try to make the request from our OllamaClient.ts: