search

MertKalkanci / Highlights-Maker

A video highlights creator
GNU General Public License v3.0
4 stars 0 forks source link

Using open source llm #1

Closed Tortoise17 closed 5 months ago

Tortoise17 commented 5 months ago

Is it also possible to use open-source LLM with this workflow?

MertKalkanci commented 5 months ago

Yes you can use your own LLM with modifying ai.py,

In default I've added Llama.cpp and OpenAI GPT support but also you can add your own model via modifying the default functions that are there.

Also I would be pleased if you contribute with the solution you will make. :)

MertKalkanci commented 5 months ago

In the new version I've added fully llama.cpp support, you can use some .gguf formatted AI's via it, for more information on how to use it with llama.cpp please see readme.md and Llama.cpp Github Page

Tortoise17 commented 5 months ago

@MertKalkanci Billions of thank you. This is really a great help.