search

Dene33 / world-gpt

Other
52 stars 5 forks source link

Local LLM model #22

Open m1nuzz opened 7 months ago

m1nuzz commented 7 months ago

Is it possible to use a custom link for endpoints like koboldcpp or LM Studio so that a local LLM model can be utilized? Will you add such a capability?

Dene33 commented 6 months ago

It is possible. There is a foundation for that but some code adjustments are needed to make it work. Pull requests are welcome :)