search

turing-machines / mentals-ai

Agents in Markdown syntax (loops, memory and tools included) 🍓
https://x.com/mentals_ai
MIT License
344 stars 32 forks source link

Local AIn endpoint #7

Open clickbrain opened 3 months ago

clickbrain commented 3 months ago

This looks like a really amazing idea. I may have missed it, but looks like it only works with OpenAI. Any chance of using a local endpoint in it from Ollama, etc?

costa-al commented 3 months ago

Thanks for the feedback!

Regarding local models, the minimum requirement is:

  1. llama3 70B

  2. compatible Open AI Chat API

    If you can meet these requirements, Mentals will most likely work