search

MorpheusAIs / moragents

Morpheus Local Agents
MIT License
26 stars 15 forks source link

Replace Functionary and Llama3.1 with Llama3.2 3B #70

Closed LachsBagel closed 1 month ago

LachsBagel commented 1 month ago

Functionary is currently part of the container

Llama 3.1 is on host via Ollama.

Let's replace both with Llama3.2 3B assuming it can handle function calling. Llama3.2 3B should reside on host via Ollama.

This should massively speed up inference.

LachsBagel commented 1 month ago

https://github.com/danXyu is working on this