Closed eliranwong closed 5 months ago
Done in recent updates
add support of custom LLM path to be used with llama.cpp
add support use of Ollama hosted models with llama.cpp: It appears that models are easily to be selected and downloaded with Ollama, but inference is faster with llama.cpp. We will add UI to download LLMs via Ollama and used them with llama.cpp
add TUI dialogs to change llm backends and models
add tool selection threshold to allow users to select tool from closest matches tools
integrate llama.cpp with AutoGen features
add support of code auto-heal features like we implemented in LetMeDoIt AI
more to come
done. * ui to change tool dependence
add documentation
add support of custom LLM path to be used with llama.cpp
add support use of Ollama hosted models with llama.cpp: It appears that models are easily to be selected and downloaded with Ollama, but inference is faster with llama.cpp. We will add UI to download LLMs via Ollama and used them with llama.cpp
add TUI dialogs to change llm backends and models
ui to change tool dependence
add tool selection threshold to allow users to select tool from closest matches tools
improve tool selection based on users interactions
test and fine-tune all plugins with all supported backends ... in progress ...
add more tools to further expand FreeGenius capabilities
integrate llama.cpp and GeminiPro with AutoGen features
add support of code auto-heal features like we implemented in LetMeDoIt AI
add qt-based GUI
more to come