Open arcuru opened 4 months ago
Perhaps aichat could be extended (or parts of it extracted) to export its functionality as a library crate? It already supports a wide variety of different LLM interfaces and it seems like a waste to reimplement that separately.
@arcuru Thanks for this project and leading the way
Have you considered interfacing with an openai API compatible backend such as llama-cpp-python https://github.com/abetlen/llama-cpp-python
It supports multimodal input as well as function calling
There are other backends that are self-hosted openai API compatible . By picking a defacto standard API interface it opens up the possibility of interfacing with other backends in the future
https://github.com/matatonic/openedai-vision https://github.com/matatonic/openedai-speech
While relying on Aichat has been good for bootstrapping, going forward it doesn't make much sense to continue relying on it. The 'API' being used (cmd line invocations of aichat) is too limiting and really isn't how it's supposed to be used.