search

arcuru / chaz

Chaz is for chats
https://chaz.is
MIT License
35 stars 3 forks source link

[Feature Request]: Remove the dependency on aichat #3

Open arcuru opened 4 months ago

arcuru commented 4 months ago

While relying on Aichat has been good for bootstrapping, going forward it doesn't make much sense to continue relying on it. The 'API' being used (cmd line invocations of aichat) is too limiting and really isn't how it's supposed to be used.

eras commented 4 months ago

Perhaps aichat could be extended (or parts of it extracted) to export its functionality as a library crate? It already supports a wide variety of different LLM interfaces and it seems like a waste to reimplement that separately.

saket424 commented 5 days ago

@arcuru Thanks for this project and leading the way

Have you considered interfacing with an openai API compatible backend such as llama-cpp-python https://github.com/abetlen/llama-cpp-python

It supports multimodal input as well as function calling

There are other backends that are self-hosted openai API compatible . By picking a defacto standard API interface it opens up the possibility of interfacing with other backends in the future

https://github.com/matatonic/openedai-vision https://github.com/matatonic/openedai-speech