anc95
commented
11 months ago llm-client, It's an excellent job! When there is a need for customized LLM, I would be interested in using your SDK for this task. Additionally, could you please provide a Node.js wrapper version as well? It would be more convenient for Nodejs to use
Do you have any plans to add configuration options that would allow the use of custom LLMs in future versions? I recently published a package llm-client that can be very helpful in enabling the support to run other LLM models, including OpenAI, Google, AI21, HuggingfaceHub, Aleph Alpha, Anthropic, Local models with transformers.