search

miurla / babyagi-ui

BabyAGI UI is designed to make it easier to run and develop with babyagi in a web app, like a ChatGPT.
https://babyagi-ui.vercel.app
MIT License
1.31k stars 278 forks source link

Integration of Together.ai with babyagi-ui #186

Open JM2197 opened 1 year ago

JM2197 commented 1 year ago

I propose the integration of Together.ai with babyagi-ui to enhance capabilities and provide more affordable options for utilizing llm. Together.ai offers a variety of base models, including Llama2 (70B), at a significantly lower cost compared to OpenAI, making it a valuable resource for project.

Key Features of Together.ai:

  1. Affordable Access to llm: Together.ai provides access to a variety of base models, including Llama2 (70B), at a significantly lower cost compared to OpenAI. This cost-effective solution can help us to leverage llm more efficiently.

  2. Robust API Support: Together.ai offers robust API support, which can facilitate seamless integration with Babyagi-ui and ensure smooth operation.

  3. Fine-tuning Model Deployment: Together.ai allows for the deployment of fine-tuned models. This feature can be beneficial for project as it can enable us to customize the models according to specific requirements.

Considering the ongoing project of Llama-2 support in Babyagi-ui, integrating Together.ai can be seen as a logical extension of current efforts. This integration can potentially enhance the functionality of Babyagi-ui and provide us with more flexibility in terms of utilizing llm.

link: https://together.ai/

miurla commented 1 year ago

Together.ai looks good.

The call to LLM in BabyAGI-UI is done using LangChain. I checked for support and it seems to be in progress. https://github.com/hwchase17/langchainjs/issues/2284

If it gets merged soon, I'd like to add it to Llama-2 support.

JM2197 commented 1 year ago

That sounds great! I hope it works out.

It would be more efficient if we could use a model like LLaMA-2 Chat (70B) as the main one and selectively utilize the LLaMA-2-32K (7B) model for like web crawling.