search

AI-in-Hand / platform

AI Agent Automation Platform: Rapidly prototype, test, and deploy Multi-Agent Systems from your browser.
https://platform.ainhand.com
GNU Affero General Public License v3.0
16 stars 7 forks source link

Add support for open-source LLMs #85

Open dmitryshurov opened 2 months ago

dmitryshurov commented 2 months ago

Adding LLaMA support would be really great :)

bonk1t commented 2 months ago

Hi @dmitryshurov,

Thank you for your suggestion! We would love to support open-source models like LLaMA. However, we currently rely on the Agency Swarm library, which only supports the OpenAI Assistants API at the moment.

According to their plans, Agency Swarm intends to integrate with Open Assistant API in the future (related issues: #112, #92). As soon as this integration is available, we will be able to add support for open-source models in our project.

We appreciate your interest and will keep you updated on any progress!

Best regards, Nick