search

crewAIInc / crewAI

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
https://crewai.com
MIT License
21.07k stars 2.93k forks source link

[FEATURE] I'd like to use together.ai for llama hosted LLMs #1408

Open ShadiCopty opened 1 month ago

ShadiCopty commented 1 month ago

Feature Area

Core functionality

Is your feature request related to a an existing bug? Please link it here.

NA

Describe the solution you'd like

Ideally I want to be able to define the model provider in my .env file (LLM_MODEL_PROVIDER=Together.ai), and then TOGETHER_AI_API_KEY to define the api key. The rest being the same as is today and instead of openAI as provider Together.ai would be used. This could also be expanded to simplify using things like bedrock / anthropic / ..

Describe alternatives you've considered

No response

Additional context

No response

Willingness to Contribute

Yes, I'd be happy to submit a pull request

github-actions[bot] commented 5 days ago

This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.