"LLM Provider NOT provided" Error for Non-OpenAI Models in Litellm

[dhirenmathur]

Description: CrewAI uses the Litellm library to route LLM requests to the appropriate model. Currently, Litellm throws an error, "LLM Provider NOT provided", whenever a request is made for a non-OpenAI model, preventing proper routing to other providers.

Expected Behavior: Litellm should handle non-OpenAI models without throwing an error, allowing CrewAI to route requests to the correct LLM as specified.

Steps to Reproduce:

• Configure CrewAI to use a non-OpenAI LLM provider through Litellm using the following API:

  curl -X POST "http://localhost:8001/api/v1/set-global-ai-provider/" \
  -H "Authorization: Bearer <API_TOKEN>" \
  -H "Content-Type: application/json" \
  -d '{
  "provider": "anthropic"
  }'

• Set the anthropic API key "ANTHROPIC_API_KEY" in your .env
• Create a conversation:

  curl -X 'POST' \
  'http://localhost:8001/api/v1/conversations/' \
  -H 'accept: application/json' \
  -H 'Content-Type: application/json' \
  -d '{
  "user_id": "your_user_id",
  "title": "Conversation Title",
  "status": "active",
  "project_ids": [
  "project_id"
  ],
  "agent_ids": [
  "codebase_qna_agent"
  ]
  }'

• Send message:

  curl -X 'POST' \
  'http://localhost:8001/api/v1/conversations/1234/message/' \
  -H 'accept: application/json' \
  -H 'Content-Type: application/json' \
  -d '{
  "content": "Your message content here",
  "node_ids": [
  {
    "node_id": "node_identifier",
    "name": "node_name"
  }
  ]
  }'

[palash018]

I will try to reproduce this issue, currently facing some issues regarding running code on wsl.

[palash018]

I'm encountering a connection error after running ./start.sh. It seems that: POSTGRES_SERVER=postgresql://postgres:mysecretpassword@host.docker.internal:5432/momentum is not resolving to the proper IP in WSL. I'm using the non-WSL version of that variable, which resolves the issue, but now I'm getting an incorrect password error.

although when I connect to psql via shell and force it to ask for password even if I type random password, it connects

is this a known issue @dhirenmathur?

[dhirenmathur]

Not a known issue @palash018 , is this a blocker or were you able to proceed with the task?

[palash018]

@dhirenmathur it is actually a blocker since I cannot even run the code itself due to this issue. issue presents itself in ./start.sh itself

[dhirenmathur]

Got it, I'll try to reproduce and get back to you