from litellm import completion
import os
## set ENV variables
os.environ["OPENAI_API_KEY"] = "your-api-key"
response = completion(
model="gpt-3.5-turbo",
messages=[{ "content": "Hello, how are you?","role": "user"}]
)
the garak constructor demands a provider
if self.provider is None:
> raise ValueError(
"litellm generator needs to have a provider value configured - see docs"
this breaks the garak test, which is failing (available when OPENAI_API_KEY is set)
litellm
can be invoked with or without a providerfrom https://docs.litellm.ai/docs/#litellm-python-sdk (example 1):
the garak constructor demands a provider
this breaks the garak test, which is failing (available when
OPENAI_API_KEY
is set)resolution: the provider constraint should be relaxed, perhaps completely, and exceptions (etc) on model non-existence raised by
litellm
bubbled up