Open ezraporter opened 3 months ago
Currently the __init__ method for OpenAICompletionFn has **kwargs but OpenAIChatCompletionFn does not. This creates problems if I have both:
__init__
OpenAICompletionFn
**kwargs
OpenAIChatCompletionFn
--completion_args
In these cases I would like to do:
oaieval my_completion_fn,gpt-4-turbo-preview my_eval --completion_args my_param=my_value
But I get:
TypeError: OpenAIChatCompletionFn.__init__() got an unexpected keyword argument 'my_param'
Run oaieval gpt-3.5-turbo test-match --completion_args ignore_me=1
oaieval gpt-3.5-turbo test-match --completion_args ignore_me=1
No response
macOS
Python v3.11.7
openai-evals 2.0.0.post1
Describe the bug
Currently the
__init__
method forOpenAICompletionFn
has**kwargs
butOpenAIChatCompletionFn
does not. This creates problems if I have both:--completion_args
In these cases I would like to do:
But I get:
To Reproduce
Run
oaieval gpt-3.5-turbo test-match --completion_args ignore_me=1
Code snippets
No response
OS
macOS
Python version
Python v3.11.7
Library version
openai-evals 2.0.0.post1