Azure / azure-openai-benchmark

Azure OpenAI benchmarking tool
MIT License
130 stars 54 forks source link

Change prompt to allow for longer generations #11

Closed technicianted closed 10 months ago

technicianted commented 11 months ago

Slightly change the prompt to have the model to do full generation in case of larger requested max_tokens.

@michaeltremeer

michaeltremeer commented 11 months ago

Nice, have tested this across most models and results look good enough in testing (10 requests were made for each combination of model/token config)

image