To evaluate the models, often an echo parameter can be set to true in the request. Then the prompt will be echoed (passes token by token) to the model and the corresponding tokens will be added to the output.
Motivation
This is no longer supported by the OpenAI api but might be a good point to differentiate from them. Is this possible or how much work is involved to get this running?
Your contribution
I could try a PR with some guidance if it is not that hard. I am familiar with python but new to rust
Feature request
To evaluate the models, often an
echoparameter can be set totruein the request. Then the prompt will be echoed (passes token by token) to the model and the corresponding tokens will be added to the output.Motivation
This is no longer supported by the OpenAI api but might be a good point to differentiate from them. Is this possible or how much work is involved to get this running?
Your contribution
I could try a PR with some guidance if it is not that hard. I am familiar with python but new to rust