Introduce echo parameter for text generation - Githubissues

openvinotoolkit / model_server

A scalable inference server for models optimized with OpenVINO™

https://docs.openvino.ai/2024/ovms_what_is_openvino_model_server.html

Apache License 2.0

658 stars 208 forks source link

Introduce echo parameter for text generation #2717

Open mzegla opened 1 week ago

mzegla commented 1 week ago

🛠 Summary

JIRA/Issue if applicable. Describe the changes.

🧪 Checklist

[ ] Unit tests added.
[ ] The documentation updated.
[ ] Change follows security best practices. ``