search

openvinotoolkit / model_server

A scalable inference server for models optimized with OpenVINOâ„¢
https://docs.openvino.ai/2024/ovms_what_is_openvino_model_server.html
Apache License 2.0
658 stars 208 forks source link

Update genAI dependency #2689

Closed dtrawins closed 2 weeks ago

dtrawins commented 2 weeks ago

🛠 Summary

CVS-148119 Fixes sporadic block_size assertion error in text generation

🧪 Checklist