search

openvinotoolkit / openvino.genai

Run Generative AI models using native OpenVINO C++ API
Apache License 2.0
69 stars 106 forks source link

[CONTINIOUS BATCHING] WA the x2 memory allocation #556

Closed iefode closed 4 days ago

ilya-lavrenov commented 4 days ago

build_jenkins

ilya-lavrenov commented 4 days ago

build_jenkins