search

openvinotoolkit / openvino.genai

Run Generative AI models using native OpenVINO C++ API
Apache License 2.0
69 stars 106 forks source link

device config and external tok/detok for genai llm bench #515

Closed eaidova closed 2 weeks ago