search

openvinotoolkit / openvino_contrib

Repository for OpenVINO's extra modules
Apache License 2.0
105 stars 144 forks source link

LLAMA_CPP notebook with Qwen-1.5-7B-Chat #901

Closed vshampor closed 6 months ago

vshampor commented 7 months ago

Adds a notebook that demonstrates the usage of the LLAMA_CPP plugin to run LLM inference with the Qwen-1.5-7B-Chat model.

vshampor commented 7 months ago

@MaximProshin @AlexKoff88

AlexKoff88 commented 6 months ago

LGTM, thanks.