[Openvino code] Fix deepseek coder model run for fill-in-middle mode

openvinotoolkit / openvino_contrib

Repository for OpenVINO's extra modules

Apache License 2.0

103 stars 144 forks source link

[Openvino code] Fix deepseek coder model run for fill-in-middle mode #881

Closed kumarijy closed 6 months ago

kumarijy commented 6 months ago

Below changes done in this Pull request: 1) Changed model location to kumarijy/deepseek-code-1.3b_base_ov_int8 2) Upgraded versions at pyproject.toml 'openvino==2023.3.0', 'optimum==1.17.1', 'optimum-intel[openvino]==1.15.0'