search

yas-sim / openvino-llm-minimal-code

Most simple and minimal code to run an LLM chatbot from HuggingFace hub with OpenVINO
5 stars 0 forks source link

Export problem #1

Closed vivindeena closed 9 months ago

vivindeena commented 9 months ago

Hey,

thanks for this, but on my system when i try to run the model i get this error, do you have any solutions to this.

(venv) PS D:\intel\LLM\openvino-llm-minimal-code> optimum-cli export openvino -m intel/neural-chat-7b-v3 --weight-format int4_sym_g64 neural-chat-7b-v3/INTtoken4
Framework not specified. Using pt to export to ONNX.
yas-sim commented 9 months ago

This message (Framework not specified. Using pt to export to ONNX.) is shown on my system, too, but it's not an error. Is it returned to the command prompt and didn't download anything after the message?

yas-sim commented 9 months ago

Any update? Can I close this issue?

yas-sim commented 9 months ago

I will close this issue. Thanks.