OV configurations alignment

huggingface / optimum-intel

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

https://huggingface.co/docs/optimum/main/en/intel/index

Apache License 2.0

386 stars 109 forks source link

OV configurations alignment #787

Closed KodiaqQ closed 3 months ago

KodiaqQ commented 3 months ago

Updated OV configurations to align with openvino.genai nncf_utils.py.

KodiaqQ commented 3 months ago

cc @AlexKoff88, @MaximProshin

HuggingFaceDocBuilderDev commented 3 months ago

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

MaximProshin commented 3 months ago

@KodiaqQ , I still see some misalignment with genai. In genai we have 28 models, but only 26 here. Can you explain it?

KodiaqQ commented 3 months ago

@KodiaqQ , I still see some misalignment with genai. In genai we have 28 models, but only 26 here. Can you explain it?

As was noticed, the stablelm-epoch-3b-preview and llama-7b configurations are not applicable anymore, so I removed them. Maybe @AlexKoff88 can confirm that as we discussed.

MaximProshin commented 3 months ago

@echarlaix , can you please help to merge it?