huggingface / optimum-intel

🤗 Optimum Intel: Accelerate inference with Intel optimization tools

https://huggingface.co/docs/optimum/main/en/intel/index

Apache License 2.0

388 stars 110 forks source link

fix olmo accuracy for bf16, add sdpa for persimmon, support jais #726

Closed eaidova closed 4 months ago

eaidova commented 4 months ago

What does this PR do?

fix olmo accuracy for bf16, add sdpa for persimmon, support jais

HuggingFaceDocBuilderDev commented 4 months ago

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

ilya-lavrenov commented 4 months ago

@echarlaix could you please review and merge before next optimum release?

eaidova commented 4 months ago

@echarlaix please take a look