huggingface / optimum-amd

AMD related optimizations for transformer models
https://huggingface.co/docs/optimum/amd/index
MIT License
46 stars 17 forks source link

[ZenTorch] Testing and CI #109

Closed IlyasMoutawwakil closed 5 months ago

IlyasMoutawwakil commented 6 months ago

This PR adds tests and CI for the custom torch.compile backend zentorch. Tests are using tiny models and are mostly checking computational sanity between inductor and zentorch backends. The workflow is using the amdrun cli command which was modified to set optimal zentorch env vars as well as rocm.

IlyasMoutawwakil commented 5 months ago

I will add some details to the readme/docs and a dockerfile once zendnn plugin is installable.

IlyasMoutawwakil commented 5 months ago

diffusers tests are passing again (it was a seed issue).

IlyasMoutawwakil commented 5 months ago

Thanks for the reviews !