search

huggingface / blog

Public repo for HF blog posts
https://hf.co/blog
2.18k stars 666 forks source link

Optimisation 3: Torch Compile in audioldm2.md does not appear in the Colab notebook mentioned in the beginning of the blog #1576

Open tiansiyuan opened 9 months ago

tiansiyuan commented 9 months ago

And there is some error when I run this optimisation following the steps in the blog

Thanks

sanchit-gandhi commented 3 months ago

Hey @tiansiyuan, sorry for the late reply here. At the time of writing, Google Colab free tier came with a version of torch that didn't provide compile support for T4. Hence, it was omitted from the Colab. Since then, Colab has been updated to use a newer version of torch, which should have support. You can simply copy and paste the code from the blog post into the Colab to run the compiled version of the code. If this fails, please could you provide the following:

  1. The output of transformers-cli env
  2. A copy and paste of the code you're using
  3. The full stack trace of the error

Thanks!