search

keras-team / keras-hub

Pretrained model hub for Keras 3
Apache License 2.0
804 stars 243 forks source link

Add `VAEBackbone` and use it for SD3 #1892

Closed james77777778 closed 1 month ago

james77777778 commented 1 month ago

This PR adds the VAE encoder to SD3 and also fixes the summary of Task to recursively parse the info, rather than relying on the layer attribute.

The preset on kaggle has also been updated.

Demo colab: https://colab.research.google.com/drive/1ucx2lEck1ZO3HVTjZ4qgVsQrBWrHWfVQ?usp=sharing

james77777778 commented 1 month ago

@divyashreepathihalli This PR is ready for review. Please let me know if any further changes are required.

Colab for demo: https://colab.research.google.com/drive/1ucx2lEck1ZO3HVTjZ4qgVsQrBWrHWfVQ

I can add image2image and inpaint after this PR is merged. The finetuning part is much more complicated. I don't think I will be able to complete it before the official release of KerasHub.