plenoptic-org / plenoptic

Visualize/test models for visual representation by synthesizing images.
https://plenoptic.readthedocs.io/en/latest/
MIT License
57 stars 9 forks source link

Add style transfer example? #179

Open billbrod opened 1 year ago

billbrod commented 1 year ago

Would be nice to have an example showing how to use Metamer for style transfer, using some standard deep nets. Would also serve as an example of an extension of Metamer for other purposes.

@jenellefeather pointed out that it's not straightforward to grab the activation of intermediate layers from the standard deep nets in the pytorch model zoo. can see how she did it in her project. Might be worth giving discussion of how to do that a separate tutorial.

billbrod commented 1 year ago

Could also see this as another possibility

billbrod commented 1 year ago

Another possibility: get style from Portilla-Simoncelli texture stats, content from deep net. Or content could just be some simple convolutional filters?

billbrod commented 1 year ago

Use torchlens for this?

billbrod commented 1 month ago

I think the torchvision create_feature_extraction is the way to do this: https://pytorch.org/vision/stable/feature_extraction.html