tensorflow / lucid

A collection of infrastructure and tools for research in neural network interpretability.
Apache License 2.0
4.65k stars 655 forks source link

How to apply to other media? #232

Open Tylersuard opened 4 years ago

Tylersuard commented 4 years ago

Hello. I'm using the xy2rgb notebook. It is creating some of the most beautiful, stunning images I have ever seen. I'm wondering why and how it does this. Can you explain in a semi-layman's terms please? And would I be able to apply that same methodology to other media, like music? Thank you.

colah commented 4 years ago

There's a detailed paper covering it here: https://distill.pub/2018/differentiable-parameterizations/ (see section 3)

Unfortunately, generalizing it to other media would be a significant research problem.