The original motivation came from the fact, that InceptionV1 gradients look similar to white noise for some reason, while natural images have 1/f amplitude spectrum decay.[google: natural image spectrum] At first I was using Lapacian pyramid normalization to fix the gradient spectrum, and then together with Chris we formulated it as optimization in different parameters space (or as Chris states, optimization under a different vector norm).
The original motivation came from the fact, that InceptionV1 gradients look similar to white noise for some reason, while natural images have 1/f amplitude spectrum decay.[google: natural image spectrum] At first I was using Lapacian pyramid normalization to fix the gradient spectrum, and then together with Chris we formulated it as optimization in different parameters space (or as Chris states, optimization under a different vector norm).