search

JCBrouwer / maua-stylegan2

This is the repo for my experiments with StyleGAN2. There are many like it, but this one is mine. Contains code for the paper Audio-reactive Latent Interpolations with StyleGAN.
https://wavefunk.xyz/audio-reactive-stylegan
179 stars 29 forks source link

about styleganv2 classes and beat effect #20

Closed Breeze-Zero closed 3 years ago

Breeze-Zero commented 3 years ago

well ,i saw your the kick and snare drums demo, Elastic recovery interests me. I would like to know How does this work.what's more,whether or not class vectors are used in styleganv2 Looking forward to your reply ------a student written

JCBrouwer commented 3 years ago

Hello, I'm not quite sure what you mean by elastic recovery, but ar.onsets() is what generates the envelopes that are used in the kick/snare demo.

Here's an example of what the onsets look like

The video changes according to these peaks, so that can lead to a kind of "elastic" visual effect (if that's what you mean?).

re: class vector. Right now, no class conditioning is used, I haven't ever trained a conditional net so haven't had the use for it. However, all of the audio-reactive tricks that are applied in latent space should work similarly on class-conditioning vectors.