Closed braceal closed 3 years ago
I have an idea how you can get rid off weird resnet restrictions for latent space dim.
instead of flatten the vector, average pool the spatial dims and just take the filter outputs to feed into the next layer.
that way your latent space dim does not change with image size and you can adjust it by adjusting that filter dim
so you might need to add more filters to capture the spatial features you lose but that could work too
I have an idea how you can get rid off weird resnet restrictions for latent space dim.
instead of flatten the vector, average pool the spatial dims and just take the filter outputs to feed into the next layer.
that way your latent space dim does not change with image size and you can adjust it by adjusting that filter dim
so you might need to add more filters to capture the spatial features you lose but that could work too