Tune hyperparameters such that there is sufficiently low sparsity in latent codes

[ribombee]

Make It Work Better : D

Mitigation ideas:

• Smaller VQVAE latent space
• Smaller VQVAE codebook

[ribombee]

I've made some attempts at this but wfc is honestly so slow it's taking a long while to run iterations

[ribombee]

Another idea: Adding parameters to allow for sheared, rotated and otherwise augmented versions of the image to train the WFC where this is appropriate