leo-p / papers

Papers and their summary (in issue)
22 stars 4 forks source link

Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks #8

Open leo-p opened 7 years ago

leo-p commented 7 years ago

https://arxiv.org/pdf/1511.06434.pdf

In recent years, supervised learning with convolutional networks (CNNs) has seen huge adoption in computer vision applications. Comparatively, unsupervised learning with CNNs has received less attention. In this work we hope to help bridge the gap between the success of CNNs for supervised learning and unsupervised learning. We introduce a class of CNNs called deep convolutional generative adversarial networks (DCGANs), that have certain architectural constraints, and demonstrate that they are a strong candidate for unsupervised learning. Training on various image datasets, we show convincing evidence that our deep convolutional adversarial pair learns a hierarchy of representations from object parts to scenes in both the generator and discriminator. Additionally, we use the learned features for novel tasks - demonstrating their applicability as general image representations.

leo-p commented 7 years ago

Summary:

Architecture:

Below are the guidelines for making DCGANs.

screen shot 2017-04-24 at 10 58 17 am

And here is a sample network:

screen shot 2017-04-24 at 10 57 54 am

A tensorflow implementation can be found here along with an online demo.

Results:

Quite interesting especially concerning the structure learned in the Z-space and how this can be used for interpolation or object removal, see the example that is shown everywhere:

screen shot 2017-04-24 at 11 20 03 am

Nonetheless the network is still generating small images (32x32).