search

rdevon / DIM

Deep InfoMax (DIM), or "Learning Deep Representations by Mutual Information Estimation and Maximization"
BSD 3-Clause "New" or "Revised" License
806 stars 102 forks source link

High level question about discriminator #38

Open mm04926412 opened 4 years ago

mm04926412 commented 4 years ago

Hello, I don't have a pure math background and I've tried to make my own naive implemenation of DIM where the "discriminator" is just a standard binary crossentropy sigmoid classifier where there is a 50% chance the input is global and and + example and a 50% chance the input is a global and - sample. Is this vanilla classification scheme a correct implementation of the project?

rdevon commented 4 years ago

Yeh, it's just binary classification between pairs (global, local that comes from same image that produced global) and (global, local that comes from probably different image that that that produced global).