positive phase order and negative phase order in DBM model

nitishsrivastava / deepnet

Implementation of some deep learning algorithms.

BSD 3-Clause "New" or "Revised" License

896 stars 438 forks source link

positive phase order and negative phase order in DBM model #74

Open jingjing1 opened 9 years ago

jingjing1 commented 9 years ago

Hi,

Could any one tell me something about how to set the positive phase order and negative phase order in DBM model? I have read the given example in deepnet, but I can't understand it.

airingzhang commented 9 years ago

This is trying to setup the order of the calculation. When there are more than 2 hidden layers in the model, this is quite useful since edge in DBM are bi-directional. Usually, people use the "even and odd" way to do the calculation: fix odd (index) layers calculating all even (index) layers, mean-field (positive phrase) or gibbs (negative phrase) sampling, and then vice versa .