Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation - Githubissues

philparadis / paper-notes

Papers I need to go through or already went through and and any relevant notes, small experiments or attempt at reproducibility, questions and answers, etc.

0 stars 0 forks source link

Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computation #1

Open philparadis opened 7 years ago

philparadis commented 7 years ago

https://arxiv.org/abs/1308.3432

philparadis commented 7 years ago

Step 1:

[ ] Read the article diagonally, highlighting all key terminology, concepts, algorithms, etc. I need to be familiar with
[ ] Make a first quick summary of what I think the paper is trying to establish

Step 2:

[ ] Find the definitions of the previously highlighted key prerequisites (concepts, algorithms, terminology)
[ ] Find the most important articles listed in the reference section and go through them

Step 3:

[ ] Implement some of the ideas in the paper to ensure that not only do I understand the material, but I can reproduce the results
[ ] Make a final quick summary of what the paper is trying to establish

Step 4:

[ ] Identify the most impactful ideas (by looking at follow-up literrature)
[ ] Criticize the paper
[ ] Identify open problems in the paper
[ ] See if those open problems have been solved or not in follow-up papers
[ ] Move on the the follow-up papers, rinse and repeat until I reach the current state-of-the-art