Get Neural Network running

paivaspol / EECS583

Class Project

0 stars 0 forks source link

Closed chrisjbaik closed 8 years ago

chrisjbaik commented 8 years ago

Currently the training isn't working. Two things are suspect:

[x] Test input is bad. Try doing a test input with randomly generated numbers from 0-9 in the matrix, and labels for each row being the sum(row) % 10, and then put it in a one-hot vector form.
[x] Cross-entropy at intermediate steps seems to be producing NaN. how come?

arquinn commented 8 years ago

well... so Cross-entropy, according to wikipedia, is a sum of a probability times a log SO.. log(x) = NaN when x < 0 right?

chrisjbaik commented 8 years ago

@arquinn you're absolutely right. I'm gonna take a cue from this page:

It's still not really changing much though; have to figure out what's going wrong.

chrisjbaik commented 8 years ago

This problem is fixed, but we're still not getting super awesome results. :(

@zainahamid @arquinn @paivaspol