airoldilab / ai-sgd

Towards stability and optimality in stochastic gradient descent
5 stars 2 forks source link

Run experiments on covertype data #16

Open dustinvtran opened 9 years ago

dustinvtran commented 9 years ago

See Bach and Moulines (2013). Compare AI-SGD to Bach's method for logistic regression and SVRG.

dustinvtran commented 9 years ago

f4ab2362338a741da1b61b9f39039f01ab4b7af2 ads this. Still need to add Bach's method, and see what's going on with SVRG exploding.

temp What the plot looks like. It should not be analyzed as I only use a very small subset of the training data in order to make it run faster and produce this plot.