add color to run_exp plots and change x-axis to label based on number of passes

[dustinvtran]

source("script/load_mnist.R")
source("script/multilogit.R")
source("script/plot.R")

library(sgd)
library(bigmemory)

dat <- load_mnist()
X <- dat$train$x
y <- dat$train$y
X_test <- dat$test$x
y_test <- dat$test$y

methods <- list("sgd", "ai-sgd", "implicit")
lrs <- list("adagrad", "one-dim", "one-dim")
np <- list(3, 3, 3)
names <- methods

run_exp(methods, names, lrs, np, X, y, X_test, y_test)

[lantian2012]

Do you think it makes sense that ai-sgd has worse error? Or is it caused by small training set size?

[dustinvtran]

Both yes. I believe in practice the standard recommendation is to start averaging after a single pass (what Bottou does).

[dustinvtran]

it's looking quite nice :)

[dustinvtran]

Added npasses in 6dbd981b8b6b60dea2fbd698b28e66011500fb34