Evaluate behavioral change for margin and other hyperparameters

[junzengx14]

It would be interesting to evaluate behavior changes with respect to different hyperparameters and think about the a systematical way to handle this problem, initialized from Sha's issue.