search

shenweichen / DeepCTR

Easy-to-use,Modular and Extendible package of deep-learning based CTR models .
https://deepctr-doc.readthedocs.io/en/latest/index.html
Apache License 2.0
7.43k stars 2.19k forks source link

What about adding a Benchmark #51

Open iFe1er opened 5 years ago

iFe1er commented 5 years ago

What about adding a performance benchmark (by AUC and logloss) over datasets such as Criteo?

iFe1er commented 5 years ago

@shenweichen

shenweichen commented 5 years ago

@iFe1er That's a good idea,but the hyperparameters of each model are not easy to determine because it is difficult to determine a consistent setting. And it is too cumbersome to find the optimal parameters by parameter tuning. Do you have any good solution?

iFe1er commented 5 years ago

@shenweichen I would recommend simply adding testing them with default hyper-parameter. Control the variable such as learning rate and batch size, then compare those algorithm on the same test set. That should be helpful enough and an easy way to do.