search

Diyago / kaggle-malware

https://www.kaggle.com/c/microsoft-malware-prediction/
1 stars 0 forks source link

Optimize hyperparamerts #4

Open Diyago opened 5 years ago

Diyago commented 5 years ago

Try higher learning rate to overcome overfitting

Diyago commented 5 years ago 
base_params = {   
        'boosting_type': 'gbdt',
        'objective': 'binary',
        'metric': 'auc',
        'nthread': 4,
        'learning_rate': 0.05,
        'max_depth': 5,
        'num_leaves': 40,
        'sub_feature': 0.9,
        'sub_row':0.9,
        'bagging_freq': 1,
        'lambda_l1': 0.1,
        'lambda_l2': 0.1,
        'random_state': random_state
        }