brmson / dataset-sts

Semantic Text Similarity Dataset Hub
711 stars 206 forks source link

Hyperparameter tuning using Spearmint #12

Open pasky opened 8 years ago

pasky commented 8 years ago

So far, we have support just for parameter tuning using random search (tools/anssel_tune.py). Since this search is pretty high dimensional, what we then sometimes do is look at what works in general and manually focus the parameters on that. But this is sort of inexact, and quite tiresome + boring too. We should use a smarter way to tune stuff!

I don't know if there's a better choice than https://github.com/JasperSnoek/spearmint .

(Using software allowing commercial usage etc. and ideally without CLA is pretty important to me.)