jkkummerfeld / text2sql-data

A collection of datasets that pair questions with SQL queries.
http://jkk.name/text2sql-data/
Other
538 stars 106 forks source link

Hyperparameters for small datsets #29

Closed DeNeutoy closed 5 years ago

DeNeutoy commented 5 years ago

Hi Jonathan - just wondering how the hyperparameters for the slot filling baseline were chosen? The code doesn't do any early stopping based on a development split - were these based off some intuition about the dataset's relative sizes compared to the datasets which do have train/dev/test splits?

Thanks!

jkkummerfeld commented 5 years ago

That's right. There is a good chance that there is scope for improvement with some optimisation, but doing that without overfitting seems tricky.