Modeling issue 28 train test split - Githubissues

dominikmn / one-million-posts

Assisting newspaper moderators with machine learning.

MIT License

2 stars 1 forks source link

Modeling issue 28 train test split #51

Closed lima-tango closed 3 years ago

lima-tango commented 3 years ago

utils.train_test_val_split:

Posts annotated in round 2 should represent the population and can be used for validation and test set.
Stratify by labels that are rare in annotation round 2.
Use annotations for personal stories and possibly feedback to get better balance for these labels in training data.

utils.loading function load_extended_posts:

Include parameter "label" to get only posts with annotations for that label.