search

ai-se / ML-assisted-SLR

Automated Systematic Literature Review
2 stars 2 forks source link

Start rule and stop rule #29

Open azhe825 opened 7 years ago

azhe825 commented 7 years ago

Stop rule

  1. elbow test
  2. if highest prediction score < 0.5 (promising)
  3. life point, each iter if no relevant detected, life point -1

    Start rule (a bigger problem when reusing model)

  4. random sampling until ONE relevant study retrieved (Currently in use, can be unstable in extreme cases when seed set cannot represent the shape of the data)
  5. Instead of random sampling, try stratified sampling from clusters. Add start rule of: at least one labeled example in each cluster.
azhe825 commented 7 years ago

Current version