twitter / communitynotes

Documentation and source code powering Twitter's Community Notes
https://twitter.github.io/communitynotes
Apache License 2.0
1.47k stars 213 forks source link

Allow scorers to firm_reject, finish split scorer refactoring & QOL++ #247

Closed jbaxter closed 3 months ago

jbaxter commented 3 months ago

-Allow more-authoritative scorers to issue a FIRM_REJECT, which prevents less-authoritative scorers from being able to CRH a note, if the note scored poorly (<0.3 intercept) in the authoritative model. -Adjust MF loss function such that it is invariant to the ratings:users:notes ratios, allowing scoring to be split fully into a separate final scoring phase -Memory reduction & speedup from using smaller data types -Separate max flip rates for NMR=>CRH vs. CRH=>NMR transitions. -Speed up RAM profiling

As usual, code written by the whole team, not just me.