amyxzhang / squadbox

Fight harassment with your squad.
https://squadbox.org
MIT License
24 stars 7 forks source link

Allow filtering by perspective API scores #17

Open amyxzhang opened 7 years ago

amyxzhang commented 7 years ago

Let owners choose what should happen to messages with scores over particular thresholds. For example, "automatically hold messages with toxicity > 0.8 for moderator review"

kmahar commented 7 years ago

we can reuse a lot of existing tagging related code if the setting is implemented as: if score above 0.8, apply tag "toxic". and then let the user decide what happens to messages with tag toxic.