Open jamesgeddes opened 2 years ago
I have asked Ofcom to publish their offensive language list in JSON on a permalink.
I have converted the Ofcom list to JSON myself. Hopefully Ofcom will publish their own JSON in the future so that we can automate this.
GitHub does not support uploading .json files so rename this from
offensive_language-json.txt
to
offensive_language.json
On the assumption that Ofcom,
I see two main options that would allow us to get the latest version of the offensive language list without cron.
We could use a free change checker such as distill.io to monitor the file for changes and then update our copy on webhook. We should avoid using cron jobs unless absolutely necessary.
We could update the list from Ofcom if all of the following criteria are met.
This might be helpful
Just a few thoughts which can hopefully provide further guidance on this matter:
ML could potentially identify insulting/offensive text, regardless of if it contains bad language. However, the technology is extremely limited, and I strongly advise that it is used to notify human moderators only.
A good regex filter should be enough to identify explicit language, and so long as it is only used for words which should be prohibited regardless of context, it shouldn't cause problems.
What should never be done, is a bot (ML or not) with the ability to timeout/kick/ban people based on text that may not be offensive depending on context. Deep learning-based bots in particular should never have this ability, since it is impossible to provide assurances against false positives.
What's your idea?
Build or implement a bot that can moderate our forum and discord server according to the different levels of offensive language as stipulated by Ofcom; "Mild", "Moderate" and "Strong".
Brownie points
Could use human input, such reactions, to learn whether potentially offensive language is actually offensive within the context of the previous 10 messages.
Once predictions start getting above 90% certainty, we could start letting the bot take action on messages.
Impact
High
Urgency
Later
Code of Conduct