atharesinc / athares

Expo Web and Native Codebase
0 stars 0 forks source link

Sentiment Analysis Trigger #53

Open actuallydan opened 3 years ago

actuallydan commented 3 years ago

In lieu of a fleet of moderators to make sure people aren't doing illegal or awful stuff, it would be a cool idea to implement some cloud function to scan a message or revision on creation for its sentiment (checking for illegal content, or something that would infringe terms of use) and mark it for manual review as well as hide it by default when being viewed and only optionally allow the message to be viewed.

This could either use a canned brain.js function and/or use an open source API that can scan for sketchy content.