planetary-social / nos

nos.social social media for all of us, using nostr
https://nos.social
Mozilla Public License 2.0
120 stars 14 forks source link

[Content Moderation hot fixes] Spam is missing as an option in slack > Updating to NIP56 #1247

Closed setch-l closed 2 months ago

setch-l commented 3 months ago

Spam is missing as an option in slack

Steps to reproduce:

  1. Open Nos
  2. Flag a note or an account for spam
  3. Send the flag to Nos for review
  4. Open slack moderation channel Issue: Spam is missing as an option in slack so is other.

It's unclear to me what options exist in slack. Do these match the 1984 kinds? Or something else?

Image

dcadenas commented 3 months ago

What we display and send to reportinator directly are the categories used by OpenAI this is later mapped to nip-69 categories. OpenAI doesn't have a Spam category but nip-69 does.

So we'd need to:

setch-l commented 3 months ago

As part of the content moderation hot fixes, we did not simplify the labeling nip we were using. NIP69 labels will be great in the future, but today they are too complicated for what the existing apps and community needs. Instead after speaking with @dcadenas we will map our in-app labels to NIP56 labels and remove the NIP69 from the workflow. This will allow us to have spam in the slack bot moving forward. Below are the list of updates needed to complete this work.

Updates:

mplorentz commented 2 months ago

@setch-l telling the user they are publishing a public flag for harassment and then under-the-hood publishing an event that labels it as "profanity" seems really user-hostile. I would be pretty mad if an app I was using did that. If you want to stick with the NIP-56 categories then I really think we should also update our UI to match what we are actually going to publish on the user's behalf.

setch-l commented 2 months ago

We have a plan to submit a nip update to change the language for profanity to coarse language or intolerance to match what is in our app and that better reflects the spirit of the profanity label.

In general all of this is much more complicated than it needs to be given the functionality we offer users today. Daniel and I are simplifying what exists now so we can build upon easily in the future. Today we need to navigate between 2 nips & open AI. It’s a lot of extra code that was causing confusion for users.