Moderation Api : missing harassment and harassment/threatening metrics and flag

[Aelentel]

calling the Moderation API result in the following payload :

however the java model "ModerationResult" doesn't have the following flags & metrics : harassment & harassment/threatening

{
  "id": "modr-<SOMEID>",
  "model": "text-moderation-005",
  "results": [
    {
      "flagged": true,
      "categories": {
        "sexual": false,
        "hate": false,
        "harassment": false,
        "self-harm": false,
        "sexual/minors": false,
        "hate/threatening": false,
        "violence/graphic": false,
        "self-harm/intent": false,
        "self-harm/instructions": false,
        "harassment/threatening": true,
        "violence": false
      },
      "category_scores": {
        "sexual": 0.0005017801886424422,
        "hate": 0.0000533161437488161,
        "harassment": 0.1876802295446396,
        "self-harm": 0.00004789013109984808,
        "sexual/minors": 1.1327256288495846e-6,
        "hate/threatening": 0.0005069859325885773,
        "violence/graphic": 0.00003967898010159843,
        "self-harm/intent": 0.000017482938346802257,
        "self-harm/instructions": 5.0221064640254554e-8,
        "harassment/threatening": 0.47996777296066284,
        "violence": 0.8792107701301575
      }
    }
  ]
}

[remyohajinwa]

@Aelentel Working on this and will raise a PR soon

[cryptoapebot]

This can be handled dynamically.

import java.util.ArrayList;
import java.util.HashMap;
import lombok.Data;
@Data
public class CategoryResults {

    HashMap<String, Boolean> categories = new HashMap<String, Boolean>();
    HashMap<String, Double> category_scores = new HashMap<String, Double>();
    Boolean flagged = false;

    public CategoryResults(HashMap<String, Boolean> categories, HashMap<String, Double> category_scores,
            Boolean flagged) {
        super();
        this.categories = categories;
        this.category_scores = category_scores;
        this.flagged = flagged;
    }

    public ArrayList<String> reasons() {
        ArrayList<String> rzns = new ArrayList<String>();
        for (String key : categories.keySet()) {
            if (categories.get(key)) {
                rzns.add(key);
            }
        }
        return rzns;
    }

}

import java.util.ArrayList;
import java.util.Optional;
import lombok.Data;
@Data
public class Moderation {

    String id = null;
    String model = "text-moderation-latest";
    ArrayList<CategoryResults> results = new ArrayList<CategoryResults>();

    @Override
    public String toString() {
        if (results != null && results.stream().anyMatch(CategoryResults::getFlagged)) {
            Optional<CategoryResults> cr = results.stream().findFirst();
            return String.join(", ", cr.get().reasons());
        } else {
            return "no particular reason.";
        }
    }

    public Moderation(CategoryResults violation) {
        super();
        results.add(violation);
    }

}

       //         HttpResponse<String> response = {API request};
    public static Gson gs = new GsonBuilder().setPrettyPrinting().create();
    Moderation mod = gs.fromJson(response.body(), Moderation.class);

[Aelentel]

@Aelentel Working on this and will raise a PR soon

do you know if @TheoKanning is letting this project down ? there's a lots of PR not answered. this project was pretty alive 2 month ago, and as such i based one of the company project on it, kinda want to fork it and fix/merge some because time is running short. no pressure though, but it's strange to see those PR accumulate