thu-ml / MMTrustEval

A toolbox for benchmarking trustworthiness of multimodal large language models (MultiTrust, NeurIPS 2024 Track Datasets and Benchmarks)
https://multi-trust.github.io/
Creative Commons Attribution Share Alike 4.0 International
108 stars 7 forks source link

How to Replace Perceptive API? #1

Closed hacker-jerry closed 4 months ago

hacker-jerry commented 4 months ago

Hi author, due to the well-known network problems, China can not use google's Perceptive API, is there a simpler way to replace it?Thanks for your help!

zycheiheihei commented 4 months ago

Thanks for your attention to our work. PerspectiveAPI is widely used in works studying LLM safety alignment. If it's not available, Moderation API can be used for rating then. The difference should be acceptable based on our experience.