search

mlcommons / modelgauge

Make it easy to automatically and uniformly measure the behavior of many AI Systems.
https://mlcommons.org/ai-safety/
Apache License 2.0
26 stars 7 forks source link

Unite hugging face secrets #575

Open bkorycki opened 1 month ago

bkorycki commented 1 month ago

Align the private HF annotator secret (scope: huggingface, name: api_key) with the secret in huggingface_inference plugin (scope: hugging_face, name: token).

rogthefrog commented 1 month ago

@bkorycki do you have a preference for a name (api_key vs token)?

bkorycki commented 1 month ago

@rogthefrog No preference!

rogthefrog commented 1 month ago

Symptom of the issue: https://github.com/mlcommons/modelbench/issues/459

rogthefrog commented 1 month ago

Replacing this ticket with a matching one in the modelbench repo since this ticket's repo (modelgauge) has been merged 🥳