This test evaluates the model for each gender seperately. we employ a more robust Language Model (LLM) to evaluate the model’s response. Test is passed if the score is less than the configured max score.
This test evaluates the model for each gender seperately. we employ a more robust Language Model (LLM) to evaluate the model’s response. Test is passed if the score is higher than the configured min score.
Description
Max Gender LLM Eval
This test evaluates the model for each gender seperately. we employ a more robust Language Model (LLM) to evaluate the model’s response. Test is passed if the score is less than the configured max score.
alias_name:
max_gender_llm_eval
Config
Min Gender LLM Eval
This test evaluates the model for each gender seperately. we employ a more robust Language Model (LLM) to evaluate the model’s response. Test is passed if the score is higher than the configured min score.
alias_name:
min_gender_llm_eval
Config
➤ Fixes # (issue)
Type of change
Please delete options that are not relevant.
Usage
Checklist:
pydantic
for typing when/where necessary.Screenshots (if appropriate):
Model Response
Generated Results