search

wisecubeai / pythia

Open source AI hallucination monitoring
https://askpythia.ai/
Apache License 2.0
4 stars 0 forks source link

Support configuring Validators #8

Open cloudronin opened 1 week ago

cloudronin commented 1 week ago

We need a way to configure Pythia to only run one or more configured/enabled validators as part of its processing. Right now its not clear if it runs all of the validators all the time or not.

pratacosmin commented 4 days ago

Validators

Using validators will increase the processing time for the trace. The first call can take up to 2 minutes because some validators required to download models or additional data. This time will drop to something like 15-20 sec depending also on the number of enabled validators.

Pythia Offers a variety of LLM validators in order to check the input and output for the model. This validators can be enabled or disabled using the config file configurations/validators/config.yaml.

    - name: detect_pii
      description: "The Anonymize Scanner acts as your digital guardian, ensuring your user prompts remain confidential and free from sensitive data exposure."
      source: llm Guard
      enabled: true
      input: input_reference
      output: input_response

The response for the validators Will be set on the pythia Traces. image