Updated the get_standard_metric_inputs function so that it can any types of inputs flexibly (system prompts, conversation histories, stringified numeric scores... etc)
Hopefully with this update LangCheck can help verification of wider variety of LLM-based apps!!
Making use of the infra, I
Enabled flexible inputs for custom_evaluator (only for non-pairwise inputs)
Added prompt_leakage functions which take system_prompts as an input arg.
Updated the
get_standard_metric_inputs
function so that it can any types of inputs flexibly (system prompts, conversation histories, stringified numeric scores... etc) Hopefully with this update LangCheck can help verification of wider variety of LLM-based apps!!Making use of the infra, I
custom_evaluator
(only for non-pairwise inputs)prompt_leakage
functions which takesystem_prompts
as an input arg.You can run
prompt_leakage
byYou can do the same thing with
custom_evaluator
by