langchain-ai / langsmith-docs

Documentation for langsmith
https://docs.smith.langchain.com/
MIT License
81 stars 37 forks source link

how to access expected output in evaluation prompts #409

Closed munterwexi closed 1 month ago

munterwexi commented 2 months ago

I want to use a hallucination evaluator on my dataset, which is kv-structured. however there is no way in the ui, to access the expected output or expected output variables? please help

Bildschirmfoto 2024-08-26 um 21 25 28

expected behaviour: access input with input. and output with output. accessors is possible for kv datasets, otherwise evaluation is not possible

hinthornw commented 1 month ago

Use reference.<key-name>