zeno-ml / zeno-build

Build, evaluate, understand, and fix LLM-based apps
MIT License
482 stars 33 forks source link

Better document how to implement new tasks and evaluation metrics #167

Closed neubig closed 8 months ago

neubig commented 1 year ago

It is possible to support:

  1. New features by implementing new @distill functions like this
  2. New evaluation metrics by implementing new @distill functions like this and then a new metric function like this
  3. New visualizations based on zeno instance-views

This should be more extensively documented.