[FR]: While running Evaluate() print to the CLI the ongoing score of the metrics measured

comet-ml / opik

Open-source end-to-end LLM Development Platform

Apache License 2.0

2.29k stars 141 forks source link

[FR]: While running Evaluate() print to the CLI the ongoing score of the metrics measured #674

Open gidim opened 1 week ago

gidim commented 1 week ago

Proposal summary

When running a new experiment you often want to view the progress of it before letting it finish. This is for instances where your change negatively impacted your previous best score. Since of these runs take a while it would be beneficial to see an ongoing updated score either in the CLI or in the UI

Motivation

No response