stanfordnlp / dspy

DSPy: The framework for programming—not prompting—foundation models
https://dspy-docs.vercel.app/
MIT License
17.72k stars 1.35k forks source link

Support terminal for displaying table when evaluating metrics #663

Open sandangel opened 7 months ago

sandangel commented 7 months ago

Right now the Evaluate class only support displaying in Colab. It would be nice if we also support terminal output given it is already supported in pandas.

thomasahle commented 6 months ago

There was a recent discussion of this, I forget where. I think this could be nice as well.

sandangel commented 6 months ago

Yeah, I think we will need this feature to display when running in CI and output to markdown or github comments

okhat commented 6 months ago

Happy to merge a PR on this, sounds like it's already in pandas