search

stanfordnlp / dspy

DSPy: The framework for programming—not prompting—language models
https://dspy.ai
MIT License
19.06k stars 1.46k forks source link

Updating MIPROv2 Logging #1828

Closed klopsahlong closed 1 day ago

klopsahlong commented 2 days ago

The following changes were made to improve MIPROv2 logging:

  1. Ensuring that both mini-batching and full eval programs (along with their scores) are saved at each trial in trial_logs. This fixes a previous issue where the full eval score was being overwritten.
  2. Returning evaluated programs and their scores in best_program.candidate_programs (all fully evaluated programs) and best_program.mb_candidate_programs (only minibatch evaluated programs), for consistency with Random Search Few-Shot