search

stanfordnlp / dspy

DSPy: The framework for programming—not prompting—foundation models
https://dspy-docs.vercel.app/
MIT License
17.36k stars 1.33k forks source link

Add Tests for extend generation logic #1184

Open mikeedjones opened 3 months ago

mikeedjones commented 3 months ago

Added tests for extend generation logic to avoid any further breaking changes (#920) which must then be reverted (#1169)

I'm not sure the behaviour currently exhbitied is intended? I have included the generation logs as a comment in each test to illustrate how the lm is being prompted to show the DummyLM responses in context.

Adds tests to illustrate issue #1232 and to test against any solution for that issue.

Cheers

arnavsinghvi11 commented 2 months ago

Hi @mikeedjones , thanks for the PR. can you rebase to main and push to retrieve the latest tests?

mikeedjones commented 2 months ago

Hi @arnavsinghvi11 - updated - thanks!

mikeedjones commented 2 months ago

Hi @arnavsinghvi11 Is there anything else which needs to be added to this?

mikeedjones commented 2 months ago

@arnavsinghvi11 - Anything which needs to be done to merge these tests?