Verbose prompt changes - Githubissues

TathagataChakraborti commented 2 weeks ago

A couple of minor changes, after going though the last results.

[x] As far as I can see, none of the examples in the prompt have a slot in it? I think we should have an ask to appear in one of those 4 examples. Some of the llm responses are missing out on asks.
[x] I think we should kill the variable output 😒 The outputs is adding added complexity that is making a lot of the responses add outputs in the asks and maps as well.
- To turn off output in the debugger and pretty print, check this example.
- If you are making this change, make sure to change the text in the prompt description to also not have output.
[x] Change _"Action a1 has variables v3, v8" to "Action a1 has parameters v3, v8"_. I am hoping this improves the situation where the parameters are wrong in the output plan.
[x] The "should be known" in the action description should be "must be known" imo.

jkeskingvillage commented 2 weeks ago

The first item has nothing to do with NL2flow. ai_profiler is in a different repository, and changes are made already.

jkeskingvillage commented 2 weeks ago

@TathagataChakraborti Did you verify the impact of the proposed suggestions with at least two models?

IBM / nl2flow