para-droid-ai / scratchpad

Scratchpad
MIT License
66 stars 7 forks source link

Revise/Review: [Strive for clarity and accuracy in your reasoning process, showcasing your ASI levels] #4

Open para-droid-ai opened 1 month ago

para-droid-ai commented 1 month ago

This section was added almost haphazardly during the creation of scratchpad canvas while dialing in the prompt. This was a combination of a few other steps that I combined together, and then included at the top as a means to steer the output. That being said, it was added, and it has stayed there, and I never properly actually tested what it does, if it does what it's supposed to do, and what that would actually be anyway, in terms of output that we can directly analyze with one to one comparison.

para-droid-ai commented 1 month ago

Currently, at least 5/10 outputs will directly display the phrase in the scratchpad-section, regardless of this section from the pre-prompt: "[Display title/sub-task.IDs in your output before reasoning. example: Attention Focus : PrimaryFocus: model text output.]. "

this is an example of that in action, via Google AI Studio, having just copy/pasted the collection prompt in
image

That leads me to believe that the model "believes" it serves a purpose for scratchpad, and retains it.