native support for system prompts

leondz commented 1 year ago

add a flag & template in generator classes for how to include these

leondz commented 9 months ago

also include a _set_system_prompt generator function, for those that support it (raise NotSupportedError by default)

leondz commented 6 months ago

requires #109

proposal:

handle all this in Attempt using chat provision (i.e. not only message but also role, with role = system)
stored in .messages
implemented via set/get .sysprompt
should be possible to set .sysprompt if empty history
should be possible to set .prompt w/ string iff history empty or history only a sysprompt (i.e. role=system)
history replication on first output should handle sysprompts OK
logic for getting & setting .prompt will change a bit - the history lengths become flexible if a system prompt is allowed in front

leondz / garak