OoriData / OgbujiPT

Client-side toolkit for using large language models, including where self-hosted
Apache License 2.0
101 stars 8 forks source link

reconsider prompt delimiters construction #31

Open choccccy opened 1 year ago

choccccy commented 1 year ago

Right now, prompts get somewhat malformed, missing several newlines. In a commit that's coming soon:tm:, i'll be hardcoding the templates in pylib/prompting/model_style.py, but obviously a solution that can programmatically add lines more intelligently would be cool.

choccccy commented 10 months ago

while this has been solved for prompting templates that are already included, I want to keep this ticket open until we have a more robust solution for different prompting styles