Slimming down system message

[farzadab]

This PR tries to slim down the default System message for Sidekicks.

General changes:

• Trying to reduce unneeded words (I didn't go so far, but LLMLingua shows that LLMs can understand a highly shortened format of language)
• The "document system message" is used only if there Sidekick has some tools. Corpus vs other tools are not disambiguated
• Reducing number of System messages: not a large factor, but I verified that each additional system message uses about 4 extra tokens
• Date format change
  • before: 11/10/2023, 1:46:34 PM .... Friday
  • after: Friday, Nov 10, 2023, 1:46:34 PM
  • Interestingly, this uses slightly less tokens (not including actual prompt changes) while disambiguating 11/10 (US "standard" ...) to Nov 10

Token count for plain text mode (text only):

• before: 136 (probably slightly higher due to having multiple system messages)
• after (with tools): 77
• after (w/o tools): 56

[vercel[bot]]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
ai-jsx-docs	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Nov 13, 2023 7:37pm
ai-jsx-nextjs-demo	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Nov 13, 2023 7:37pm
ai-jsx-tutorial-nextjs	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Nov 13, 2023 7:37pm
ai-jsx-voice	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Nov 13, 2023 7:37pm