search

microsoft / prompty

Prompty makes it easy to create, manage, debug, and evaluate LLM prompts for your AI applications. Prompty is an asset class and format for LLM prompts designed to enhance observability, understandability, and portability for developers.
https://prompty.ai
MIT License
381 stars 24 forks source link

Built-in prompt compression #68

Open vincentgiraud opened 3 weeks ago

vincentgiraud commented 3 weeks ago

Optimization being part of prompt design, it'd be great to integrate a tool like LLMLingua in the VSC extension.

The prompty file could have a compression section:

compression:
    rate: 0.55
    target_token: 200
    ...
wayliums commented 3 weeks ago

I think this is a great idea. @sethjuarez what do you think?

sethjuarez commented 2 weeks ago

In general it should be able to be done in the render/parse step - maybe we could add an invoker for this?