microsoft / prompty

Prompty makes it easy to create, manage, debug, and evaluate LLM prompts for your AI applications. Prompty is an asset class and format for LLM prompts designed to enhance observability, understandability, and portability for developers.
https://prompty.ai
MIT License
522 stars 46 forks source link
generative-ai llm-evaluation llms promptengineering

Prompty

Prompty is an asset class and format for LLM prompts designed to enhance observability, understandability, and portability for developers. The primary goal is to accelerate the developer inner loop.

This repo contains the following:

This Visual Studio Code extension offers an intuitive prompt playground within VS Code to streamline the prompt engineering process. You can find the Prompty extension in the Visual Studio Code Marketplace.

What is Prompty?

Specification

Prompty standardizes prompts and their execution into a single asset.

Language Spec

VSCode Extension Features

Quickly Create

Quickly create a basic prompty by right-clicking in the VS Code explorer and selecting "New Prompty."

Quick Create

Preview

Preview prompty similar to markdown with dynamic template rendering while typing, allowing you to see the prompt that will be sent to the model.

Preview

Define and Switch Model Configurations

Quick Run

Hit F5 or click the Run button at the top. There are two output windows:

Orchestrator Integration

Prompty is supported by popular orchestration frameworks:

Right-click on a .prompty file to quickly generate integration snippets.

Orchestrator Integration

Feedback

Submit your feedback about Prompty or the VS Code extension to the Microsoft/prompty GitHub repository.

Documentation