latitude-dev / latitude-llm

Latitude is the open-source prompt engineering platform to build, evaluate, and refine your prompts with AI
https://latitude.so
GNU Lesser General Public License v3.0
891 stars 57 forks source link

Latitude PromptL implementation #652

Closed csansoon closed 3 days ago

csansoon commented 4 days ago

Latitude will now use the right compiler (legacy or ✨PromptL✨) depending on the version of the document and advanced evaluations, both to run prompts and to evaluate syntax.

Note: All LLM as Judge Simple evaluations will always be treated as PromptL evaluations, and evacuating them will create them accordingly. Until the UI is setup, this is the only way to create a promptl document for now.