zeno-ml / zeno-build

Build, evaluate, understand, and fix LLM-based apps
MIT License
482 stars 33 forks source link

GPT-MT Example: Post-processing of gpt-4 #145

Closed neubig closed 1 year ago

neubig commented 1 year ago

Description

This PR adds a post-processing rule for GPT-4 that removes the first word in an output when that word is a language followed by a colon. This fixes a common error pattern in GPT-4 where it tends to output the language (due to the prompt).

Blocked by