eth-sri / lmql

A language for constraint-guided and efficient LLM programming.
https://lmql.ai
Apache License 2.0
3.64k stars 195 forks source link

Documentation: Add an example of agents that talk to each other or to a user #84

Open aretrace opened 1 year ago

aretrace commented 1 year ago

In the context of #74, guidance has an example section for agents; what would the analogous LMQL program look like using the Python library? Perhaps an example of agents in conversation could be added to the hero teaser on the website homepage.

OLT, will LMQL be open to supporting role tags?

lbeurerkellner commented 1 year ago

Adding a traditional agent example will definitely be interesting to have in the documentation. For now, you can already have a look at the Wikipedia example (https://lmql.ai/#wiki), which showcases tool use.

Role tags are also supported in LMQL, as shown in the chatbot example here: https://lmql.ai/#chat.

Another interesting resource on agent development with LMQL, is this blog post https://vivien000.github.io/blog/journal/better-steering-LLM-agents-with-LMQL.html.

lbeurerkellner commented 1 year ago

I will keep this issue around, until we add a more thorough agent example to the documentation.