clp-research / clembench

A Framework for the Systematic Evaluation of Chat-Optimized Language Models as Conversational Agents and an Extensible Benchmark
MIT License
19 stars 26 forks source link

Feature dialogue gamemaster reprompting, implements #41 #42

Closed lpfennigschmidt closed 5 months ago

lpfennigschmidt commented 5 months ago

I hope I understood your comment about changing the action type of the log message correctly, unfortunately I could not try out whether this works with my game as I currently get weird cuda errors again...

And I also found two typos, I hope they can simply be merged with this PR as well :) Commit changes should be squashed into one commit, otherwise some of my codenames stuff will appear and disappear in the commit history unnecessarily