Actually test the Python translator

microsoft / TypeChat

TypeChat is a library that makes it easy to build natural language interfaces using types.

https://microsoft.github.io/TypeChat/

MIT License

8.06k stars 378 forks source link

Actually test the Python translator #240

Closed DanielRosenwasser closed 2 months ago

DanielRosenwasser commented 2 months ago

This PR adds a test for Python translators by mocking a model and snapshotting the log.

Based on feedback from @gvanrossum where he pointed out that we don't actually use the repaired prompt (I broke this in #203). Some of the fixes are already in https://github.com/microsoft/TypeChat/pull/238.