Closed SteveSandersonMS closed 2 months ago
The only reason it wasn't done this way originally is that it predated widespread availability of JSON response sampling. But as of September 2024, the vast majority of LLM backends can respond reliably with JSON.
The only reason it wasn't done this way originally is that it predated widespread availability of JSON response sampling. But as of September 2024, the vast majority of LLM backends can respond reliably with JSON.