Open simonw opened 2 months ago
Start by just logging the responses to SQLite with response.log_to_db(...) - then log the eval configuration (a full copy so the database is useful even without the original YAML) and the check results.
response.log_to_db(...)
Initial thoughts in https://github.com/simonw/llm-evals-plugin/issues/1#issuecomment-2067826767
Start by just logging the responses to SQLite with
response.log_to_db(...)- then log the eval configuration (a full copy so the database is useful even without the original YAML) and the check results.Initial thoughts in https://github.com/simonw/llm-evals-plugin/issues/1#issuecomment-2067826767