Closed jonastim closed 1 year ago
This is great! Thanks for the contribution and the unit test!
@mrucker, do you use a formatter or some commit-hooks for enforcing the project's style (indentations, etc)?
No, we have nothing right now. Do you have any experience with Python formatters that we might be able to use?
No, we have nothing right now. Do you have any experience with Python formatters that we might be able to use?
We use pre-commit with Black as the formatter. Pre-commit is a great tool for keepings things consistent and offers other useful hooks like mypy.
This change adds
context
to the metrics which can berecord
ed for interactions in the task evaluation. This is particularly useful for performing analyses like feature importance on experiment results.