epic-open-source / seismometer

AI model evaluation with a focus on healthcare
https://epic-open-source.github.io/seismometer/
BSD 3-Clause "New" or "Revised" License
156 stars 15 forks source link

CI Test suite for multiple enviroments #15

Closed diehlbw closed 1 month ago

diehlbw commented 1 month ago

Overview

Updates CI for test coverage

Description of changes

Coverage should be done on base environment (py3.10 + linux) since there is no dependent branching
Test suite should run on:

3.12 has known install issue to resolve before adding - marked as experimental allowing failure

Using a runner matrix allowed for testing across environments and python versions without actually using nox. While this isn't easily reproducible on a single machine, it seems reasonable to forgo defining the nox sessions until we need more complexity. Testing multiple environments in a single python version might be reason to start using sessions (such as ensuring compatibility with multiple versions of pandas)

Author Checklist

diehlbw commented 1 month ago

Are we planning on including the failing 3.12 pipeline still?

Removed, seems cleaner avoids the confusion of failing tasks