ENSTA-U2IS-AI / torch-uncertainty

Open-source framework for uncertainty and deep learning models in PyTorch :seedling:
https://torch-uncertainty.github.io
Apache License 2.0
287 stars 19 forks source link

:rocket: Update to Lightning 2.0, Add Segmentation, & Rework Regression #85

Closed o-laurent closed 6 months ago

o-laurent commented 6 months ago

:zap: Add Lightning 2.0 support and completely rework the CLI using lightning's config files

Regression :sparkles: Make RegressionRoutine fully functional and add proper probabilistic regression support :sparkles: Add distributions & improve probabilistic regression

Segmentation :sparkles: Add SegmentationRoutine :sparkles: Add Segformer Baseline & Models :sparkles: Add Camvid, Cityscapes & MUAD Datamodules :sparkles: Add mIoU

Depth Estimation :sparkles: Add Depth metrics

Others :sparkles: Improve result printing using TUTrainer :sparkles: Rework experiments :sparkles: Add Packed-Ensembles config files :sparkles: Add energy as OOD criterion :heavy_minus_sign: Remove cli_test_helpers :wrench: Fix codecov :shirt: Improve overall code quality :book: Improve documentation :books: Improve tutorials

Tasks for merging:

codecov[bot] commented 6 months ago

Codecov Report

Attention: Patch coverage is 96.76492% with 45 lines in your changes are missing coverage. Please review.

Project coverage is 99.02%. Comparing base (79ec8af) to head (06b37c3).

Files Patch % Lines
...h_uncertainty/models/segmentation/segformer/std.py 89.30% 15 Missing and 19 partials :warning:
torch_uncertainty/routines/classification.py 97.26% 0 Missing and 4 partials :warning:
torch_uncertainty/utils/cli.py 88.57% 0 Missing and 4 partials :warning:
torch_uncertainty/utils/evaluation_loop.py 93.75% 1 Missing and 2 partials :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #85 +/- ## ========================================== + Coverage 99.01% 99.02% +0.01% ========================================== Files 84 107 +23 Lines 4445 5018 +573 Branches 571 679 +108 ========================================== + Hits 4401 4969 +568 + Misses 20 17 -3 - Partials 24 32 +8 ``` | [Flag](https://app.codecov.io/gh/ENSTA-U2IS-AI/torch-uncertainty/pull/85/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ENSTA-U2IS-AI) | Coverage Δ | | |---|---|---| | [cpu](https://app.codecov.io/gh/ENSTA-U2IS-AI/torch-uncertainty/pull/85/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ENSTA-U2IS-AI) | `99.02% <96.76%> (+0.01%)` | :arrow_up: | | [pytest](https://app.codecov.io/gh/ENSTA-U2IS-AI/torch-uncertainty/pull/85/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ENSTA-U2IS-AI) | `99.02% <96.76%> (+0.01%)` | :arrow_up: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ENSTA-U2IS-AI#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.