pyronear / pyro-risks

Data science for wildfire risk forecasting and monitoring
https://pyronear.github.io/pyro-risks
Apache License 2.0
25 stars 8 forks source link

feat: Add pipeline evaluation module #50

Closed jsakv closed 3 years ago

jsakv commented 3 years ago

This PR introduce a dedicated module for streamlining evaluation of our scoring pipelines.

The new functions will allow to persist model performance :

image

Let me know what you think!

codecov[bot] commented 3 years ago

Codecov Report

Merging #50 (07f40ca) into master (6908e55) will increase coverage by 0.57%. The diff coverage is 100.00%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master      #50      +/-   ##
==========================================
+ Coverage   95.36%   95.93%   +0.57%     
==========================================
  Files          23       25       +2     
  Lines         949     1033      +84     
==========================================
+ Hits          905      991      +86     
+ Misses         44       42       -2     
Flag Coverage Δ
unittests 95.93% <100.00%> (+0.57%) :arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
pyro_risks/__init__.py 100.00% <100.00%> (ø)
pyro_risks/config/datasets.py 100.00% <100.00%> (ø)
pyro_risks/evaluate.py 100.00% <100.00%> (ø)
pyro_risks/load.py 100.00% <100.00%> (ø)
pyro_risks/train.py 100.00% <100.00%> (+2.66%) :arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 6908e55...07f40ca. Read the comment docs.

frgfm commented 3 years ago

@dataJSA not sure if it was on purpose, but you didn't delete the remaining branch ;)