NSAPH-Projects / space

SpaCE, the Spatial Confounding Environment, loads benchmark datasets for causal inference methods tackling spatial confounding
https://nsaph-projects.github.io/space/
MIT License
12 stars 4 forks source link

Mauriciogtec/issue125 #129

Closed mauriciogtec closed 10 months ago

mauriciogtec commented 10 months ago

Solves #49 #124 #125 #128 #127 #129 #121 Updates the benchmarking protocol with the new confounding groups, adds a Snakemake pipeline for reproducibility. Implements the hyperparameter optimization framework with ray[tune]. Updates spatial+. Adds an API for algorithms, that was necessary for the hyperparameter optimization.

codecov-commenter commented 10 months ago

Codecov Report

Merging #129 (b517453) into dev (afbf78d) will decrease coverage by 19.53%. The diff coverage is 32.80%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.

@@             Coverage Diff             @@
##              dev     #129       +/-   ##
===========================================
- Coverage   63.80%   44.28%   -19.53%     
===========================================
  Files           9       18        +9     
  Lines         420     1163      +743     
===========================================
+ Hits          268      515      +247     
- Misses        152      648      +496     
Flag Coverage Δ
unittests 44.28% <32.80%> (-19.53%) :arrow_down:

Flags with carried forward coverage won't be shown. Click here to find out more.

Files Changed Coverage Δ
spacebench/datamaster.py 69.23% <0.00%> (ø)
spacebench/eval.py 15.62% <0.00%> (-1.33%) :arrow_down:
spacebench/algorithms/spatialplus.py 14.87% <14.43%> (ø)
spacebench/algorithms/gcn.py 24.10% <19.04%> (ø)
spacebench/algorithms/dapsm.py 25.19% <19.71%> (ø)
spacebench/algorithms/pysal_spreg.py 26.38% <26.38%> (ø)
spacebench/algorithms/nonspatial.py 28.94% <28.94%> (ø)
spacebench/algorithms/datautils.py 66.66% <66.66%> (ø)
spacebench/algorithms/base.py 69.56% <69.56%> (ø)
spacebench/env.py 73.74% <71.42%> (-0.57%) :arrow_down:
... and 4 more