SpaceNet Change and Object Detection (SCOT) metric

[dphogan]

Thank you for submitting your PR. Please read the template below, fill it out as appropriate, and make additional changes to your code as needed. Please feel free to submit your PR even if it doesn't satisfy all of the requirements below - simply prepend [WIP] to the PR title until it is ready for review by a maintainer. If you need assistance or review from a maintainer, add the label Status: Help Needed or Status: Review Needed respectively. After review, a maintainer will add the label Status: Revision Needed if further work is required for the PR to be merged.

Description

Adds the SpaceNet Change and Object Tracking (SCOT) metric to the eval subpackage, including the file scot.py with the metric itself, and a multi_temporal_buildings function in challenges.py to load and score SpaceNet 7 submissions.

Type of change

Please delete options that are not relevant.

• [ ] Bug fix (non-breaking change which fixes an issue)
• [X] New feature (non-breaking change which adds functionality)
• [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected - these changes will not be merged until major releases!)

How Has This Been Tested?

Tests not added.

Checklist:

• [ ] My PR has a descriptive title
• [ ] My code follows PEP8
• [ ] I have performed a self-review of my own code
• [ ] I have commented my code, particularly in hard-to-understand areas
• [ ] I have made corresponding changes to the documentation
• [ ] My changes generate no new errors
• [ ] I have added tests that prove my fix is effective or that my feature works
• [ ] My PR passes Travis CI tests
• [ ] My PR does not reduce coverage in Codecov

If your PR does not fulfill all of the requirements in the checklist above, that's OK! Just prepend [WIP] to the PR title until they are all satisfied. If you need help, @-mention a maintainer and/or add the Status: Help Needed label.

[codecov[bot]]

Codecov Report

Merging #400 into dev will decrease coverage by 1.19%. The diff coverage is 5.88%.

@@            Coverage Diff             @@
##              dev     #400      +/-   ##
==========================================
- Coverage   56.45%   55.25%   -1.20%     
==========================================
  Files          81       82       +1     
  Lines        6983     7152     +169     
==========================================
+ Hits         3942     3952      +10     
- Misses       3041     3200     +159     

Impacted Files	Coverage Δ
solaris/eval/scot.py	4.16% <4.16%> (ø)
solaris/eval/challenges.py	63.09% <12.00%> (-21.66%)	:arrow_down:
solaris/eval/__init__.py	100.00% <100.00%> (ø)
solaris/nets/transform.py	62.90% <0.00%> (+0.80%)	:arrow_up:

---

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update c087902...5b0b22c. Read the comment docs.