GeoGraph provides a tool for analysing habitat fragmentation and related problems in landscape ecology. GeoGraph builds a geospatially referenced graph from land cover or field survey data and enables graph-based landscape ecology analysis as well as interactive visualizations.
Purpose: we need to setup a rigurous framework to evaluate relative model performance. Whilst we create "metrics", these are part of the model and cannot be directly used to evaluate relative performance between models. How can evaluate models relative to each other? How do we know a model is "good"?
Possible evaluation methods:
Create simple test cases (as in papers such as Fahrig 2003), e.g two circles with increasing distance. See issue #10.
Pick a metric with ground truth (e.g. average patch size), and evaluate with respect to that ground truth.
What else?
TODOs:
Check how relative comparison is done in other papers
Croydon-Brixton
commented
3 years ago
Purpose: we need to setup a rigurous framework to evaluate relative model performance. Whilst we create "metrics", these are part of the model and cannot be directly used to evaluate relative performance between models. How can evaluate models relative to each other? How do we know a model is "good"?
Possible evaluation methods:
TODOs: