mapbox / gabbar

Guarding OpenStreetMap from harmful edits using machine learning
MIT License
19 stars 7 forks source link

Regression test suite for automated testing #50

Closed bkowshik closed 7 years ago

bkowshik commented 7 years ago

Per http://machinelearningmastery.com/deploy-machine-learning-model-to-production/

Develop Automated Tests For Your Model

Write regression tests for your model.

  • Collect or contribute a small sample of data on which to make predictions.
  • Use the production algorithm code and configuration to make predictions.
  • Confirm the results are expected in the test.

We could start with a 2x manually verified dump of 100 changesets that contains:


cc: @anandthakker @geohacker @batpad

bkowshik commented 7 years ago

Todo

Changesets