Production Training Cycle for 2.13

[alexshepard]

• [x] pick a data export and bless as release version
• [x] do same with taxon range evals
• [x] download export and taxon range files
• [x] delete unneeded photos from previous training run
• [x] download validation photos
• [x] download training photos
• [x] make cleaned train and validation exports
• [x] train CV model
• [x] train geo model
• [x] make thresholds for geomodel
• [x] evaluate geomodel & thresholds using taxon range eval files
• [x] evaluate models against previous release
• [x] share models, thresholds, eval metric CSV artifacts to smilax NFS drive
• [x] release to staging
• [x] discuss with team approval to release
• [x] release publicly
• [x] write & publish announcement blog post

[alexshepard]

using export vision-export-20240331050014-aka-2.13

[alexshepard]

geomodel evaluation statistics: PR-AUC: 0.713 Precision: 0.663 Recall: 0.696 F1: 0.632

[alexshepard]

48,710,336 training images 88,517 taxa

[alexshepard]

wandb for CV run is here: https://wandb.ai/inaturalist/iNat%20CV/runs/we2eq8sm

[alexshepard]

office machines shut down in the wee hours of April 22 after reboot, morbo only saw one of the two GPUs installed training on hold until we can work on the hardware

[alexshepard]

training running again as of 4/24 mid day