Production Training Cycle for 2.14

[alexshepard]

• [x] pick a data export and bless as release version
• [x] do same with taxon range evals
• [x] download export and taxon range files
• [x] delete unneeded photos from previous training run
• [x] download validation photos
• [x] download training photos
• [ ] make cleaned train and validation exports
• [ ] train CV model
• [ ] train geo model
• [ ] make thresholds for geomodel
• [ ] evaluate geomodel & thresholds using taxon range eval files
• [ ] evaluate models against previous release
• [ ] share models, thresholds, eval metric CSV artifacts to smilax NFS drive
• [ ] release to staging
• [ ] discuss with team approval to release
• [ ] release publicly
• [ ] write & publish announcement blog post

[alexshepard]

using vision-export-20240512050009-aka-2.14 as the data export

[alexshepard]

90,290 leaf taxa, 50,139,307 training images

[alexshepard]

early estimate is 33 days of training which would be June 22

[alexshepard]

wandb run info is https://wandb.ai/inaturalist/iNat%20CV/runs/cyep14bt