inaturalist / iNaturalistMLWork

0 stars 0 forks source link

dual headed training for mobile and web #7

Open alexshepard opened 8 months ago

alexshepard commented 8 months ago

can we avoid having to train two separate models for both the mobile apps and the website? instead we could share a feature extractor, with one head factorized & therefore smaller for mobile, and another head unfactorized and therefore slightly more accurate. this should make it easier to keep web and mobile models in sync and reduce overall training time.

alexshepard commented 8 months ago

we used to do this with grant's TF-slim code.

I couldn't get it multi-head models to export correctly in the early days of TF2, worth trying again.