search

inaturalist / iNaturalistMLWork

0 stars 0 forks source link

estimate scaling metrics for NL search #48

Open alexshepard opened 4 months ago

alexshepard commented 4 months ago

How much storage and compute is required to make an NL search tool that would work across all of the photos in iNat? Have to account for new data ingestion, number of queries, etc. Can we afford to do this?

alexshepard commented 3 months ago

Ops rightly said we can't really estimate this without understanding product requirements so I tried to gather thoughts in a google doc in the shared drive.