NERC-CEH / plankton_ml

A project for image processing and analysis pipelines for plankton sampling
GNU General Public License v3.0
0 stars 1 forks source link

Modest proposal for running a model on the FlowCam directly #16

Open metazool opened 4 months ago

metazool commented 4 months ago

Lots of images and notes to add, but quick summary

Lot of effort into getting data and metadata off the instrument all oriented to bigger goals (data sharing, serving as a network repository for freshwater plankton, external partners for model development, etc) which isn't answering researchers' questions.

What are the odds of running a model directly on the FlowCam's OS with a trial and error approach to doing it?

  1. "hello world" proof of concept, can we build and run the simplest executable (cf the .Net work for the flow cytometer at Cefas for the build parts [add link here])
  2. usefully read some of the intermediate outputs, run python, bundle scikit-image, avoid more than minimal UI development
  3. run pytorch, model choice influenced by what will run on the hardware, no transformers etc. OR sustainable way of offering a short-term proxy to a model API during recording sessions, which could be on-prem (ongoing discussion about security options)