Run Mega (lodon) detector on new images to add proposals for complete coverage

fathomnet / community-feedback

0 stars 0 forks source link

Run Mega (lodon) detector on new images to add proposals for complete coverage #20

Open hohonuuli opened 2 years ago

hohonuuli commented 2 years ago

Do we want to add the proposals to fathoment? Or just run metrics to compare the submitted images?

We haven't created this uber mega detector yet ....

hohonuuli commented 2 years ago

TODO: Setup meeting to design/implement coverage augmentation in FathomNet @kakanikatija @lonnylundsten @BGWoodward

hohonuuli commented 2 years ago

From our 2022-01-25 Meeting:

@BGWoodward will put together a docker container with a service where we can POST images and get bounding box proposals back as JSON. Expected turnaround for an image is on the order of a 1 second-ish.
@hohonuuli Will put together:
1. the wiring to submit un-analyzed images to the service and grab the results
2. do analysis to compare the results to the coverage provided in the images, (Intersection over union)
3. Add the % coverage of annotations as a tag to the image in FathomNet. % coverage is basically the number of proposed annotations vs the number of actual annotations. @kevinsbarnard may work on this too.

hohonuuli commented 2 years ago

Discussion of our goals for full coverage are on MBARI's slack channel here.

kakanikatija commented 2 years ago

*megalodon

hohonuuli commented 2 years ago

@BGWoodward Hey, your predictor's response has output like the snippet below. Can you change it so that bbox is not a string but an array of number values instead(like scores)?

  {
      "bbox": "[1044.992431640625, 111.13956451416016, 1063.755126953125, 128.82638549804688]",
      "category_id": "Anemone",
      "scores": [
          0.24541693925857544
      ]
  }

hohonuuli commented 2 years ago

@BGWoodward p.s. Requiring a trailing slash on the URL endpoint was a subtly evil touch. ;-)

BGWoodward commented 2 years ago

I think I can do that. I'll double check there wasn't a reason they were a string (I can't think of one off the top of my head. re: the trailing slash, I think that was inherited from the fastapi template I based this off of. I can change that too. I'd like to take credit for being just devious enough to do that on purpose, but alas, I am not

hohonuuli commented 2 years ago

LOL, I was tearing my hair out for about 30 minutes ... then I noticed the slash. Well played. You're the reason I'm drinking tonight.

hohonuuli commented 2 years ago

BTW, no need to remove the slash now. I KNOW it's there.

hohonuuli commented 1 year ago

Related to #23