Project-MONAI / MONAI

AI Toolkit for Healthcare Imaging
https://monai.io/
Apache License 2.0
5.49k stars 1.01k forks source link

MONAI Geometric Workflow #7816

Open vikashg opened 3 weeks ago

vikashg commented 3 weeks ago

Is your feature request related to a problem? Please describe. An end to end use case for MONAI Geometric workflows Describe the solution you'd like If we are considering a pipeline which will have the most impact on the MONAI Community and will draw more attention to the work we are doing, it will be adding a detection pipeline. The way I envision it is that we can make a big claim in the next release that "MONAI now supports Detection workflows". Some of the use cases for detection are

These use cases are generally 2D in nature and just by the default nature of the annotation tools being used and the public dataset available, two things happen

  1. These image data is generally in JPEG format
  2. The annotations are by default recorded in image space at subpixel accuracy. This means that the World Coordinate System and the Image Index system share the same default origin (0, 0) and image spacing (1, 1). Further, the annotation might be recorded as (12.32, 24.67) instead of (12, 24). The annotation do not generally snap to the closest index.

Additional context We should develop a pipeline based on Microsoft coco object detection dataset. We should have no problems building this out on MONAI frameworks as we can load JPEG images using our LoadImage function. Once we build the pipeline we can replace the JPEG image with our medical JPEG images.

vikashg commented 2 weeks ago

https://github.com/Project-MONAI/MONAI/blob/dev/monai/apps/detection/transforms/box_ops.py

vikashg commented 2 weeks ago

Another example from @ericspod https://github.com/Project-MONAI/model-zoo/tree/dev/models/valve_landmarks