Kitware / dive

Media annotation and analysis tools for web and desktop. Get started at https://viame.kitware.com
https://kitware.github.io/dive
Apache License 2.0
83 stars 21 forks source link

Image Formatting Pipelines #1453

Open BryonLewis opened 2 weeks ago

BryonLewis commented 2 weeks ago

Add support for image formatting pipelines to the Desktop version of DIVE.

The current pipeline running is located: https://github.com/Kitware/dive/blob/main/client/platform/desktop/backend/native/viame.ts#L34

We need to modify the filter for the pipeline list to allow these other types of Pipelines. The Pipeline list is retrieved here: https://github.com/Kitware/dive/blob/main/client/platform/desktop/backend/native/common.ts#L345 This would have to modified to probably provide a new category of pipelines for 'image modifications' or named something similar.

The process of running the pipeline will no longer require annotations but will take only an image-sequence and perform modifications. The output logic may be slightly different than the existing pipelines but for now just allow it to output the files to the processing directory. Similar to current pipelines you can open the output director to see what is created. This is called the workdir in the job interface.

For the initial version just worry about getting the processed images out. In the future we may want to modify it so it creates a new dataset with the updated images and imports it into the system. Start with the basic way of getting output first.

BryonLewis commented 2 weeks ago

@mattdawkins Can we get a list of image formatting pipelines you would like to see in DIVE Desktop? Any examples would be helpful as well.

mattdawkins commented 1 week ago

All pipelines which filter images or videos and produce new images have the filter_*.pipe name formatting in the VIAME pipelines folder (https://github.com/VIAME/VIAME/tree/main/configs/pipelines), two of importance would be filter_enhance and filter_draw_dets

There are also transcode pipelines given by transcode_*.pipe - these produce video files as output instead of images, but are also relevant here and related