Add Seam Carving preprocessing layer

keras-team / keras-cv

Industry-strength Computer Vision workflows with Keras

Other

1k stars 332 forks source link

Add Seam Carving preprocessing layer #707

Closed innat closed 1 year ago

innat commented 2 years ago

Short Description

Seam Carving: A Content-Aware Image Resizer

Papers

Paper-link. Citation: 2242

Existing Implementations

https://github.com/yu4u/seam-carving

Other

Maybe!

tf.keras.layers.Resizing(interpolation=seam_carving)

tanzhenyu commented 1 year ago

@innat can you help us verify how this augmentation would help some of our main downstream tasks? (detection / segmentation)

innat commented 1 year ago

@tanzhenyu I raised this ticket as a image processing layer (KPL). Mostly inspired from this application https://www.kaggle.com/code/ren4yu/mayo-clinic-removing-background-via-seam-carving.

In terms of detect/seg, I don't know any strong proof (citation) of applying this processing layer into those application. But it may be helpful by reducing no-object background processing in terms of time and space complexity.