terraref / computing-pipeline

Pipeline to Extract Plant Phenotypes from Reference Data
BSD 3-Clause "New" or "Revised" License
23 stars 13 forks source link

Improving Image quality from illumination, contrast, noise, and color aspects #562

Closed Paheding closed 5 years ago

Paheding commented 5 years ago

Title: Improving Image quality from illumination, contrast, noise, and color aspects.

Description

This extractor is designed to improve the RGB image (Gantry or UAS imaging systems) quality in term of visualization from four different aspects: illumination, contrast, noise, and color.

Input : RGB or grayscale image Output : Enhanced image

Suggestion

This extractor can be combined with RGB image quality extractor. Whenever the image quality score is lower the expected value, this image enhancement algorithm can be triggered and apply to the raw input image.

Workflow

image

Details

Due to the limitations of UAS (unmanned aerial system) or other imaging devices, image enhancement has become a necessary process for improving the visual appearance images. Although a great amount of effort has been focused on improving image quality from different aspects, the major obstacles are from computational or operational efficiency and complexity, such as manually adjusting the associated camera settings or algorithmic parameters that account for various image luminance or signal-to-noise ratio. To overcome these drawbacks, we propose a new adaptive yet highly efficient image enhancement method for enhancing the quality of digital color images in terms of illumination, contrast, color and signal-to-noise ratio. The proposed method is derived from a trigonometric transformation, high frequency boosting functions, wavelet transform, and a color restoration process whose characteristics adaptively change with respect to the variation of the image luminance, contrast, color and noise level.

Completion Criteria

FOR A FEATURE REQUEST

Related publication: Sidike, P., Sagan, V., et al. (2018). Adaptive trigonometric transformation function with image contrast and color enhancement: Application to unmanned aerial system imagery. IEEE Geoscience and Remote Sensing Letters, 15(3), 404-408.

max-zilla commented 5 years ago

I sent email to @ZongyangLi and @Paheding with some questions:

How similar is this to GAN enhancement code Zongyang has worked on that was part of the work that led to soil mask extractor?

Will this affect the RGB soil mask extractor at all? (I doubt it)

Patrick proposed running this only on RGB images below a certain quality threshold – do we know what that threshold should be?

Should this be done before other steps?

Paheding commented 5 years ago

@max-zilla Good questions. The proposed image enhancement was designed to improve RGB or grayscale image in terms of illumination, noise, and contrast.

max-zilla commented 5 years ago

Zongyang recommends keeping these enhancement methods separate for now.

max-zilla commented 5 years ago

This extractor is complete and has been run on a small number of test datasets. Plan to try to run on the sample RGB data later this week.

https://terraref.ncsa.illinois.edu/clowder/datasets/5c5ad0a64f0c7047afc4ce79 - 2018-06-0409-22-54-963 https://terraref.ncsa.illinois.edu/clowder/datasets/5b1ca2564f0c64f929c68bfa - 2018-06-0810-14-12-277