search

terraref / computing-pipeline

Pipeline to Extract Plant Phenotypes from Reference Data
BSD 3-Clause "New" or "Revised" License
24 stars 13 forks source link

Recover missing scanner 3d height data using stereo image #330

Open ZongyangLi opened 7 years ago

ZongyangLi commented 7 years ago

Scanner 3d data from 2016-10-10 to 2016-11-04 is missing, I and @pless tried to recover height data using stereo image.

Normal 3d data: normal_3d_data

Missing points data: missing_data

Height Plot created by @rmgarnett

height_data_from_scanner3d

The idea is using stereo image to rebuild the 3d model. I will skip all the details, here is the result:

  1. 3d model from laser scanner and reconstruct 3d model from stereo camera: screen shot 2017-04-26 at 10 27 14 amscreen shot 2017-04-25 at 5 16 43 pm

  2. Height histogram comparison, the blue one is laser scanner and the red one comes from stereo camera: 1626_plot

  3. Correlation between two data set is around 85%: 0 89

  4. Height histogram in one plot comparison: only laser scanner plot: heat_647 only-laser

add stereo 3d model: heat_647 merged

We had generated available stereo height result for season 2. Maybe this method can be deploy as another height dataset extractor for our program.

ZongyangLi commented 7 years ago

@max-zilla Could you please create another directory in https://github.com/terraref/extractors-stereo-rgb, and I will upload my files there.

max-zilla commented 7 years ago

@ZongyangLi created a "height_recovery" directory

ghost commented 7 years ago

@ZongyangLi please update this issue

ghost commented 7 years ago

@craig-willis - please advise where to store calibration reference images

ghost commented 7 years ago

the two height extractors should run in parallel - missing data should not be replaced by data from other extractor

Automating the identification of bad data within the extractor can help with this. Bad data could be flagged or deleted.

ZongyangLi commented 6 years ago

@max-zilla Please take a look at: https://github.com/terraref/extractors-stereo-rgb/pull/38

We might have to initial a time to work together for the deployment.