terraref / computing-pipeline

Pipeline to Extract Plant Phenotypes from Reference Data
BSD 3-Clause "New" or "Revised" License
23 stars 13 forks source link

refactor laser3D extractor #405

Closed dlebauer closed 6 years ago

dlebauer commented 6 years ago

Following from https://github.com/terraref/computing-pipeline/issues/338

We want to move science functionality that currently exists in https://github.com/terraref/extractors-3dscanner into the new https://github.com/terraref/scanner_3d repository

Singularity container for lastools: https://groups.google.com/forum/#!topic/lastools/TqQxc40EbAo/discussion (which requires Wine)

Here is the proposed workflow; it can be edited here:

image

query BETYdb for intersecting plots 
for each plot 
  find all intersecting las files
  lasclip to plot
  lasmerge to single file
  las2dem elevation raster geotiff file (digital elevation model or dem)
  las2dem -slope an angle raster geotiff file.

for each plot 
  find angle.tiff 
  read in values as vector
  compute sample, histogram, mean, sd, neff, other stats
  insert mean, sd, neff, theta, ... into BETYdb
  insert same + sample of 1000 and histogram into geostreams
  create summary figures as thumbnails in clowder for QA/QC. 

Code to compute leaf angle parameters is in https://github.com/terraref/computing-pipeline/issues/338#issuecomment-357304136

To identify data levels refer to documentation: https://terraref.gitbooks.io/terraref-documentation/content/data-product-creation.html

dlebauer commented 6 years ago

@jterstriep you mentioned using a python interface or equivalent of lastools. I found laspy but not equivalent functions for lasclip, lasmerge, or las2dem. Any suggestions?

weiqin61 commented 6 years ago

https://github.com/terraref/canopy_height Here is the package for canopy_height

max-zilla commented 6 years ago

We want to look at using other libraries e.g. laspy

max-zilla commented 6 years ago

@weiqin61 perhaps look at one of our merged LAS files and see if we can use laspy las2dem to generate an angle map/heightmap.

dlebauer commented 6 years ago

@weiqin61 could you give an update on the progress with this?

max-zilla commented 6 years ago

waiting on https://github.com/terraref/computing-pipeline/issues/460 to finalize.

max-zilla commented 6 years ago

both ply2las and heightmap are deployed and the science package update was pushed. https://github.com/terraref/laser3d/pull/11