hobuinc / usgs-lidar

AWS Entwine Point Tiles USGS LiDAR Public Dataset GitHub repo
https://registry.opendata.aws/usgs-lidar/
141 stars 14 forks source link

================================================================================ USGS 3DEP LiDAR Point Clouds

.. contents:: Contents :depth: 2

Project Description

This AWS Public Dataset project is about processing the USGS 3DEP LiDAR point cloud data into a form that is cloud-friendly, streamable, lossless, and convenient.

The main landing page on AWS for the project is at https://registry.opendata.aws/usgs-lidar/

Public 3DEP LiDAR data is available in two forms on AWS:

  1. A Requester Pays <https://docs.aws.amazon.com/AmazonS3/latest/dev/RequesterPaysBuckets.html>_ bucket at s3://usgs-lidar containing many of the USGS resources available as full-density LASzip tiles

  2. A public access bucket at s3://usgs-lidar-public containing EPT resources mirroring many (but not all) of the resources in #1.

Entwine ................................................................................

A description of the EPT format, which is a hierarchical format arranged by progressive level-of-detail, is contained at https://entwine.io/entwine-point-tile.html. EPT was chosen as the service mechanism for this data due to its scalability potential to trillions of points, flexibility, and its ease of use via open source infrastructure like PDAL, LASzip, Potree, and Plasio.js_.

To generate EPT datasets for your own data with Entwine, visit the quickstart <https://entwine.io/quickstart.html> and browse the configuration documentation <https://entwine.io/configuration.html> for more advanced usage.

Processing ................................................................................

Data processing with Entwine_ was performed on AWS EC2 c5d.9xlarge instances using S3 <https://aws.amazon.com/s3/>__ for output storage. Currently, there are more than 10 trillion LiDAR points available in over 950 distinct resources.

Visualization ................................................................................

The point cloud data may be visualized with Potree or Plasio.js via the index at http://usgs.entwine.io.

Coordinate System ................................................................................

The EPT data is accessible via EPSG:3857 <https://epsg.io/3857> for ease of web usage - with PDAL the data can be reprojected on the fly with the reprojection filter <https://pdal.io/stages/filters.reprojection.html> which can be used in combination with other processing pipeline stages.

The EPT reader <https://pdal.io/stages/readers.ept.html>_ within PDAL may also be used to select areas of data for use locally.

Resource Links

.. readers.ept: https://pdal.io/stages/readers.ept.html .. Potree: http://potree .. _Plasio.js: https://github.com/hobu/plasio.js

Support

Thank you to the multiple organizations that have supported the development of the USGS 3DEP LiDAR dataset.

USACE CRREL ................................................................................

.. image:: ./images/rsgis_logo.png :target: http://www.erdc.usace.army.mil/Locations/CRREL.aspx :scale: 30%

The US Army Corps of Engineers Remote Sensing / GIS Center of Expertise at CRREL sponsored the processing and development of the AWS 3DEP Public Dataset in multiple ways. First, it sponsored the development and continuing support of PDAL and Entwine open source software libraries, which were used to process and manage the data. Second, it supported the processing and management of the 3DEP data to an Entwine Point Tiles_ public dataset.

Amazon Web Services Public Datasets Team ................................................................................

.. image:: https://d0.awsstatic.com/logos/powered-by-aws.png :target: https://registry.opendata.aws :scale: 30%

The AWS Public Datasets Team supported the effort by providing processing and storage grants for the development of the EPT_ data and ongoing support by making access to that data publicly available.

Hobu, Inc. ................................................................................

.. image:: ./images/hobu-logo-2C-white.png :target: https://hobu.co :scale: 30%

Connor Manning from Hobu, Inc. constructed the 3DEP EPT resources with cloud processing and management tools from Hobu, Inc._.

.. Connor Manning: http://github.com/connormanning/ .. Hobu, Inc.: https://hobu.co .. Entwine: https://entwine.io .. PDAL: https://pdal.io .. _CRREL: https://www.erdc.usace.army.mil/Locations/CRREL.aspx

.. Entwine Point Tiles: https://entwine.io/entwine-point-tile.html .. EPT: https://entwine.io/entwine-point-tile.html .. _LASzip: https://laszip.org

.. _AWS 3DEP Public Dataset: https://registry.opendata.aws/usgs-lidar/