landam / grass-gis-git-migration-test

0 stars 0 forks source link

r.what: remove 400 maps limit and add some new output options #145

Open landam opened 5 years ago

landam commented 5 years ago

Reported by sbl on 28 Jan 2015 14:27 UTC r.what is currently the most efficient tool for sampling (single) STRDS at point locations. Usage of r.what for space time data sets however is hampered by the current limit of 400 maps. Would be nice if that limit could be overcome. Memory may be an issue in case of thousands of maps?

See discussion on the mailinglist: http://thread.gmane.org/gmane.comp.gis.grass.devel/62452/focus=62472

In that context also an option/flag to choose between vertical and horizontal output would be useful (columns for thousands of maps will probably trouble spread sheet software).

Finally, when using a vector map as input it would be nice if the category (or content from another column) could be written into the "site name" column of the output, so a resulting table can be linked more easily to the original data.

GRASS GIS version and provenance

svn-trunk

Migrated-From: https://trac.osgeo.org/grass/ticket/2564

landam commented 5 years ago

Comment by huhabla on 28 Jan 2015 23:16 UTC I have just committed a new temporal module called t.rast.what in trunk (https://trac.osgeo.org/grass/changeset/64349 - https://trac.osgeo.org/grass/changeset/64351) that utilized r.what to sample space time raster datasets using vector points. It provides three output layouts that transforms the r.what output into row or column layouts. It can run several r.what processes in parallel using a maximum of 400 raster map layer in a single r.what process.

Please have a look at it.

Any feedback about its performance, usefulness and handling is highly welcome.

Improving r.what to allow more than 400 maps is simple, just edit the fixed value in the source. But, editing this value may cause open file handler limit problems with your OS. However, these limits can be adjusted at kernel level configuration for Linux.

Implementing a more intelligent file handling solution requires more effort.

landam commented 5 years ago

Comment by neteler on 8 Dec 2015 08:50 UTC See also #1

landam commented 5 years ago

Comment by huhabla on 9 Dec 2015 09:19 UTC I would like to see a PyGRASS implementation of r.what that is easier to maintain. Especially the database handling in PyGRASS is much, much easier than in C. However, PyGRASS supports only sqlite and postgresql as backends, since it fully ignores the GRASS database library and uses Python bindings.

I have implemented a simple prototype to sample a space time raster dataset with vector points, that allows to have a vector attribute table column as identifier of the points in the output. It is slower than t.rast.what but a good example of what can be done using PyGRASS and the temporal framework.

https://bitbucket.org/huhabla/temporal-raster-sampling/overview

landam commented 5 years ago

Comment by neteler on 5 May 2016 14:08 UTC Milestone renamed

landam commented 5 years ago

Comment by neteler on 28 Dec 2016 15:04 UTC Ticket retargeted after milestone closed

landam commented 5 years ago

Modified by @landam on 5 May 2017 20:40 UTC

landam commented 5 years ago

Comment by @landam on 1 Sep 2017 20:28 UTC All enhancement tickets should be assigned to 7.4 milestone.

landam commented 5 years ago

Comment by neteler on 26 Jan 2018 11:40 UTC Ticket retargeted after milestone closed

landam commented 5 years ago

Modified by neteler on 12 Jun 2018 20:48 UTC

landam commented 5 years ago

Comment by @landam on 25 Sep 2018 16:51 UTC All enhancement tickets should be assigned to 7.6 milestone.

landam commented 5 years ago

Comment by @landam on 25 Jan 2019 21:07 UTC Ticket retargeted after milestone closed