search

locationtech / rasterframes

Geospatial Raster support for Spark DataFrames
http://rasterframes.io
Apache License 2.0
246 stars 45 forks source link

Support Sparklyr #109

Open harryprince opened 5 years ago

harryprince commented 5 years ago

Hi RasterFrames team: Wish rasterframes could support sparklyr R package for more data scientists, and integrate well with stars R package.

https://github.com/rstudio/sparklyr/issues/1966

metasim commented 5 years ago

@harryprince Thanks for the ticket and interest. To be honest, I'm not really sure what I'd have to do to add RasterFrames support to R.... I based the Python integration on other examples I found out there, namely GeoMesa. Do you know of any other R packages that rely on UDTs that might serve as an example? We'd likely need to add support to GeoMesa as well.

harryprince commented 5 years ago

@metasim, geospark R package is pretty similar to rasterframes, which handle the vector geospatial data as a sparklyr plugin. And integrate a spark package is pretty easy in R with sparklyr and dbplyr mechanism.

Here is geospark example, which support SQL mode and R mode in a very easy way for developer.

metasim commented 5 years ago

@harryprince Thanks! We'll have to look into it.