ropensci / unconf17

Website for 2017 rOpenSci Unconf
http://unconf17.ropensci.org
64 stars 12 forks source link

R package to retrieve NASA datasets 🛰 #67

Open jimhester opened 7 years ago

jimhester commented 7 years ago

Basically an R port of https://github.com/bmtgoncalves/pyNASA, seems a pretty natural fit for rOpenSci

stefaniebutland commented 7 years ago

Calling all #NASADatanauts! @jasdumas @ldecicco-USGS @AmeliaMN @eringrand @LucyMcGowan

LucyMcGowan commented 7 years ago

yes! this has been on my todo list probably pulling from here: https://data.nasa.gov/browse?limitTo=datasets 🚀

eringrand commented 7 years ago

Yes!

Apologies for any typos.

On Apr 30, 2017, at 2:16 PM, LucyMcGowan notifications@github.com wrote:

yes! this has been on my todo list probably pulling from here: https://data.nasa.gov/browse?limitTo=datasets 🚀

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

ldecicco-USGS commented 7 years ago

Yeah, I've been looking for a way to contribute, and this is a natural fit. I've led a similar effort for USGS data (sorry for the non-unique package name...):

https://github.com/USGS-R/dataRetrieval

I can try to contribute my experience of what has worked well in that package (...and what didn't!)

d4tagirl commented 7 years ago

I'm not going to the Unconf but I've been talking about collaborate with this with @bmtgoncalves. Is there a way that I can be involved?

stefaniebutland commented 7 years ago

@d4tagirl A couple of people have participated in the unconf remotely in the past. The key would be good communication with the project team, using something like https://appear.in/ for video chat.

d4tagirl commented 7 years ago

I'll stay tuned then, thank you!!

alisonboyer commented 7 years ago

I am on board! I work at a NASA data center (https://daac.ornl.gov/ ) and we could start here for the Earth science data: https://cmr.earthdata.nasa.gov/opensearch/ I would also like to talk about packages to retrieve actual data (as opposed to metadata) using webservices such as OPeNDAP. we could start here: https://thredds.daac.ornl.gov/thredds/catalogs/ornldaac/ornldaac.html

cvitolo commented 7 years ago

Count me in for this! @alisonboyer, I agree retrieving actual data would be even more interesting

maelle commented 7 years ago

I had started working on this package interfacing the NASA API of MODIS Level 1 and Atmosphere data products. Not sure how much it overlaps with other datasets presented here, maybe not at all? In any case, if anyone is interested, I can move it to ropenscilabs for the unconf.

alisonboyer commented 7 years ago

@maelle Your LAADS package looks cool. This is exactly the type of package that we need. The MODISTools package was my inspiration, and I think we need multiple packages to hit different data.

maelle commented 7 years ago

Cool, happy to collaborate! MODISTools has a slightly misleading name IMO since it doesn't hit all MODIS data 😊

mdsumner commented 7 years ago

We use raadsync to download data from a variety of sources via different methods (mostly wget) and includes remote sensing files from the NASA ocean colour website:

https://github.com/AustralianAntarcticDataCentre/raadsync

It's not polished sufficiently for general use but it's not hard to set up and it's proven to work very well - we'd appreciate any feedback or interest in it. We register datasets in JSON with the information required about how to discover new/changed files, the download method, whether unpacking is required after download.

sckott commented 7 years ago

@alisonboyer regarding opendap, been trying to get an opendap client dappr https://github.com/ropensci/dappr to a useable state for a while - could be part of this

alisonboyer commented 7 years ago

@sckott nice! yes, that is a good idea

alisonboyer commented 7 years ago

i'm so sorry to miss the unconf this year. If you all decide to pursue this topic will you loop me in via video chat? I really would love to contribute

bmtgoncalves commented 7 years ago

Hi everyone (and @jimhester and @d4tagirl in particular)

Thank you for the interest in pyNASA. While I'm fairly comfortable using R, I've never tried writing a package. If there's anything I can do to help, just let me know!

Best

B