search

spedas / pyspedas

Python-based Space Physics Environment Data Analysis Software
https://pyspedas.readthedocs.io/
MIT License
147 stars 58 forks source link

Support direct dataset loading #770

Open Beforerr opened 6 months ago

Beforerr commented 6 months ago

For example, magplasma dataset for STEREO is located in CDAWEB with link https://spdf.gsfc.nasa.gov/pub/data/stereo/ahead/l2/impact/magplasma/1min/ and it could not be loaded by stereo module right now.

Right now PySPEDAS loading logic is like mission->instrument->datatype&level it would be nice to directly support loading dataset with logic like mission->dataset for dataset combined from multiple instrument. Also it might be possible that some dataset combine multiple mission, then the logic would be like dataset -> ....

Beforerr commented 6 months ago

Another idea is to make a dataframe/table to match keyword to remote file link. So the user could specify some keyword to uniquely match the remote link (fuzzy matching might be useful also)

| dataset | mission | instrument | level | doi | spase id | other keywords | remote link| 
...

Related to #613