pysat / pysatNASA

pysat support for NASA Instruments
BSD 3-Clause "New" or "Revised" License
21 stars 7 forks source link

GUVI #138

Closed landsito closed 1 year ago

landsito commented 1 year ago

Support for TIMED-GUVI L1C intensity datasets.

Description

Spectrograph and imaging sensors handled by inst_id, and resolutions handled by tags of high and low.

Addresses # (issue) -Added platform TIMED and instruments for GUVI L1C datasets. -Methods of load and download included and tested. -cdaweb was improved to consider cases found in GUVI:

Type of change

How Has This Been Tested?

It was tested following pysat guidelines using pytest -vs -flake8 pysatNASA

Test Configuration

Checklist:

jklenzing commented 1 year ago

Adding a note to my self. Testing the default pysat.utils.io.load_netcdf as a possible alternative to loading.

data, meta = pysat.utils.io.load_netcdf(fnames, pandas_format=False, epoch_name='TIME_EPOCH_DAY', decode_times=True)

This works for a single file, but for a list of files (required for GUVI), I get

ValueError: Could not find any dimension coordinates to use to order the datasets for concatenation

from xarray. It's possible we can pass through a list of coords or other options to fix this in the xarray interface, but would require some updates on the pysat side. https://docs.xarray.dev/en/stable/generated/xarray.open_mfdataset.html

jklenzing commented 1 year ago

Hmm. It looks like there's still a whitespace issue in the style check. See feedback here: https://github.com/pysat/pysatNASA/actions/runs/3678408300/jobs/6221630783

It looks like there have been some issues with the comment system for modifying code. @landsito, it might be easier if you update the last two lines on your machine and push.

Bringing @rstoneback and @JonathonMSmith into the conversation. The code is working locally, but needs some updates to metadata. Should we fix that in this branch or merge and work on that in develop. Could be easier for the team to help update things from a single branch. Any preferences on how to proceed?

rstoneback commented 1 year ago

If you think the final steps would be easier in develop that is ok with me.

landsito commented 1 year ago

Thanks @jklenzing and @rstoneback. I made the change that seems to be needed but not sure if this is actually helpful. hopefully it will work now. Let me know how else I can help.

jklenzing commented 1 year ago

Thanks @landsito. I caught another typo in my updates and sorted that out. The code is running fine locally, but failing here due to a new numpy release. Let's plan to chat in the new year at one of the upcoming developer meetings. I'll pull together some more notes and ping you offline.

aburrell commented 1 year ago

It looks good! 😀 🚀