pysat / pysatNASA

pysat support for NASA Instruments
BSD 3-Clause "New" or "Revised" License
21 stars 6 forks source link

BUG: de2 vefi load #217

Closed jklenzing closed 11 months ago

jklenzing commented 11 months ago

Description

Addresses #211

Deprecates the combined vefimagb data product under de2_vefi, replaces with new de2_vefimagb instrument module.

This product contains multiple time indices, the new instrument allows users to choose which one to load. For the deprecated version, only the mag data is kept to tentatively solve the issue raised in #211.

Type of change

How Has This Been Tested?

    import datetime as dt
    import pysat

    # Set electric field instrument
    vefi = pysat.Instrument(platform='de2', name='vefimagb', tag='e')
    vefi.download(dt.datetime(1983, 1, 1))

    # Set magnetic field instrument
    mag = pysat.Instrument(platform='de2', name='vefimagb', tag='b')

    # Both instruments can be loaded from the same download
    vefi.load(1983, 1)
    mag.load(1983, 1)

Test Configuration:

Checklist:

If this is a release PR, replace the first item of the above checklist with the release checklist on the wiki: https://github.com/pysat/pysat/wiki/Checklist-for-Release

aburrell commented 11 months ago

pysatnasa_de2_vefimag_needs_cleaning

It looks like there needs to be some data cleaning implemented, since this is supposedly 'clean'.

jklenzing commented 11 months ago

It looks like there needs to be some data cleaning implemented, since this is supposedly 'clean'.

or maybe a warning? Cleaning is only based on fill vals.

aburrell commented 11 months ago

Looking at the data some of those are clearly fill values, they just aren't recognized by the clean method.

jklenzing commented 11 months ago

Looking at the data some of those are clearly fill values, they just aren't recognized by the clean method.

The fill vals are improperly set. Adding a warning. There are set to 0 in the meta, clearly 1e7.