Read ACME test data - Githubissues

doutriaux1 commented 10 years ago

on aims1 ~williams13/test_data

try to read/plot all var in all files

aashish24 commented 10 years ago

@williams13 Just a reminder.. please share the data on figshare or dropbox.

williams13 commented 10 years ago

Can everyone get to the dropbox: https://www.dropbox.com/home/uvcdat-archive

There should be at least two files there now. One large ACME data set and one png generating file.

-Dean

From: Aashish Chaudhary notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Tuesday, September 16, 2014 9:40 AM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: Dean Williams williams13@llnl.gov<mailto:williams13@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

@williams13https://github.com/williams13 Just a reminder.. please share the data on figshare or dropbox.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-55772394.

ThomasMaxwell commented 10 years ago

Dean,

The b1850c5_t2_01_climo.nc data file that you posted is another CAM5 file which suffers from the same problem with missing time data as the CAM4 and CAM5 data that I've been looking at.    That is what's causing the pipeline errors in UVCDAT:

netcdf b1850c5_t2_01_climo { dimensions: time = 1 ; lat = 128 ; lon = 256 ; lev = 30 ; ncl4 = 1 ; ncl5 = 1 ; ncl6 = 1 ; ilev = 31 ; variables: double time(time) ; time:bounds = "time_bnds" ; time:calendar = "noleap" ; time:units = "days since 0001-01-01 00:00:00" ; time:long_name = "time" ; time:_FillValue = 9.96921e+36f ;

…

// global attributes: :case = "ne120_f02_t12_B1850c5" ; :source = "CAM" ; data:

time = _ ;

williams13 commented 10 years ago

This data is on the ESGF node at ORNL and Peter Caldwell is complaining that he cannot read all the data on ESGF with UV-CDAT. Is this something that we can solve to let users read the data?

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Tuesday, September 16, 2014 11:04 AM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: Dean Williams williams13@llnl.gov<mailto:williams13@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Dean,

The b1850c5_t2_01_climo.nc data file that you posted is another CAM5 file which suffers from the same problem with missing time data as the CAM4 and CAM5 data that I've been looking at. That is what's causing the pipeline errors in UVCDAT:

netcdf b1850c5_t2_01_climo { dimensions: time = 1 ; lat = 128 ; lon = 256 ; lev = 30 ; ncl4 = 1 ; ncl5 = 1 ; ncl6 = 1 ; ilev = 31 ; variables: double time(time) ; time:bounds = "time_bnds" ; time:calendar = "noleap" ; time:units = "days since 0001-01-01 00:00:00" ; time:long_name = "time" ; time:_FillValue = 9.96921e+36f ;

…

// global attributes: :case = "ne120_f02_t12_B1850c5" ; :source = "CAM" ; data:

time = _ ;

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-55786281.

doutriaux1 commented 10 years ago

@painter1 @williams13 where are we at on this one?

durack1 commented 10 years ago

While you're at it, the issue highlighted at https://github.com/UV-CDAT/uvcdat/issues/479 is probably also worth investigating..

doutriaux1 commented 9 years ago

@painter1 @williams13 can we close?

painter1 commented 9 years ago

I think we can close this. For the record, UV-CDAT can now read and plot all variables of interest in the test datafiles we tried. A script to do this may be found in https://github.com/UV-CDAT/staticView

ThomasMaxwell commented 9 years ago

Jeff, Are you able to read the ACME CAM datasets from http://esg.ccs.ornl.govhttp://esg.ccs.ornl.gov// with UVCDAT? I get a fatal error due to problems with the time axis. Here is a sample (downloaded today):

https://www.dropbox.com/s/oirv69p15c3ffpy/ne120_f02_t12_B1850a_01_climo.nc?dl=0

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Tuesday, October 7, 2014 5:42 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

I think we can close this. For the record, UV-CDAT can now read and plot all variables of interest in the test datafiles we tried. A script to do this may be found in https://github.com/UV-CDAT/staticView

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58267954.

painter1 commented 9 years ago

Yes, I just used the diags script to plot a sample variable from
your dropfox file; a plot is attached.

When did you download and install the diagnostics?  How did you run
the diagnostics?

The time axis in your sample file consists of one missing value. 
It's a sensible way to treat a climatology (although I prefer to
omit the time axis entirely).   I've tested on such data before.

- Jeff

On 10/9/14, 12:40 PM, Thomas Maxwell wrote:

  Jeff,

  Are you able to read the ACME CAM datasets from
  http://esg.ccs.ornl.gov<http://esg.ccs.ornl.gov/>/ with
  UVCDAT? I get a fatal error due to problems with the time axis.
  Here is a sample (downloaded today):

https://www.dropbox.com/s/oirv69p15c3ffpy/ne120_f02_t12_B1850a_01_climo.nc?dl=0

  -- Tom

  From: Jeffrey Painter
  <notifications@github.com<mailto:notifications@github.com>>

  Reply-To: UV-CDAT/uvcdat
  <reply@reply.github.com<mailto:reply@reply.github.com>>

  Date: Tuesday, October 7, 2014 5:42 PM

  To: UV-CDAT/uvcdat

uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.gov>

  Subject: Re: [uvcdat] Read ACME test data (#658)

  I think we can close this. For the record, UV-CDAT can now read
  and plot all variables of interest in the test datafiles we tried.
  A script to do this may be found in

  https://github.com/UV-CDAT/staticView

  —

  Reply to this email directly or view it on

GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58267954. — Reply to this email directly or view it on GitHub. {"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58565614","name":"View Issue"}}

ThomasMaxwell commented 9 years ago

Jeff, I'm not running the diagnostics, I'm just trying to generate a simple boxfill in vcs from publicly distributed ACME data. Here is a sample script:

import vcs, cdms2

x=vcs.init()

gm = vcs.createboxfill()

xtra = {}

f=cdms2.open( 'ne120_f02_t12_B1850a_01_climo.nc' )

s=f("U",**xtra)

x.plot( s, gm )

x.interact()

When I run this script I get the following errors:

CDMS error: Error on time conversion: invalid hour = 239261039241284857122685270850462023680.000000

Traceback (most recent call last):

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/source/Packages/DV3D/demo/demo_plots/basic_boxfill.py", line 8, in

x.plot( s, gm )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 2578, in plot

a = self.__plot( arglist, keyargs )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 3644, in __plot

self.backend.plot(*arglist,**keyargs)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 353, in plot

self.plot2D(data1,data2,tpl,gm)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1017, in plot2D

self.renderTemplate(tmpl,data1,gm,t,z)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1069, in renderTemplate

tstr = str(cdtime.reltime(taxis[0],taxis.units).tocomp(taxis.getCalendar()))

Cdtime error: Invalid component time

How is it that you don't get this error when generating plots for the diagnostics?

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Thursday, October 9, 2014 4:48 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Yes, I just used the diags script to plot a sample variable from your dropfox file; a plot is attached.

When did you download and install the diagnostics? How did you run the diagnostics?

The time axis in your sample file consists of one missing value. It's a sensible way to treat a climatology (although I prefer to omit the time axis entirely). I've tested on such data before.

Jeff

On 10/9/14, 12:40 PM, Thomas Maxwell wrote:

Jeff,

Are you able to read the ACME CAM datasets from http://esg.ccs.ornl.govhttp://esg.ccs.ornl.gov// with UVCDAT? I get a fatal error due to problems with the time axis. Here is a sample (downloaded today):

https://www.dropbox.com/s/oirv69p15c3ffpy/ne120_f02_t12_B1850a_01_climo.nc?dl=0

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Tuesday, October 7, 2014 5:42 PM

To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

I think we can close this. For the record, UV-CDAT can now read and plot all variables of interest in the test datafiles we tried. A script to do this may be found in

https://github.com/UV-CDAT/staticView

—

Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58267954. — Reply to this email directly or view it on GitHub. {"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58565614","name":"View Issue"}}

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58575196.

painter1 commented 9 years ago

I see the exact same behavior; and also with isofill which the diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several of the diagnostics reduction functions will delete trivial axes. It's a trivial axis which causes this problem.

Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

doutriaux1 commented 9 years ago

Ok I got a super basic test that reproduces my error.

Tom is that what you get, here is the script

import cdms2

vals = [239261039241284857122685270850462023680.000000, 239261039241284857122685270850462023690.000000]

ax = cdms2.createAxis(vals,id="time")

ax.units="hours since 1"

ax.designateTime()

print ax.asComponentTime()

C.

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:14 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Jeff, I'm not running the diagnostics, I'm just trying to generate a simple boxfill in vcs from publicly distributed ACME data. Here is a sample script:

import vcs, cdms2

x=vcs.init()

gm = vcs.createboxfill()

xtra = {}

f=cdms2.open( 'ne120_f02_t12_B1850a_01_climo.nc' )

s=f("U",**xtra)

x.plot( s, gm )

x.interact()

When I run this script I get the following errors:

CDMS error: Error on time conversion: invalid hour = 239261039241284857122685270850462023680.000000

Traceback (most recent call last):

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/source/Packages/DV3D/demo/demo_plots/basic_boxfill.py", line 8, in

x.plot( s, gm )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 2578, in plot

a = self.__plot( arglist, keyargs )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 3644, in __plot

self.backend.plot(arglist,*keyargs)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 353, in plot

self.plot2D(data1,data2,tpl,gm)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1017, in plot2D

self.renderTemplate(tmpl,data1,gm,t,z)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1069, in renderTemplate

tstr = str(cdtime.reltime(taxis[0],taxis.units).tocomp(taxis.getCalendar()))

Cdtime error: Invalid component time

How is it that you don't get this error when generating plots for the diagnostics?

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 4:48 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Yes, I just used the diags script to plot a sample variable from your dropfox file; a plot is attached.

When did you download and install the diagnostics? How did you run the diagnostics?

The time axis in your sample file consists of one missing value. It's a sensible way to treat a climatology (although I prefer to omit the time axis entirely). I've tested on such data before.

Jeff

On 10/9/14, 12:40 PM, Thomas Maxwell wrote:

Jeff,

Are you able to read the ACME CAM datasets from http://esg.ccs.ornl.govhttp://esg.ccs.ornl.gov// with UVCDAT? I get a fatal error due to problems with the time axis. Here is a sample (downloaded today):

https://www.dropbox.com/s/oirv69p15c3ffpy/ne120_f02_t12_B1850a_01_climo.nc?dl=0

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Tuesday, October 7, 2014 5:42 PM

To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

I think we can close this. For the record, UV-CDAT can now read and plot all variables of interest in the test datafiles we tried. A script to do this may be found in

https://github.com/UV-CDAT/staticView

—

Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58267954. — Reply to this email directly or view it on GitHub. {"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58565614","name":"View Issue"}}

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58575196.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58578862.

ThomasMaxwell commented 9 years ago

So it looks like uvcdat/vcs can't read this ACME data without some prior massaging of the data.

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:21 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

I see the exact same behavior; and also with isofill which the diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several of the diagnostics reduction functions will delete trivial axes. It's a trivial axis which causes this problem.

Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58579769.

doutriaux1 commented 9 years ago

Actually an even shorter script:

import cdtime

val = 239261039241284857122685270850462023680.0

cdtime.reltime(val, "hours since 1").tocomp()

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:14 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Jeff, I'm not running the diagnostics, I'm just trying to generate a simple boxfill in vcs from publicly distributed ACME data. Here is a sample script:

import vcs, cdms2

x=vcs.init()

gm = vcs.createboxfill()

xtra = {}

f=cdms2.open( 'ne120_f02_t12_B1850a_01_climo.nc' )

s=f("U",**xtra)

x.plot( s, gm )

x.interact()

When I run this script I get the following errors:

CDMS error: Error on time conversion: invalid hour = 239261039241284857122685270850462023680.000000

Traceback (most recent call last):

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/source/Packages/DV3D/demo/demo_plots/basic_boxfill.py", line 8, in

x.plot( s, gm )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 2578, in plot

a = self.__plot( arglist, keyargs )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 3644, in __plot

self.backend.plot(arglist,*keyargs)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 353, in plot

self.plot2D(data1,data2,tpl,gm)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1017, in plot2D

self.renderTemplate(tmpl,data1,gm,t,z)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1069, in renderTemplate

tstr = str(cdtime.reltime(taxis[0],taxis.units).tocomp(taxis.getCalendar()))

Cdtime error: Invalid component time

How is it that you don't get this error when generating plots for the diagnostics?

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 4:48 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Yes, I just used the diags script to plot a sample variable from your dropfox file; a plot is attached.

When did you download and install the diagnostics? How did you run the diagnostics?

The time axis in your sample file consists of one missing value. It's a sensible way to treat a climatology (although I prefer to omit the time axis entirely). I've tested on such data before.

Jeff

On 10/9/14, 12:40 PM, Thomas Maxwell wrote:

Jeff,

Are you able to read the ACME CAM datasets from http://esg.ccs.ornl.govhttp://esg.ccs.ornl.gov// with UVCDAT? I get a fatal error due to problems with the time axis. Here is a sample (downloaded today):

https://www.dropbox.com/s/oirv69p15c3ffpy/ne120_f02_t12_B1850a_01_climo.nc?dl=0

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Tuesday, October 7, 2014 5:42 PM

To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

I think we can close this. For the record, UV-CDAT can now read and plot all variables of interest in the test datafiles we tried. A script to do this may be found in

https://github.com/UV-CDAT/staticView

—

Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58267954. — Reply to this email directly or view it on GitHub. {"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58565614","name":"View Issue"}}

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58575196.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58578862.

doutriaux1 commented 9 years ago

Looking into it, I think it might be some casting issue with hours being so big.

Do you have any idea what time this value really is?

Filing a bug for this and trying to fix right away

C.

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:28 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

So it looks like uvcdat/vcs can't read this ACME data without some prior massaging of the data.

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:21 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

I see the exact same behavior; and also with isofill which the diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several of the diagnostics reduction functions will delete trivial axes. It's a trivial axis which causes this problem.

Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58579769.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58580680.

ThomasMaxwell commented 9 years ago

Charles, Both of your scripts give errors that look very similar to what I'm getting from the ACME box plot. -- Tom

From: Charles notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:29 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Actually an even shorter script:

import cdtime

val = 239261039241284857122685270850462023680.0

cdtime.reltime(val, "hours since 1").tocomp()

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:14 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Jeff, I'm not running the diagnostics, I'm just trying to generate a simple boxfill in vcs from publicly distributed ACME data. Here is a sample script:

import vcs, cdms2

x=vcs.init()

gm = vcs.createboxfill()

xtra = {}

f=cdms2.open( 'ne120_f02_t12_B1850a_01_climo.nc' )

s=f("U",**xtra)

x.plot( s, gm )

x.interact()

When I run this script I get the following errors:

CDMS error: Error on time conversion: invalid hour = 239261039241284857122685270850462023680.000000

Traceback (most recent call last):

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/source/Packages/DV3D/demo/demo_plots/basic_boxfill.py", line 8, in

x.plot( s, gm )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 2578, in plot

a = self.__plot( arglist, keyargs )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 3644, in __plot

self.backend.plot(arglist,*keyargs)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 353, in plot

self.plot2D(data1,data2,tpl,gm)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1017, in plot2D

self.renderTemplate(tmpl,data1,gm,t,z)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1069, in renderTemplate

tstr = str(cdtime.reltime(taxis[0],taxis.units).tocomp(taxis.getCalendar()))

Cdtime error: Invalid component time

How is it that you don't get this error when generating plots for the diagnostics?

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 4:48 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Yes, I just used the diags script to plot a sample variable from your dropfox file; a plot is attached.

When did you download and install the diagnostics? How did you run the diagnostics?

The time axis in your sample file consists of one missing value. It's a sensible way to treat a climatology (although I prefer to omit the time axis entirely). I've tested on such data before.

Jeff

On 10/9/14, 12:40 PM, Thomas Maxwell wrote:

Jeff,

Are you able to read the ACME CAM datasets from http://esg.ccs.ornl.govhttp://esg.ccs.ornl.gov// with UVCDAT? I get a fatal error due to problems with the time axis. Here is a sample (downloaded today):

https://www.dropbox.com/s/oirv69p15c3ffpy/ne120_f02_t12_B1850a_01_climo.nc?dl=0

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Tuesday, October 7, 2014 5:42 PM

To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

I think we can close this. For the record, UV-CDAT can now read and plot all variables of interest in the test datafiles we tried. A script to do this may be found in

https://github.com/UV-CDAT/staticView

—

Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58267954. — Reply to this email directly or view it on GitHub. {"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58565614","name":"View Issue"}}

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58575196.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58578862.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58580851.

doutriaux1 commented 9 years ago

Ok I filed a bug report, working on it

https://github.com/UV-CDAT/uvcdat/issues/781

C.

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:32 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Charles, Both of your scripts give errors that look very similar to what I'm getting from the ACME box plot. -- Tom

From: Charles notifications@github.com<mailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:29 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Actually an even shorter script:

import cdtime

val = 239261039241284857122685270850462023680.0

cdtime.reltime(val, "hours since 1").tocomp()

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:14 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Jeff, I'm not running the diagnostics, I'm just trying to generate a simple boxfill in vcs from publicly distributed ACME data. Here is a sample script:

import vcs, cdms2

x=vcs.init()

gm = vcs.createboxfill()

xtra = {}

f=cdms2.open( 'ne120_f02_t12_B1850a_01_climo.nc' )

s=f("U",**xtra)

x.plot( s, gm )

x.interact()

When I run this script I get the following errors:

CDMS error: Error on time conversion: invalid hour = 239261039241284857122685270850462023680.000000

Traceback (most recent call last):

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/source/Packages/DV3D/demo/demo_plots/basic_boxfill.py", line 8, in

x.plot( s, gm )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 2578, in plot

a = self.__plot( arglist, keyargs )

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/Canvas.py", line 3644, in __plot

self.backend.plot(arglist,*keyargs)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 353, in plot

self.plot2D(data1,data2,tpl,gm)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1017, in plot2D

self.renderTemplate(tmpl,data1,gm,t,z)

File "/Developer/Projects/EclipseWorkspace/uvcdat/master/build/install/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/vcs/VTKPlots.py", line 1069, in renderTemplate

tstr = str(cdtime.reltime(taxis[0],taxis.units).tocomp(taxis.getCalendar()))

Cdtime error: Invalid component time

How is it that you don't get this error when generating plots for the diagnostics?

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 4:48 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Yes, I just used the diags script to plot a sample variable from your dropfox file; a plot is attached.

When did you download and install the diagnostics? How did you run the diagnostics?

The time axis in your sample file consists of one missing value. It's a sensible way to treat a climatology (although I prefer to omit the time axis entirely). I've tested on such data before.

Jeff

On 10/9/14, 12:40 PM, Thomas Maxwell wrote:

Jeff,

Are you able to read the ACME CAM datasets from http://esg.ccs.ornl.govhttp://esg.ccs.ornl.gov// with UVCDAT? I get a fatal error due to problems with the time axis. Here is a sample (downloaded today):

https://www.dropbox.com/s/oirv69p15c3ffpy/ne120_f02_t12_B1850a_01_climo.nc?dl=0

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Tuesday, October 7, 2014 5:42 PM

To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

I think we can close this. For the record, UV-CDAT can now read and plot all variables of interest in the test datafiles we tried. A script to do this may be found in

https://github.com/UV-CDAT/staticView

—

Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58267954. — Reply to this email directly or view it on GitHub. {"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58565614","name":"View Issue"}}

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58575196.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58578862.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58580851.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581195.

ThomasMaxwell commented 9 years ago

The actual single time value is undefined (or empty), apparently because it is a climatology.

From: Charles notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:30 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Looking into it, I think it might be some casting issue with hours being so big.

Do you have any idea what time this value really is?

Filing a bug for this and trying to fix right away

C.

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:28 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

So it looks like uvcdat/vcs can't read this ACME data without some prior massaging of the data.

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:21 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

I see the exact same behavior; and also with isofill which the diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several of the diagnostics reduction functions will delete trivial axes. It's a trivial axis which causes this problem.

Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58579769.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58580680.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581030.

painter1 commented 9 years ago

These are climatology files, so there is no time value.  Someone
feels obliged to include a time axis (why, I don't know) and marks
the time as missing because there is no time value.  Those huge
times are, almost surely, whatever random bits happened to be in
memory.

BTW, FWIW your shorter script fails for me too, with "Cdtime error:
Invalid componet time".

- Jeff

On 10/9/14, 2:30 PM, Charles wrote:

  Looking into it, I think it might be some casting issue with hours
  being so big.

  Do you have any idea what time this value really is?

  Filing a bug for this and trying to fix right away

  C.

  From: Thomas Maxwell
  <notifications@github.com<mailto:notifications@github.com>>

  Reply-To: UV-CDAT/uvcdat
  <reply@reply.github.com<mailto:reply@reply.github.com>>

  Date: Thursday, October 9, 2014 at 2:28 PM

  To: UV-CDAT/uvcdat

uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.gov>

  Subject: Re: [uvcdat] Read ACME test data (#658)

  So it looks like uvcdat/vcs can't read this ACME data without some
  prior massaging of the data.

  -- Tom

  From: Jeffrey Painter

notifications@github.com<mailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:21 PM

  To: UV-CDAT/uvcdat

uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

  I see the exact same behavior; and also with isofill which the

  diagnostics uses.

  Maybe the reason why the diagnostics can handle it is that several
  of

  the diagnostics reduction functions will delete trivial axes. It's
  a

  trivial axis which causes this problem.

  - Jeff

  On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

  > x.plot( s, gm )

  —

  Reply to this email directly or view it on

GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58579769.

  —

  Reply to this email directly or view it on

GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58580680. — Reply to this email directly or view it on GitHub. {"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581030","name":"View Issue"}}

doutriaux1 commented 9 years ago

Ok I will try to fix it, but if it’s missing can we read with squeeze=1? I think that’s how we solved it for the web page pngs generation

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:34 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

These are climatology files, so there is no time value. Someone feels obliged to include a time axis (why, I don't know) and marks the time as missing because there is no time value. Those huge times are, almost surely, whatever random bits happened to be in memory.

BTW, FWIW your shorter script fails for me too, with "Cdtime error: Invalid componet time".

Jeff

On 10/9/14, 2:30 PM, Charles wrote:

Looking into it, I think it might be some casting issue with hours being so big.

Do you have any idea what time this value really is?

Filing a bug for this and trying to fix right away

C.

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Thursday, October 9, 2014 at 2:28 PM

To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

So it looks like uvcdat/vcs can't read this ACME data without some prior massaging of the data.

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:21 PM

To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

I see the exact same behavior; and also with isofill which the

diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several of

the diagnostics reduction functions will delete trivial axes. It's a

trivial axis which causes this problem.

Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

—

Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58579769.

—

Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58580680. — Reply to this email directly or view it on GitHub. {"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581030","name":"View Issue"}}

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581564.

painter1 commented 9 years ago

Charles, you're right.  The file at issue is not CF-compliant.  The
CF Conventions section 1.2, entry for "coordinate variable" says "

Missing values are not allowed in coordinate variables."   I think
that we should complain to someone.  Nevertheless, I think that it
would be useful if UV-CDAT could plot this data.

- Jeff

On 10/9/14, 2:37 PM, Charles wrote:

  Ok I will try to fix it, but if it’s missing can we read with
  squeeze=1? I think that’s how we solved it for the web page pngs
  generation

  From: Jeffrey Painter
  <notifications@github.com<mailto:notifications@github.com>>

  Reply-To: UV-CDAT/uvcdat
  <reply@reply.github.com<mailto:reply@reply.github.com>>

  Date: Thursday, October 9, 2014 at 2:34 PM

  To: UV-CDAT/uvcdat

uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.gov>

  Subject: Re: [uvcdat] Read ACME test data (#658)

  These are climatology files, so there is no time value. Someone

  feels obliged to include a time axis (why, I don't know) and marks

  the time as missing because there is no time value. Those huge

  times are, almost surely, whatever random bits happened to be in

  memory.

  BTW, FWIW your shorter script fails for me too, with "Cdtime
  error:

  Invalid componet time".

  - Jeff

  On 10/9/14, 2:30 PM, Charles wrote:

  Looking into it, I think it might be some casting issue with hours

  being so big.

  Do you have any idea what time this value really is?

  Filing a bug for this and trying to fix right away

  C.

  From: Thomas Maxwell

notifications@github.com<mailto:notifications@github.commailto:notifications@github.com>

  Reply-To: UV-CDAT/uvcdat

reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.com>

  Date: Thursday, October 9, 2014 at 2:28 PM

  To: UV-CDAT/uvcdat

uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>

  Cc: "Doutriaux, Charles"

doutriaux1@llnl.gov<mailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

  Subject: Re: [uvcdat] Read ACME test data (#658)

  So it looks like uvcdat/vcs can't read this ACME data without some

  prior massaging of the data.

  -- Tom

  From: Jeffrey Painter

notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

  Reply-To: UV-CDAT/uvcdat

reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

  Date: Thursday, October 9, 2014 5:21 PM

  To: UV-CDAT/uvcdat

uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>

  Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL

  CORP]"

thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>

  Subject: Re: [uvcdat] Read ACME test data (#658)

  I see the exact same behavior; and also with isofill which the

  diagnostics uses.

  Maybe the reason why the diagnostics can handle it is that several

  of

  the diagnostics reduction functions will delete trivial axes. It's

  a

  trivial axis which causes this problem.

  - Jeff

  On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

  > x.plot( s, gm )

  —

  Reply to this email directly or view it on

GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58579769.

  —

  Reply to this email directly or view it on

GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58580680.

  —

  Reply to this email directly or view

  it on GitHub.

  {"@context":<a class="moz-txt-link-rfc2396E"
  href="http://schema.org">"http://schema.org"</a>,"@type":"EmailMessage","description":"View
  this Issue on GitHub","action":{"@type":"ViewAction","url":<a
  class="moz-txt-link-rfc2396E"
  href="https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581030">"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581030"</a>,"name":"View
  Issue"}}

  —

  Reply to this email directly or view it on

GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581564. — Reply to this email directly or view it on GitHub. {"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581927","name":"View Issue"}}

ThomasMaxwell commented 9 years ago

If you mean trying 'x.plot( s, gm, squeeze=1 )' , that didn't help (same error).

From: Charles notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:37 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Ok I will try to fix it, but if it’s missing can we read with squeeze=1? I think that’s how we solved it for the web page pngs generation

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:34 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

These are climatology files, so there is no time value. Someone feels obliged to include a time axis (why, I don't know) and marks the time as missing because there is no time value. Those huge times are, almost surely, whatever random bits happened to be in memory.

BTW, FWIW your shorter script fails for me too, with "Cdtime error: Invalid componet time".

Jeff

On 10/9/14, 2:30 PM, Charles wrote:

Looking into it, I think it might be some casting issue with hours being so big.

Do you have any idea what time this value really is?

Filing a bug for this and trying to fix right away

C.

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Thursday, October 9, 2014 at 2:28 PM

To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

So it looks like uvcdat/vcs can't read this ACME data without some prior massaging of the data.

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:21 PM

To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

I see the exact same behavior; and also with isofill which the

diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several of

the diagnostics reduction functions will delete trivial axes. It's a

trivial axis which causes this problem.

Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

—

Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58579769.

—

Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58580680. — Reply to this email directly or view it on GitHub. {"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581030","name":"View Issue"}}

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581564.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581927.

doutriaux1 commented 9 years ago

No I mean when you read s s=f(“PRECL”,squeeze=1)

Let me know,

C.

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:45 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

If you mean tr

doutriaux1 commented 9 years ago

I guess if you go all the way to plot time, then do:

X.plot(s(squeeze=1))

C.

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:45 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

If you mean trying 'x.plot( s, gm, squeeze=1 )' , that didn't help (same error).

From: Charles notifications@github.com<mailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:37 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Ok I will try to fix it, but if it’s missing can we read with squeeze=1? I think that’s how we solved it for the web page pngs generation

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:34 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

These are climatology files, so there is no time value. Someone feels obliged to include a time axis (why, I don't know) and marks the time as missing because there is no time value. Those huge times are, almost surely, whatever random bits happened to be in memory.

BTW, FWIW your shorter script fails for me too, with "Cdtime error: Invalid componet time".

Jeff

On 10/9/14, 2:30 PM, Charles wrote:

Looking into it, I think it might be some casting issue with hours being so big.

Do you have any idea what time this value really is?

Filing a bug for this and trying to fix right away

C.

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Thursday, October 9, 2014 at 2:28 PM

To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

So it looks like uvcdat/vcs can't read this ACME data without some prior massaging of the data.

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:21 PM

To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

I see the exact same behavior; and also with isofill which the

diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several of

the diagnostics reduction functions will delete trivial axes. It's a

trivial axis which causes this problem.

Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

—

Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58579769.

—

Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58580680. — Reply to this email directly or view it on GitHub. {"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581030","name":"View Issue"}}

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581564.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581927.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58582846.

doutriaux1 commented 9 years ago

If that works I can try to see where vcs is trying to do this and put a try/except for dim 1 dims.

Nevertheless it would be nice to fix it properly

C.

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:45 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

If you mean trying 'x.plot( s, gm, squeeze=1 )' , that didn't help (same error).

From: Charles notifications@github.com<mailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:37 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Ok I will try to fix it, but if it’s missing can we read with squeeze=1? I think that’s how we solved it for the web page pngs generation

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:34 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

These are climatology files, so there is no time value. Someone feels obliged to include a time axis (why, I don't know) and marks the time as missing because there is no time value. Those huge times are, almost surely, whatever random bits happened to be in memory.

BTW, FWIW your shorter script fails for me too, with "Cdtime error: Invalid componet time".

Jeff

On 10/9/14, 2:30 PM, Charles wrote:

Looking into it, I think it might be some casting issue with hours being so big.

Do you have any idea what time this value really is?

Filing a bug for this and trying to fix right away

C.

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Thursday, October 9, 2014 at 2:28 PM

To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

So it looks like uvcdat/vcs can't read this ACME data without some prior massaging of the data.

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:21 PM

To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

I see the exact same behavior; and also with isofill which the

diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several of

the diagnostics reduction functions will delete trivial axes. It's a

trivial axis which causes this problem.

Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

—

Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58579769.

—

Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58580680. — Reply to this email directly or view it on GitHub. {"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581030","name":"View Issue"}}

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581564.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581927.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58582846.

painter1 commented 9 years ago

x.plot( s(squeeze=1), gm )  works here.
- Jeff

On 10/9/14, 2:58 PM, Charles wrote:

  If that works I can try to see where vcs is trying to do this and
  put a try/except for dim 1 dims.

  Nevertheless it would be nice to fix it properly

  C.

  From: Thomas Maxwell
  <notifications@github.com<mailto:notifications@github.com>>

  Reply-To: UV-CDAT/uvcdat
  <reply@reply.github.com<mailto:reply@reply.github.com>>

  Date: Thursday, October 9, 2014 at 2:45 PM

  To: UV-CDAT/uvcdat

uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.gov>

  Subject: Re: [uvcdat] Read ACME test data (#658)

  If you mean trying 'x.plot( s, gm, squeeze=1 )' , that didn't help
  (same error).

  From: Charles

notifications@github.com<mailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:37 PM

  To: UV-CDAT/uvcdat

uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

  Ok I will try to fix it, but if it’s missing can we read with
  squeeze=1? I think that’s how we solved it for the web page pngs
  generation

  From: Jeffrey Painter

notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:34 PM

  To: UV-CDAT/uvcdat

uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

  These are climatology files, so there is no time value. Someone

  feels obliged to include a time axis (why, I don't know) and marks

  the time as missing because there is no time value. Those huge

  times are, almost surely, whatever random bits happened to be in

  memory.

  BTW, FWIW your shorter script fails for me too, with "Cdtime
  error:

  Invalid componet time".

  - Jeff

  On 10/9/14, 2:30 PM, Charles wrote:

  Looking into it, I think it might be some casting issue with hours

  being so big.

  Do you have any idea what time this value really is?

  Filing a bug for this and trying to fix right away

  C.

  From: Thomas Maxwell

notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

  Reply-To: UV-CDAT/uvcdat

reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

  Date: Thursday, October 9, 2014 at 2:28 PM

  To: UV-CDAT/uvcdat

uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>

  Cc: "Doutriaux, Charles"

doutriaux1@llnl.gov<mailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

  Subject: Re: [uvcdat] Read ACME test data (#658)

  So it looks like uvcdat/vcs can't read this ACME data without some

  prior massaging of the data.

  -- Tom

  From: Jeffrey Painter

notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

  Reply-To: UV-CDAT/uvcdat

reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

  Date: Thursday, October 9, 2014 5:21 PM

  To: UV-CDAT/uvcdat

uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com>

  Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL

  CORP]"

thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov>

  Subject: Re: [uvcdat] Read ACME test data (#658)

  I see the exact same behavior; and also with isofill which the

  diagnostics uses.

  Maybe the reason why the diagnostics can handle it is that several

  of

  the diagnostics reduction functions will delete trivial axes. It's

  a

  trivial axis which causes this problem.

  - Jeff

  On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

  > x.plot( s, gm )

  —

  Reply to this email directly or view it on

GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58579769.

  —

  Reply to this email directly or view it on

GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58580680.

  —

  Reply to this email directly or view

  it on GitHub.

  {"@context":<a class="moz-txt-link-rfc2396E"
  href="http://schema.org">"http://schema.org"</a>,"@type":"EmailMessage","description":"View
  this Issue on GitHub","action":{"@type":"ViewAction","url":<a
  class="moz-txt-link-rfc2396E"
  href="https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581030">"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581030"</a>,"name":"View
  Issue"}}

  —

  Reply to this email directly or view it on

GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581564.

  —

  Reply to this email directly or view it on

GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581927.

  —

  Reply to this email directly or view it on

GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58582846. — Reply to this email directly or view it on GitHub. {"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58584528","name":"View Issue"}}

ThomasMaxwell commented 9 years ago

The following script works (plot below). Great call!

import vcs, cdms2

x=vcs.init()

gm = vcs.createboxfill()

xtra = { 'squeeze': 1 }

f=cdms2.open( 'ne120_f02_t12_B1850a_01_climo.nc' )

s=f("U",**xtra)

x.plot( s, gm )

x.interact()

[cid:CF72DD69-0C82-4006-ABE8-45A86487FF18]

From: Charles notifications@github.com<mailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:58 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

If that works I can try to see where vcs is trying to do this and put a try/except for dim 1 dims.

Nevertheless it would be nice to fix it properly

C.

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:45 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

If you mean trying 'x.plot( s, gm, squeeze=1 )' , that didn't help (same error).

From: Charles notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:37 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

Ok I will try to fix it, but if it’s missing can we read with squeeze=1? I think that’s how we solved it for the web page pngs generation

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 at 2:34 PM To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

These are climatology files, so there is no time value. Someone feels obliged to include a time axis (why, I don't know) and marks the time as missing because there is no time value. Those huge times are, almost surely, whatever random bits happened to be in memory.

BTW, FWIW your shorter script fails for me too, with "Cdtime error: Invalid componet time".

Jeff

On 10/9/14, 2:30 PM, Charles wrote:

Looking into it, I think it might be some casting issue with hours being so big.

Do you have any idea what time this value really is?

Filing a bug for this and trying to fix right away

C.

From: Thomas Maxwell notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com>

Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com>

Date: Thursday, October 9, 2014 at 2:28 PM

To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Doutriaux, Charles" doutriaux1@llnl.gov<mailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.govmailto:doutriaux1@llnl.gov>

Subject: Re: [uvcdat] Read ACME test data (#658)

So it looks like uvcdat/vcs can't read this ACME data without some prior massaging of the data.

-- Tom

From: Jeffrey Painter notifications@github.com<mailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.commailto:notifications@github.com> Reply-To: UV-CDAT/uvcdat reply@reply.github.com<mailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.commailto:reply@reply.github.com> Date: Thursday, October 9, 2014 5:21 PM

To: UV-CDAT/uvcdat uvcdat@noreply.github.com<mailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.commailto:uvcdat@noreply.github.com> Cc: "Maxwell, Thomas P. (GSFC-606.2)[SCIENCE APPLICATIONS INTL CORP]" thomas.maxwell@nasa.gov<mailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.govmailto:thomas.maxwell@nasa.gov> Subject: Re: [uvcdat] Read ACME test data (#658)

I see the exact same behavior; and also with isofill which the

diagnostics uses.

Maybe the reason why the diagnostics can handle it is that several of

the diagnostics reduction functions will delete trivial axes. It's a

trivial axis which causes this problem.

Jeff

On 10/9/14, 2:14 PM, Thomas Maxwell wrote:

—

Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58579769.

—

Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58580680. — Reply to this email directly or view it on GitHub. {"@context":"http://schema.org","@type":"EmailMessage","description":"View this Issue on GitHub","action":{"@type":"ViewAction","url":"https://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581030","name":"View Issue"}}

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581564.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58581927.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58582846.

— Reply to this email directly or view it on GitHubhttps://github.com/UV-CDAT/uvcdat/issues/658#issuecomment-58584528.

CDAT / cdat

Read ACME test data #658