Open StasJ opened 3 months ago
Reason no data variable:
Nature of the work around:
My question + thinking
Hi @StasJ , you mentioned that release 3.9.2 was having this dataset imported correctly and variables identified correctly. Could you verify if it's really the case? In my test this file appeared broken since at least 2022.
I tested /glade/campaign/cisl/vast/vapor/data/Source/ROMS/jsmall
using the latest 3.9.2 release on Casper and it works.
Do you mind testing the file actually report in the issue?
On Fri, Jul 5, 2024, 4:18 PM StasJ @.***> wrote:
I tested /glade/campaign/cisl/vast/vapor/data/Source/ROMS/jsmall using the latest 3.9.2 release on Casper and it works.
— Reply to this email directly, view it on GitHub https://github.com/NCAR/VAPOR/issues/3626#issuecomment-2211498368, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAGG6JJYQ3HKAW4XOMZKKOTZK4SVBAVCNFSM6AAAAABJVCFIWKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMJRGQ4TQMZWHA . You are receiving this because you were assigned.Message ID: @.***>
Hey @StasJ , I tested it again, and it seems if you include the grid file in the same Kauffman
folder (NEP4_grid.nc
) then the dataset loads correctly, using the current main branch. Do you mind giving it a try?
Hey @shaomeng, you are correct, I apologize for the wild goose chase. I knew about the auxiliary grid file but I must've forgotten to import it when I reported the bug but remembered when I retested the issue. Maybe it would be worthwhile to have an error message for this scenario although I know that is easier said than done due to the heuristic nature of importing these datasets...
Hey @shaomeng, you are correct, I apologize for the wild goose chase. I knew about the auxiliary grid file but I must've forgotten to import it when I reported the bug but remembered when I retested the issue. Maybe it would be worthwhile to have an error message for this scenario although I know that is easier said than done due to the heuristic nature of importing these datasets...
Sounds good, I agree that a more meaningful message can be helpful here. I'll move forward to have it raised.
Hi @StasJ , I think I'll need some input from you to figure out the best way to raise a message. In my attempt in #3634 , I declare that the dataset import is unsuccessful if there are no 2D nor 3D variables. This solution doesn't work well, because for 24May
datasets, 3D variables indeed CAN be found later on, but not at the time of initialization. So, apparently, the test of whether there are 2D or 3D variables needs to be performed later in the pipeline. Do you have suggestions on where to do that test? Thanks!
@shaomeng The issue you are running into is due to the fact that you are using GetDataVariableNames
rather than GetVariableNames
. It appears the functionality of GetDataVariableNames
is not fully complete in NetCDFCFCollection
. You could use GetVariableNames
here but I would instead add this check at the end of initialization in DCCF
since that includes the full logic for distinguishing data variables.
Hi @StasJ , thanks for the suggestion; I wasn't aware of the functionality of DCCF
but it makes total sense after you point it out. I'll see if the updated code passes the smoke test. Thanks!
Does ROMS always save a separate gridfile and data files? If yes, we could have a separate ROMS loader with the option to select a grid file. Provide an explicit option.
Attempting to import a ROMS dataset (like
glade/data/Source/ROMS/Kauffman/b.n20.B1850CN.f09_g16.09.roms.ha.0001-03.nc
) will result in an empty visualizer and no data variables.