pnnl / DHSVM-PNNL

43 stars 32 forks source link

Parallel: Rework input of 2D Map data #17

Closed wperkins closed 5 years ago

wperkins commented 5 years ago

I made some pretty extensive changes to input of 2D map data, in preparation for parallel I/O, and to make the use of "MM5" met input manageable in large domains. These changes resulted in pretty significant performance increases in the cases I've tried that use "MM5" met input.

The main things are

  1. Be able to keep a 2D map file open during the simulation instead of opening and closing each time it's read. At the moment, this only applies to MM5 input. It should probably be extended to model state, PRISM, and shading input, i.e. those maps read continuously through the simulation.
  2. Be able to read NetCDF format files. This has worked for the cases I've tried, provided
    1. NetCDF file y-coordinate are in descending order, which matches the layout of binary files. Ascending y-coordinate is no longer supported and will generate a fatal errors.
    2. NetCDF 4 format files are used. NetCDF 3 will be silently read, but byte data will not be read correctly. There may be a way around this.