Enhance the performance of point2grid

Describe the Enhancement

Jemie Wolff reported point2grid took less than 1 minute with HRRR domain (1799 by 1059) but it took more than 40 minutes with GFS domain (3072 by 1536) at Cheyenne. HRRR case, the data is mapped to 1.7M grid cells (out of 1.8 M cells). GFS case, mapped to 3.1 M grid cells (out of 4.5 M cells).

Commands to load:

module use /glade/p/ral/jntp/MET/MET_releases/modulefiles module load met/9.0 setenv MET_TMP_DIR /glade/p/ral/jntp/AF/cloud_vx/goes_data/test_met

To HRRR grid:

point2grid /glade/p/ral/jntp/AF/cloud_vx/goes_data/level2/abi_tb_fd_2020070300_C13_G16.nc /glade/p/ral/jntp/AF/cloud_vx/model_data/HRRR/2020060800-05/hrrr.t00z.wrfprsf01.grib2 test_hrrr_chey.nc -field 'name="tb"; level="(,)";' -v 3

To GFS grid:

point2grid /glade/p/ral/jntp/AF/cloud_vx/goes_data/level2/abi_tb_fd_2020070300_C13_G16.nc /glade/p/ral/jntp/AF/cloud_vx/model_data/GFS/gfs.20200608/00/gfs.t00z.special.grb2f001 test_gfs_chey.nc -field 'name="tb"; level="(,)";' -v 3

Time Estimate

4 to 8 hours

Sub-Issues

Consider breaking the enhancement down into sub-issues.

[ ] Add a checkbox for each sub-issue here.

Relevant Deadlines

NONE.

Funding Source

2791541

Define the Metadata

Assignee

[x] Select engineer(s) or no engineer required (Howard)
[x] Select scientist(s) or no scientist required (None)

Labels

[x] Select component(s)
[x] Select priority
[ ] Select requestor(s)

Projects and Milestone

[ ] Review projects and select relevant Repository and Organization ones
[ ] Select milestone

Define Related Issue(s)

Consider the impact to the other METplus components.

[ ] METplus, MET, METdb, METviewer, METexpress, METcalcpy, METplotpy

Enhancement Checklist

See the METplus Workflow for details.

[ ] Complete the issue definition above.
[ ] Fork this repository or create a branch of develop. Branch name: feature_<Issue Number>_<Description>
[ ] Complete the development and test your changes.
[ ] Add/update unit tests.
[ ] Add/update documentation.
[ ] Push local changes to GitHub.
[ ] Submit a pull request to merge into develop. Pull request: feature <Issue Number> <Description>
[ ] Iterate until the reviewer(s) accept and merge your changes.
[ ] Delete your fork or branch.
[ ] Close this issue.

dtcenter / MET