Clean up DAP4 code plus minor mods to other, non-dap4, code; second attempt.

[DennisHeimbigner]

Description of Changes

This PR make major changes to the DAP4 code. It also makes some small but necessary changes to non-DAP4 code, the nature of which will be described in some detail below.

DAP4 Module Changes

The biggest change is to merge all of the dap submodules (dap4:d4core, dap4:d4cdm, etc) into just one single "dap4" module.

Other changes include:

• Get rid of the old DAP4 CDMXXX types and instead use the standard netcdf-java Array and Index types; this has some consequences with respect to what kind of sequence objects can be handled.
• Convert the set of DAP4 tests to be similar to those used by netcdf-c.
• Convert tests to JUNIT-4 parameterized tests.
  • Move various files around in the module
• Remove all tests that use server mocking -- we will use a real server instead.
• Modify dap4/build.gradle:
  • Remove out-of-date comments (still more to do here)
  • Switch "compile" action in dap4 build.gradle to "implementation" in anticipation of a gradle version upgrade.
  • Conform to the re-organized dap4 module structure, including tests.
• Aggregate (almost) all DAP4 constants into DapConstants.java.
• Remove unused code (still more to do)
• Move some DAP4 only code from UnitTestCommon.java to DapTestCommon.java
• Begin the conversion to the new checksum mode capability.
  • Move various files around in the module
• Remove the now unused Bison-based DMR parser.
• Update the Constraint grammar (ce.y) to replace deprecated Bison directives.
• Move the Odometer code from netcdf-java to TDS.
• A number of classes were renamed to more accurately reflect their semantics. Specifically:
  • DataCursor -> D4Array
  • DataIndex -> D4Index
• Major code refactoring was done:
  • Added ArrayScheme
  • Deleted a whole raft of files
  • Delete whole DSP subsystem.
  • Move various files around in the module
• Move the ucar.nc2.dataset.spi.NetcdfFileProvider file

DAP4 Related Changes Outside of DAP4 Module

• Enable inclusion of dap4 in fatJars and ncIdv.
• Get the HttpServices interceptor mechanism to work again; this is for debugging HTTP requests.
  • Create a new class HTTPIntercepts to unify most of the interceptor code.
  • Note that HTTP compression also uses Interceptors, so this unification includes that code as well.
• Fix DatasetUrl.checkIfDap4:
  • Properly handle the possible DAP4 extensions (like .dsr.xml)
  • Read the DSR to detect a DAP4 url
• Add a test to verify that the possible legal urls are recognized as being ServiceType.DAP.

Non-DAP4 related Changes

• Remove extraneous code from TestCDF5Reading.java
• Clean up UnitTestCommon.java
• Allow zero-length dimensions (e.g. from Unlimited), but also ignore any variables that have a zero length dimension.
• Change NetcdfFiles warning from mentioning H5iop to H5iospNew.
• Fix a NullPointerException in HTTPSession.java
• Fix TestReadArrayStructure because it was using a old path that changed as part of this PR.
• Move selected NetCDF-4 related constants from Attribute.java to CDM.java
• Minor comment changes

TODO

• Search and destroy unused imports

Addendum 4/5/2023

Insert all requested changes by Drwenski.

PR Checklist

• [X] Link to any issues that the PR addresses
• [X] Add labels
• [ ] Open as a draft PR until ready for review
• [X] Make sure GitHub tests pass
• [X] Make sure Jenkins tests pass
• [X] Mark PR as "Ready for Review"

[haileyajohnson]

I'm going to wait for #1151 to be finished and merged before reviewing this one :)

[rschmunk]

What is the latest on when or if this pull request might be approved?

I've just had a query from developers at GSFC/GES/DISC about problems trying to access data on their DAP4 server using Panoply.