Generate data structures in SDMX

[khaeru]

This code uses the [sdmx1 package]() to give a complete and rigorous definition of the concepts, measures, codes, etc. used to structure the iTEM historical and model data.

Details

See the updated “Data structures” page in the documentation for more details, including motivation. This is a preview version built from the branch for this PR:

• https://transportenergy.readthedocs.io/en/feature-sdmx-dsd/structure.html
• The actual structures.xml generated is included in full at: https://transportenergy.readthedocs.io/en/feature-sdmx-dsd/metadata.html#sdmx-metadata-structure-xml

PR checklist

• [x] Complete code lists:
  • [x] Convert the following codelists from the versions in the old concepts.yaml: automation, fleet, fuel, technology, pollutant, vehicle.
  • ~Generate a CL_MODEL from existing metadata.~ Deferred; see #65.
• [x] Add model and scenario concepts.
• [x] Make reference to the SDMX:CROSS_DOMAIN_CONCEPTS scheme where appropriate.
• [x] Add a distinct DSD for model data.
• [x] Improve existing code using the SDMX data structures:
  • [x] Remove concepts.yaml and measures.yaml, now obsolete.
  • [x] item.structure.make_template()
  • [x] Use the DSD instead of the item.historical.scripts.util.managers.dataframe.ColumnName enum in data processing scripts.
• [x] Expand documentation with:
  • [x] Code examples for retrieving code lists.

[codecov[bot]]

Codecov Report

Merging #62 (4c17224) into master (376def3) will increase coverage by 3.40%. The diff coverage is 82.93%.

@@            Coverage Diff             @@
##           master      #62      +/-   ##
==========================================
+ Coverage   53.21%   56.61%   +3.40%     
==========================================
  Files          39       46       +7     
  Lines        1603     1851     +248     
==========================================
+ Hits          853     1048     +195     
- Misses        750      803      +53     

Impacted Files	Coverage Δ
item/historical/scripts/T009.py	93.75% <ø> (ø)
item/tests/test_common.py	0.00% <0.00%> (ø)
item/tests/test_historical.py	0.00% <0.00%> (ø)
item/tests/test_structure.py	0.00% <0.00%> (ø)
item/cli.py	79.16% <37.50%> (ø)
item/structure/template.py	85.29% <85.29%> (ø)
item/structure/sdmx.py	92.64% <92.64%> (ø)
item/common.py	89.55% <100.00%> (ø)
item/historical/__init__.py	93.06% <100.00%> (+2.06%)	:arrow_up:
item/historical/scripts/T000.py	100.00% <100.00%> (ø)
... and 13 more

---

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 376def3...4c17224. Read the comment docs.