Closed soniayeh closed 3 years ago
If I understood correctly, T001 refers to coastal shipping. I think this issue has been fixed in our database. Maybe you can give a look and see if i looked at the right variable
Yes. You are correct. The source (ITF) has corrected the data. Therefore We should remove the temporary code fix in #40 to the script T001 https://github.com/transportenergy/database/blob/master/item/historical/scripts/T001.py without applying the multiplier of 100 for data up to 2001. @khaeru @hlinero
We should try to keep these discussions streamlined, as far as possible. Currently the information about this issue is split across comments:
The rule of thumb should be to continue with the original issue as far as possible, so I'll reply there.
Here is what we will do to fix this issue:
@hlinero will take care of it and post his update here.
Issue raised by @noussan (an error in the T001 data for China, two orders of magnitude of difference for data up to 2001 and after 2002.) in #32.
A temporary initial fix has been dealt with by @khaeru using temporary python code fix (#40)(modifed our python code, specifically file https://github.com/transportenergy/database/blob/master/item/historical/scripts/T001.py)
The longer-term fix is to request the data provider for T001: https://github.com/transportenergy/metadata/blob/be0183f/historical/sources.yaml#L12-L20 our @transportenergy/itf-oecd colleagues to fix their raw data and we eliminate our temporary python code fix.
This would be a good exercise for us.