pik-piam / mrremind

The mrremind packages contains data preprocessing for the REMIND model.
GNU Lesser General Public License v3.0
4 stars 42 forks source link

historical.mif: current version (as of 2023-11-24) has weird variable names #450

Closed robertpietzcker closed 9 months ago

robertpietzcker commented 9 months ago

Somehow the "variable" entry in the current historical.mif contains lots of NAs and units and model information connected with dots

N/A;BP;REF;Cap|Electricity|Wind.NA.GW.historical.NA; N/A;BP;IND;Emi|CO2|Energy.NA.Mt CO2/yr.historical.NA; N/A;historical;CAZ;NA.Emi|GHG|Industry.N/A.CEDS.NA;Mt CO2eq/yr;N/A;

0UmfHxcvx5J7JoaOhFSs5mncnisTJJ6q commented 9 months ago

That's rev6.605?

0UmfHxcvx5J7JoaOhFSs5mncnisTJJ6q commented 9 months ago

Does not affect APTs:

$ for f in $( ls /p/projects/rd3mod/inputdata/output/rev*APT-2023-1*_62eff8f7_validationremind.tgz ); do echo "$f"; tar -Oxf "$f" ./historical.mif | awk -F ';' '$4 ~ /Cap\|Electricity\|Geothermal/ { print $4; exit }'; e
cho " "; done
/p/projects/rd3mod/inputdata/output/rev6.542APT-2023-10-01_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal

/p/projects/rd3mod/inputdata/output/rev6.542APT-2023-10-08_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal

/p/projects/rd3mod/inputdata/output/rev6.542APT-2023-10-15_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal

/p/projects/rd3mod/inputdata/output/rev6.542APT-2023-10-22_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal

/p/projects/rd3mod/inputdata/output/rev6.542APT-2023-10-29_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal

/p/projects/rd3mod/inputdata/output/rev6.60APT-2023-11-05_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal

/p/projects/rd3mod/inputdata/output/rev6.60APT-2023-11-12_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal

/p/projects/rd3mod/inputdata/output/rev6.60APT-2023-11-19_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal
0UmfHxcvx5J7JoaOhFSs5mncnisTJJ6q commented 9 months ago

Looks like it only affected rev6.605

$ for f in $( ls -t /p/projects/rd3mod/inputdata/output/rev*_62eff8f7_validationremind.tgz | head -n 10 ); do echo "$f"; tar -Oxf "$f" ./historical.mif | awk -F ';' '$4 ~ /Cap\|Electricity\|Geothermal/ { print $4; exit 
}'; echo " "; done
/p/projects/rd3mod/inputdata/output/rev6.60falk_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal

/p/projects/rd3mod/inputdata/output/rev6.60APT-2023-11-19_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal

/p/projects/rd3mod/inputdata/output/rev6.60APT-2023-11-12_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal

/p/projects/rd3mod/inputdata/output/rev6.60-moved_mappings_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal

/p/projects/rd3mod/inputdata/output/rev6.605_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal.NA.GW.historical.NA

/p/projects/rd3mod/inputdata/output/rev6.60APT-2023-11-05_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal

/p/projects/rd3mod/inputdata/output/rev6.602dev_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal

/p/projects/rd3mod/inputdata/output/rev6.601-madrat_3.6.11.9001_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal

/p/projects/rd3mod/inputdata/output/rev6.593_62eff8f7_validationremind.tgz
Cap|Electricity|Geothermal
fbenke-pik commented 9 months ago

Right, the underlying problems in mrremind should have been solved and therefore the next inputdata revision should be fine again. (6.605 is from the beginning of November)

fbenke-pik commented 9 months ago

@LaviniaBaumstark confirmed that she will start new inputdata generation shortly

fbenke-pik commented 9 months ago

Lavinia created rev6.606. @robertpietzcker can you use this in your runs?

robertpietzcker commented 9 months ago

how to find that out? it was checked out from remindmodel/remind ~24th of November

0UmfHxcvx5J7JoaOhFSs5mncnisTJJ6q commented 9 months ago

how to find that out?

Die Antwort auf diese Frage würde Teile der Bevölkerung verunsichern.

0UmfHxcvx5J7JoaOhFSs5mncnisTJJ6q commented 9 months ago

There are differences in the both the values as well as the dimensions of the data (maybe set elements have been renamed?)

$ inputdata-comparedata /p/projects/rd3mod/inputdata/output/rev6.605_62eff8f7_remind.tgz /p/projects/rd3mod/inputdata/output/rev6.606_62eff8f7_remind.tgz 2>&1 | grep -Ev "(skipped|OK)$"
1 file(s) missing in x: f_incinerationShares.cs4r
(1/154)   annual_mileage.cs4r                 ... != dim
(7/154)   esCapCost.cs4r                      ... != dim
(12/154)  f_fedemand_build.cs4r               ... != dim
(13/154)  f_fedemand.cs4r                     ... != dim
(16/154)  f_IO_trade.cs4r                     ... != dim
(19/154)  f_macBaseMagpie.cs4r                ... != values (max diff = 1e-05)
(26/154)  f04_IO_input.cs4r                   ... != dim
(27/154)  f04_IO_output.cs4r                  ... != dim
(41/154)  f29_capitalQuantity.cs4r            ... != dim
(43/154)  f29_efficiency_growth.cs4r          ... != dim
(44/154)  f29_esdemand.cs4r                   ... != dim
(55/154)  f35_bunkers_fe.cs4r                 ... != dim
(59/154)  f36_floorspace_scen.cs4r            ... != dim
(60/154)  f36_uedemand_build.cs4r             ... != dim
(70/154)  fe_demand_tech.cs4r                 ... != dim
(71/154)  fe2es.cs4r                          ... != dim
(75/154)  harmonized_intensities.cs4r         ... != dim
(76/154)  loadFactor.cs4r                     ... != dim
(77/154)  logit_exponent.cs4r                 ... != dim
(78/154)  p_abatparam_CH4.cs4r                ... != values (max diff = 0.011658)
(80/154)  p_abatparam_N2O.cs4r                ... != values (max diff = 0.008153)
(110/154) p30_biolcResidues.cs3r              ... != values (max diff = 7.79451)
(115/154) p36_floorspace_scen.cs4r            ... != dim
(116/154) p36_serviceInputs.cs4r              ... != dim
(117/154) p36_serviceOutputs.cs4r             ... != dim
(118/154) p37_chemicals_feedstock_share.cs4r  ... != values (max diff = 0.26)
(132/154) pm_dataccs.cs3r                     ... != values (max diff = 0.12554361)
(135/154) pm_fe_demand_EDGETbased.cs4r        ... != dim
(144/154) pm_trp_demand.cs4r                  ... != dim
(145/154) pref.cs4r                           ... != dim
(146/154) price_nonmot.cs4r                   ... != dim
(147/154) ptab4W.cs4r                         ... != dim
(151/154) UCD_NEC_iso.cs4r                    ... != dim
(152/154) value_time.cs4r                     ... != dim
[OK 115 | DIFF 34 | SKIP 5 | MISS 0]
0UmfHxcvx5J7JoaOhFSs5mncnisTJJ6q commented 9 months ago

These differences can be due to anything in the list below, as well as changes to the input data files, which we do not track.

$ inputdata-commithist /p/projects/rd3mod/inputdata/output/rev6.605_62eff8f7_remind.tgz /p/projects/rd3mod/inputdata/output/rev6.606_62e
ff8f7_remind.tgz 
data.table is not an internal library
edgeTransport commits between 1.2.0 and 1.3.0
615f5b0 Camp scenarios (#230) 
Thu Nov 2 18:48:35 2023 +0100 https://github.com/pik-piam/edgeTransport/commit/615f5b0

e9e46db Merge pull request #234 from johannah-pik/master Adjust PhOP for Trucks and Busses in standard scenarios
Fri Oct 13 13:40:11 2023 +0200 https://github.com/pik-piam/edgeTransport/commit/e9e46db

See full comparison at https://github.com/pik-piam/edgeTransport/compare/50f8ca0d48d8a682a537d4ec359f3b31dd67007f..615f5b0ed1444da97a002a157464798ceff53ab4

madrat commits between 3.6.10 and 3.7.3
94e7df8 allow missing years in calcOutput 
Fri Nov 24 15:12:03 2023 +0100 https://github.com/pik-piam/madrat/commit/94e7df8

e544b37 Merge pull request #192 from tscheypidi/master bugfix in retrieveData
Mon Nov 20 10:40:35 2023 +0100 https://github.com/pik-piam/madrat/commit/e544b37

59520bf Merge pull request #190 from fbenke-pik/master add writeArgs to calcOutput
Wed Nov 8 16:13:57 2023 +0100 https://github.com/pik-piam/madrat/commit/59520bf

b65b40c Merge pull request #188 from robinhasse/devMappings extend toolGetMapping() to also fetch mappings from packages during development, i.e. loaded via devtools::load_all()
Fri Nov 3 18:37:21 2023 +0100 https://github.com/pik-piam/madrat/commit/b65b40c

4f0688d Merge pull request #187 from fbenke-pik/master enhance country2iso dictionary (used to read in data from Global Ener…
Tue Oct 17 14:06:55 2023 +0200 https://github.com/pik-piam/madrat/commit/4f0688d

See full comparison at https://github.com/pik-piam/madrat/compare/55ce17a4894643cb47d2376e5a89e242c6279333..94e7df8cb02885b0e720263dbd9737c03b598807

magclass commits between 6.11.1 and 6.11.3
68e40ed add test for write.report 
Fri Nov 10 16:43:01 2023 +0100 https://github.com/pik-piam/magclass/commit/68e40ed

33ac71f Merge pull request #160 from fbenke-pik/master handle writing all-NA magclass objects in write.report
Fri Nov 10 13:07:54 2023 +0100 https://github.com/pik-piam/magclass/commit/33ac71f

5b7f63c Merge pull request #158 from tscheypidi/master added consistency check to mbind
Wed Sep 6 14:27:37 2023 +0200 https://github.com/pik-piam/magclass/commit/5b7f63c

See full comparison at https://github.com/pik-piam/magclass/compare/91efabb3dc6d28820854d709afc9145531022d5f..68e40ed59b503b091576fc71b6054f97fcdd3263

mrcommons commits between 1.36.1 and 1.37.3
ba6df6b update dependencies to GTAPv9 
Tue Nov 28 14:00:47 2023 +0100 https://github.com/pik-piam/mrcommons/commit/ba6df6b

96a1ed7 update to GTAPv9 
Tue Nov 28 13:32:38 2023 +0100 https://github.com/pik-piam/mrcommons/commit/96a1ed7

4877558 Multiple cropping suitability correction in calcCropareaLandInG 
Mon Nov 27 18:45:36 2023 +0100 https://github.com/pik-piam/mrcommons/commit/4877558

2980101 Merge pull request #99 from FelicitasBeier/Clustering2 magpie 67k
Wed Nov 8 16:26:13 2023 +0100 https://github.com/pik-piam/mrcommons/commit/2980101

5e35b37 update of LandInG data in all function calls 
Fri Oct 27 11:13:20 2023 +0200 https://github.com/pik-piam/mrcommons/commit/5e35b37

912b0a7 bugfix in readLUH2v2 related to aggregation from 0.25 to 0.5 degrees and small fix in readLandInG 
Mon Oct 23 17:01:08 2023 +0200 https://github.com/pik-piam/mrcommons/commit/912b0a7

7a846fd bugfix in readLandInG harvested area part 
Fri Oct 20 17:45:10 2023 +0200 https://github.com/pik-piam/mrcommons/commit/7a846fd

72b81e8 re-wrote the readLandInG using read_io function 
Fri Oct 20 17:23:03 2023 +0200 https://github.com/pik-piam/mrcommons/commit/72b81e8

58bb691 added new additional LandInG functions for new Landuse Toolbox data processing 
Fri Oct 20 15:25:26 2023 +0200 https://github.com/pik-piam/mrcommons/commit/58bb691

ad60881 bugfix related to fallowland in future in calcCropareatoolbox 
Thu Oct 19 18:14:45 2023 +0200 https://github.com/pik-piam/mrcommons/commit/ad60881

64f378b added future (constant) for fallow land 
Thu Oct 19 17:05:14 2023 +0200 https://github.com/pik-piam/mrcommons/commit/64f378b

8bb5e00 fixed memory issues in calcCropareaToolbox 
Thu Oct 19 16:07:14 2023 +0200 https://github.com/pik-piam/mrcommons/commit/8bb5e00

b2637c7 Merge pull request #96 from fbenke-pik/iea remove 2021 from IEA Energy Balances due to incompleteness
Thu Oct 19 12:00:24 2023 +0200 https://github.com/pik-piam/mrcommons/commit/b2637c7

See full comparison at https://github.com/pik-piam/mrcommons/compare/b0a18cf2cd622d4e0bc377cbc9b30d72596db8cd..ba6df6b26fa8d8b124c5968c305fe7ea0fdabde6

mrdrivers has no changes (1.4.0)

mrfactors commits between 0.3.5 and 0.3.6
20010eb update dependencies on GTAP81 
Tue Nov 28 13:50:35 2023 +0100 https://github.com/pik-piam/mrfactors/commit/20010eb

See full comparison at https://github.com/pik-piam/mrfactors/compare/8e053227c631a37752bb7a226971809cd990b400..20010eb89091e7eca054f1b0ccec4a94b2439f55

mrland commits between 0.50.15 and 0.51.2
77732b7 Harmonization of perennial treatment for multiple cropping and moving functions that are required in mrcommons now 
Mon Nov 27 18:46:26 2023 +0100 https://github.com/pik-piam/mrland/commit/77732b7

80c8845 Removed .orig file that sneaked in through merge in Clustering branch and include numerical correction in calcMulticroppingCells 
Tue Nov 21 11:29:05 2023 +0100 https://github.com/pik-piam/mrland/commit/80c8845

f45e2d9 Merge pull request #39 from FelicitasBeier/Clustering Clustering
Wed Nov 8 16:39:40 2023 +0100 https://github.com/pik-piam/mrland/commit/f45e2d9

a510288 bugfix in calcMulticroppingSuitability: mgrass was in two sets 
Wed Nov 8 14:15:53 2023 +0100 https://github.com/pik-piam/mrland/commit/a510288

b64dc95 excluded mgrass and pasture from croplist in calcMulticroppingSuitability 
Wed Nov 8 10:38:53 2023 +0100 https://github.com/pik-piam/mrland/commit/b64dc95

90cd2de handing over sectoral argument in calcMulticroppingCells 
Tue Nov 7 10:09:33 2023 +0100 https://github.com/pik-piam/mrland/commit/90cd2de

8d901e6 Excluded trro from test for now. 
Mon Nov 6 16:49:59 2023 +0100 https://github.com/pik-piam/mrland/commit/8d901e6

5945138 reintroduced labor regression that accidentally got lost in PR probably due to merge conflict 
Mon Nov 6 09:40:02 2023 +0100 https://github.com/pik-piam/mrland/commit/5945138

339cee8 small bugfix: wrong parentheses in check in calcMulticroppingIntensity 
Mon Nov 6 09:11:46 2023 +0100 https://github.com/pik-piam/mrland/commit/339cee8

7b12b86 bugfix with respect to crop selection in calcMulticroppingIntensity 
Sat Nov 4 09:35:07 2023 +0100 https://github.com/pik-piam/mrland/commit/7b12b86

59c4b1e fleixbilized Multicropping functions w.r.t crop selection 
Fri Nov 3 18:34:56 2023 +0100 https://github.com/pik-piam/mrland/commit/59c4b1e

72518a6 update of LandInG data 
Fri Oct 27 11:12:22 2023 +0200 https://github.com/pik-piam/mrland/commit/72518a6

6c291dd fixed changed function argument in terra::cellSize 
Thu Oct 19 12:53:33 2023 +0200 https://github.com/pik-piam/mrland/commit/6c291dd

648a015 Merge pull request #38 from pfuehrlich-pik/master add where arg to toolGetMapping
Mon Oct 16 12:15:23 2023 +0200 https://github.com/pik-piam/mrland/commit/648a015

See full comparison at https://github.com/pik-piam/mrland/compare/5bd0aef1b7a9626c463ace0d2aae92890c707760..77732b7fd7ce44d9e12dc18dfe3cbf9554e159e7

mrmagpie commits between 1.38.1 and 1.39.1
639f72a calcPastureSuit bugfix 
Sat Nov 25 00:11:27 2023 +0100 https://github.com/pik-piam/mrmagpie/commit/639f72a

e125b47 removed line that addeded name to values dim in output. 
Fri Nov 24 21:14:39 2023 +0100 https://github.com/pik-piam/mrmagpie/commit/e125b47

b641dd6 fuehrlich -> sauer 
Wed Nov 22 12:17:49 2023 +0100 https://github.com/pik-piam/mrmagpie/commit/b641dd6

6db7635 Merge pull request #36 from FelicitasBeier/Clustering magpie 67k
Wed Nov 8 17:22:54 2023 +0100 https://github.com/pik-piam/mrmagpie/commit/6db7635

db65015 bugfix transpor costs warning 
Mon Oct 30 13:41:49 2023 +0100 https://github.com/pik-piam/mrmagpie/commit/db65015

9afb138 bugfix renaming 
Fri Oct 27 09:18:02 2023 +0200 https://github.com/pik-piam/mrmagpie/commit/9afb138

7f25972 memory bugfix fooddemandgridded 
Thu Oct 26 13:14:45 2023 +0200 https://github.com/pik-piam/mrmagpie/commit/7f25972

cec4bbb update transport functions 
Wed Oct 25 17:36:25 2023 +0200 https://github.com/pik-piam/mrmagpie/commit/cec4bbb

3590c7f Merge branch 'master' of https://github.com/pik-piam/mrmagpie 
Wed Oct 25 16:37:14 2023 +0200 https://github.com/pik-piam/mrmagpie/commit/3590c7f

8e40dc4 update tranposrt functions 
Wed Oct 25 16:37:12 2023 +0200 https://github.com/pik-piam/mrmagpie/commit/8e40dc4

See full comparison at https://github.com/pik-piam/mrmagpie/compare/bbcccf92ea6ea789b861a92c1683b1e85e9e2f54..639f72a868d186fd7b4ca98a8bde2ddbacbdb074

mrremind commits between 0.170.1 and 0.172.0
728fbca final fix to comply with tests 
Thu Nov 23 11:51:02 2023 +0100 https://github.com/pik-piam/mrremind/commit/728fbca

1f9a2ae final styling 
Tue Nov 21 18:00:23 2023 +0100 https://github.com/pik-piam/mrremind/commit/1f9a2ae

62e8a37 Merge branch 'master' of https://github.com/pik-piam/mrremind into add-incineration-trajectories 
Tue Nov 21 16:54:00 2023 +0100 https://github.com/pik-piam/mrremind/commit/62e8a37

d04233e bugfix to avoid domain violation in f_incinerationShares.cs4r: interpolate missing years, correct intervals after 2010, and remove redundant dimension 
Wed Aug 16 16:44:40 2023 +0200 https://github.com/pik-piam/mrremind/commit/d04233e

556f2f8 remove unused dimensions from f_incinerationShares.cs4r 
Tue Aug 15 14:10:02 2023 +0200 https://github.com/pik-piam/mrremind/commit/556f2f8

a2c9c05 Merge branch 'add-incineration-trajectories' of github.com:mellamoSimon/mrremind into add-incineration-trajectories 
Wed Jul 19 08:09:52 2023 +0200 https://github.com/pik-piam/mrremind/commit/a2c9c05

06781f3 add calcPlasticsEoL.R to calculate incineration shares for plastic waste 
Tue Jul 18 16:08:53 2023 +0200 https://github.com/pik-piam/mrremind/commit/06781f3

0453621 add mapping to include in version tracking 
Mon Jul 17 18:19:49 2023 +0200 https://github.com/pik-piam/mrremind/commit/0453621

See full comparison at https://github.com/pik-piam/mrremind/compare/a8464d217fc2c2355cf5d3f5502d3715f5f134a4..728fbca8b8456ab1d3b0a4cd7d5f898046d59036

mrvalidation commits between 2.51.6 and 2.52.0
0d50ebe build 
Wed Nov 8 16:40:52 2023 +0100 https://github.com/pik-piam/mrvalidation/commit/0d50ebe

a1a1acc merge master branch into clustering branch Merge branch 'master' into Clustering

# Conflicts:
#   .buildlibrary
#   CITATION.cff
#   DESCRIPTION
#   R/calcValidCostsTransport.R
#   README.md

Fri Oct 27 14:50:04 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/a1a1acc

393e0dc bugfix aggregate calls (with na.rm = TRUE) 
Tue Oct 24 15:34:34 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/393e0dc

50c7642 remove now obsolete lines 
Fri Oct 20 12:02:11 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/50c7642

e84e9e3 fix 67k related problems 
Mon Oct 16 16:09:08 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/e84e9e3

a66cfeb Merge branch 'master' of github.com:pik-piam/mrvalidation into Clustering 
Mon Oct 16 15:45:46 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/a66cfeb

7afed40 Merge branch 'Clustering' of github.com:FelicitasBeier/mrvalidation into Clustering 
Mon Oct 16 13:51:09 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/7afed40

73b1aba Merge branch 'Clustering' of github.com:FelicitasBeier/mrvalidation into Clustering 
Thu Oct 12 17:40:48 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/73b1aba

651c80e avoid term celliso 
Thu Oct 12 17:36:52 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/651c80e

7d72cf4 cleanup 
Thu Oct 12 10:48:36 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/7d72cf4

d2b6e47 ValidLSUdensity 67k support 
Thu Oct 12 10:42:06 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/d2b6e47

ff52693 update dev rev 
Fri Sep 22 18:23:52 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/ff52693

b49a518 merge master into Clustering branch Merge branch 'master' into Clustering

# Conflicts:
#   .buildlibrary
#   CITATION.cff
#   DESCRIPTION
#   R/calcValidCostsTransport.R
#   README.md

Fri Aug 18 13:31:23 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/b49a518

3dcf0a2 merged master with clustering branch Merge branch 'master' into Clustering

# Conflicts:
#   .buildlibrary
#   CITATION.cff
#   DESCRIPTION
#   README.md

Wed May 10 18:27:55 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/3dcf0a2

d0254cf merge master into Clustering branch Merge branch 'master' into Clustering

# Conflicts:
#   .buildlibrary
#   CITATION.cff
#   DESCRIPTION
#   README.md

Wed Apr 26 18:36:35 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/d0254cf

5aa52c0 soil grids now returns 67420 cells 
Mon Apr 24 16:10:25 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/5aa52c0

72af74f development version number added 
Fri Apr 21 12:49:59 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/72af74f

c11b017 Merge branch 'Clustering' 
Fri Apr 21 11:46:26 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/c11b017

7cf7d29 bugfixes related to 67k cells 
Tue Apr 4 09:47:36 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/7cf7d29

1bb6e3b build library and linter fixes 
Fri Mar 31 10:21:16 2023 +0200 https://github.com/pik-piam/mrvalidation/commit/1bb6e3b

396ca45 added development number 
Fri Mar 24 14:52:17 2023 +0100 https://github.com/pik-piam/mrvalidation/commit/396ca45

75e50be changes related to 67k cells 
Fri Mar 24 12:12:56 2023 +0100 https://github.com/pik-piam/mrvalidation/commit/75e50be

See full comparison at https://github.com/pik-piam/mrvalidation/compare/1f60b60eeb7831c689286e5d8143c90f8574df04..0d50ebe9158dffb10dbb3038f3b48de148d338dd

mrwater commits between 1.9.32 and 1.11.7
8366b31 Bugfix set dimension 
Tue Nov 28 15:22:45 2023 +0100 https://github.com/pik-piam/mrwater/commit/8366b31

fdf045e added comment to explain why betr and begr set to 0 
Tue Nov 28 14:09:20 2023 +0100 https://github.com/pik-piam/mrwater/commit/fdf045e

1d96a26 Bugfix: missing crops in second season BWC added. 
Tue Nov 28 14:08:31 2023 +0100 https://github.com/pik-piam/mrwater/commit/1d96a26

2591a0a bugfix: remove pasture from croplist in calcBlueWaterConsumption 
Tue Nov 28 11:30:37 2023 +0100 https://github.com/pik-piam/mrwater/commit/2591a0a

ee12bfa Harmonization of perennial crop treatment in mrwater mrland and mrcommons 
Mon Nov 27 18:00:20 2023 +0100 https://github.com/pik-piam/mrwater/commit/ee12bfa

bfe223e updated Protection Area to new functions. Note: underlying functions should be checked by Patrick. There were inconsistencies in additivity and the total available land area 
Fri Nov 24 11:55:04 2023 +0100 https://github.com/pik-piam/mrwater/commit/bfe223e

0df6758 re-trigger r-universe 
Wed Nov 22 14:26:20 2023 +0100 https://github.com/pik-piam/mrwater/commit/0df6758

2deb830 temporary correction of mismatches due to lpj-magpie crop mapping until more generic fix is found 
Thu Nov 9 12:28:08 2023 +0100 https://github.com/pik-piam/mrwater/commit/2deb830

1a7ac98 bugfixing calcPotMulticroppingShare 
Thu Nov 9 10:05:32 2023 +0100 https://github.com/pik-piam/mrwater/commit/1a7ac98

b903a78 Merge pull request #8 from FelicitasBeier/Clustering magpie 67k
Wed Nov 8 17:02:21 2023 +0100 https://github.com/pik-piam/mrwater/commit/b903a78

a235a09 renaming of Potential functions and removing cropAggregation argument where it is not defined 
Tue Nov 7 10:00:46 2023 +0100 https://github.com/pik-piam/mrwater/commit/a235a09

c17f5d4 renaming of Potential functions and correction of cropmix argument 
Mon Nov 6 10:40:51 2023 +0100 https://github.com/pik-piam/mrwater/commit/c17f5d4

93a1079 bugfix related to cropmix argument in calcCropAreaPotIrrig 
Mon Nov 6 09:30:10 2023 +0100 https://github.com/pik-piam/mrwater/commit/93a1079

affe8d0 introduced new river routing run between committed agriculture and potential irrigation: intensification to full multiple cropping on currently irrigated areas 
Fri Nov 3 19:00:46 2023 +0100 https://github.com/pik-piam/mrwater/commit/affe8d0

9b19f8e flexibilize multicropping function to test different settings 
Tue Oct 31 12:24:16 2023 +0100 https://github.com/pik-piam/mrwater/commit/9b19f8e

a233aa8 switched to new LandInG data (consistent with LUH) 
Fri Oct 27 11:17:06 2023 +0200 https://github.com/pik-piam/mrwater/commit/a233aa8

28963ef re-wrote fossilGW implementation to make it as last step to solve negative rainfed areas issue 
Thu Oct 26 17:10:57 2023 +0200 https://github.com/pik-piam/mrwater/commit/28963ef

See full comparison at https://github.com/pik-piam/mrwater/compare/9d5898a3b0511745a36b5e97edc5d9e5685f15aa..8366b3154abcf2c453502b933533fa896df3dfc1

mstools has no changes (0.3.0)
0UmfHxcvx5J7JoaOhFSs5mncnisTJJ6q commented 9 months ago

But if you just care about the historical.mif for the scenario comparison plots, you can replace it with the new version. The plots will work, and the historical data should only get "better". No idea which file the scenario comparison script is using, just replace them all.

$ tar -Oxf /p/projects/rd3mod/inputdata/output/rev6.606_62eff8f7_validationremind.tgz ./historical.mi
f > core/input/historical/historical.mif
$ find ./output/ -type f -name historical.mif -exec cp ./core/input/historical/historical.mif \{\} \;
robertpietzcker commented 9 months ago

thanks a lot to both of you!

so I close this issue, right?