Errors in November upload files

[nheeren]

The new files in 'NEW_TABLE_2' contain errors that need to be resolved before the scripts can process them.

• [x] 6_URB_MetabolismOfCities_Jan2019_DOI_7326485.v1
  • [x] Duplicate entry '10055-Natural gas' for key 'UC_classification_items'
  • [x] Fixed lower-case issues
  • [x] The following unit is not in units table: {1, 'HDD', 'kt'}
  • [x] renamed Gg BOD, Gg COD, day
• [x] 4_PY_YSTAFDB_EoL_RecoveryRate_v1.0
  • [x] D26:D49 must correspond to F12:I21
  • [x] Added dataset_size = 0
  • [x] Fixed column headers in Data sheet
  • [x] Removed space in data sheet column 1
• [x] 6_MIP_YSTAFDB_MetalUseShares_v1.0
  • [x] Faulty classification names in Cover!F12:H14
  • [x] 'Data layer' in Cover!D10 must be fixed
  • [x] Values 2010-2012 and 2008 not found in classification_items
  • [x] Added dataset_size = 1
  • [x] Fixed column headers in Data sheet
• [x] 6_CR_YSTAFDB_criticality_2019_v1.0
  • [x] Faulty classification names in Cover!F12:H14 @stefanpauliuk please verify
  • [x] 'Data layer' in Cover!D10 must be fixed
  • [x] 'dataset_size' set to 0
  • [x] apect_1 changed to 38
  • [x] Changed aspect_5 column to 2
  • [x] Renamed sheet comment to Comment
  • [x] 'dataset_size' set to 0
• [x] 6_CR_YSTAFDB_criticality_vsr_2019_v1.0
  • [x] Faulty classification names in Cover!F12:H14
  • [x] 'Data layer' in Cover!D10 must be fixed
  • [x] Changed aspect_5 column to 2
  • [x] Renamed sheet comment to Comment
  • [x] 'dataset_size' set to 0
• [x] 6_CR_YSTAFDB_criticality_sr_2019_v1.0
  • [x] Changed aspect_5 column to 2
  • [x] Renamed sheet comment to Comment
  • [x] 'dataset_size' set to 0
  • [x] Faulty classification names in Cover!F12:H14
  • [x] 'Data layer' in Cover!D10 must be fixed
• [x] 6_CR_YSTAFDB_criticality_ei_2019_v1.0.xlsx
  • [x] 'dataset_size' set to 0
  • [x] Faulty classification names in Cover!F12:H14. Changed YSTAFDB_materials, time, YSTAFDB_criticality_regional_scope, YSTAFDB_criticality_timeframe to material, time, region, time_frame, etc. @stefanpauliuk please verify
  • [x] 'Data layer' in Cover!D10 must be fixed
  • [x] Changed aspect_5 column to 2
  • [x] Renamed sheet comment to Comment
• [x] 1_F_Wood_Carbon_MFA_Indonesia_Aryapratama_2019 uploaded
• [x] 3_LT_Wood_Carbon_MFA_Indonesia_Aryapratama_2019 uploaded
• [x] 1_F_UN_Global_Material_Flows_Database uploaded
• [x] 2_IUS_Wood_Carbon_MFA_Indonesia_Aryapratama_2019 uploaded

[stefanpauliuk]

'Data layer' should be "Misc. units", with lower case u.

[nheeren]

Could you fix those files? If you do it within the next hour I can give it another go.

[stefanpauliuk]

The classification with name YSTAFDB_material_groups exists under id 41 in the review database. There are 11 classf. with id from 37 to 47, which all start with YSTAFDB

[nheeren]

OK. Strange why the script doesn't find them. Will investigate.

[stefanpauliuk]

Shall I still add the correct layer to the files in the dropbox? Can do that now, no problem.

[nheeren]

I believe the problem is rather that D26:D49 must correspond to F12:I21. Would you agree?

[stefanpauliuk]

Oh yes... Probably got confused by my own template. Will check and notify you once the files are fixed.

[stefanpauliuk]

Fixed all YSTAFDB files. Please try again!

[nheeren]

6_MIP_YSTAFDB_MetalUseShares_v1.0 has Values not found in classification_items, i.e. 2010-2012 and 2008

[nheeren]

Shouldn't aspect_1 in 6_CR_YSTAFDB_criticality_2019_v1.0.xlsx be 38?

[nheeren]

Shouldn't aspect_1 in 6_CR_YSTAFDB_criticality_2019_v1.0.xlsx be 38?

Yes (see updates in top post)

[stefanpauliuk]

6_MIP_YSTAFDB_MetalUseShares_v1.0 has Values not found in classification_items, i.e. 2010-2012 and 2008 --> The corresponding classification id is 14, not 9. I changed the data template file, please try again!

[stefanpauliuk]

Is 6_URB_MetabolismOfCities_Jan2019_DOI_7326485.v1 OK?

[nheeren]

Thanks for the fixes. One last dataset remaining!!

6_URB_MetabolismOfCities_Jan2019_DOI_7326485.v1.xlsx: Duplicate entry '10055-Natural gas' for key 'UC_classification_items' Any ideas?

[stefanpauliuk]

Hm. This is a custom classification created on the spot. Guess you already use the set-command to only enter unique classification items...

Will then update the dataset sizes tomorrow, make the mysql dump backup, and post the whole thing on Friday! :)))

[nheeren]

Found it! Again lower-case issues...

New problem: The following unit is not in units table: {1, 'HDD', 'kt'}

[stefanpauliuk]

1 is strange, because it is in there. Maybe as '1'? kt runs under Gg, will modify template accordingly. I overlooked HDD, will add it now.

[nheeren]

Thank you! Yeah 1 is weird. I thought I had fixed that ages ago. Checking...

[stefanpauliuk]

HDD is now in, kt changed to Gg in template.

[nheeren]

'Gg COD', 'Gg BOD' do not exist, however. Only kt.

[nheeren]

Changed them to kt COD and kt BOD. Now stuck with 'day'.

[stefanpauliuk]

day should be 'd'.

[stefanpauliuk]

Sorry for the kt BOD... that was the find and replace fix impact that I overlooked.

[nheeren]

🚀 We made it! 6_URB_MetabolismOfCities_Jan2019_DOI_7326485.v1 is online. Thanks!!

[stefanpauliuk]

Wunderful! Thanks you so much Niko!!!