quintel / atlas

Ruby library for working with ETSource data
MIT License
5 stars 1 forks source link

What needs to be scaled and what doesn't need to be scaled? #55

Closed grdw closed 7 years ago

grdw commented 8 years ago

Output of tree etsource/datasets/example

datasets/example
├── central_producers.csv
├── demands
│   └── metal_demands.csv
├── efficiencies
│   ├── energy_cokesoven_consumption_coal_gas_efficiency.csv
│   ├── energy_cokesoven_transformation_coal_efficiency.csv
│   ├── energy_mixer_for_gas_power_fuel_efficiency.csv
│   ├── energy_steel_blastfurnace_bat_transformation_cokes_efficiency.csv
│   ├── energy_steel_blastfurnace_current_transformation_cokes_efficiency.csv
│   ├── industry_chemicals_fertilizers_steam_methane_reformer_hydrogen_efficiency.csv
│   ├── industry_refinery_transformation_crude_oil_efficiency.csv
│   ├── industry_steel_blastfurnace_bat_consumption_useable_heat_efficiency.csv
│   ├── industry_steel_blastfurnace_current_consumption_useable_heat_efficiency.csv
│   └── industry_transformation_generic_coal_efficiency.csv
├── energy_balance.csv
├── energy_balance.gpg
├── example.ad
├── load_profiles
│   └── total_demand.csv
├── primary_production.csv
├── shares
│   ├── agriculture_final_demand_electricity_parent_share.csv
│   ├── buildings_final_demand_coal_parent_share.csv
│   ├── buildings_final_demand_crude_oil_parent_share.csv
│   ├── buildings_final_demand_electricity_parent_share.csv
│   ├── buildings_final_demand_for_cooling_electricity_parent_share.csv
│   ├── buildings_final_demand_for_lighting_electricity_parent_share.csv
│   ├── buildings_final_demand_for_space_heating_electricity_parent_share.csv
│   ├── buildings_final_demand_for_space_heating_network_gas_parent_share.csv
│   ├── buildings_final_demand_network_gas_parent_share.csv
│   ├── buildings_final_demand_wood_pellets_parent_share.csv
│   ├── buildings_local_production_electricity_parent_share.csv
│   ├── buildings_useful_demand_after_motion_detection_light_child_share.csv
│   ├── buildings_useful_demand_cooling_child_share.csv
│   ├── buildings_useful_demand_for_space_heating_child_share.csv
│   ├── buildings_useful_demand_light_child_share.csv
│   ├── energy_distribution_hydrogen_child_share.csv
│   ├── energy_distribution_waste_mix_child_share.csv
│   ├── energy_distribution_wood_parent_share.csv
│   ├── energy_locally_available_hydrogen_before_p2g_child_share.csv
│   ├── energy_national_gas_network_natural_gas_child_share.csv
│   ├── energy_national_gas_network_natural_gas_greengas_child_share.csv
│   ├── industry_aluminium_burner_network_gas_parent_share.csv
│   ├── industry_final_demand_coal_non_energetic_parent_share.csv
│   ├── industry_final_demand_coal_parent_share.csv
│   ├── industry_final_demand_crude_oil_non_energetic_parent_share.csv
│   ├── industry_final_demand_crude_oil_parent_share.csv
│   ├── industry_final_demand_electricity_parent_share.csv
│   ├── industry_final_demand_for_chemical_coal_non_energetic_parent_share.csv
│   ├── industry_final_demand_for_chemical_coal_parent_share.csv
│   ├── industry_final_demand_for_chemical_crude_oil_non_energetic_parent_share.csv
│   ├── industry_final_demand_for_chemical_crude_oil_parent_share.csv
│   ├── industry_final_demand_for_chemical_electricity_parent_share.csv
│   ├── industry_final_demand_for_chemical_network_gas_non_energetic_parent_share.csv
│   ├── industry_final_demand_for_chemical_network_gas_parent_share.csv
│   ├── industry_final_demand_for_chemical_steam_hot_water_parent_share.csv
│   ├── industry_final_demand_for_chemical_wood_pellets_non_energetic_parent_share.csv
│   ├── industry_final_demand_for_chemical_wood_pellets_parent_share.csv
│   ├── industry_final_demand_for_metal_coal_parent_share.csv
│   ├── industry_final_demand_for_metal_electricity_parent_share.csv
│   ├── industry_final_demand_for_metal_network_gas_parent_share.csv
│   ├── industry_final_demand_for_metal_steam_hot_water_parent_share.csv
│   ├── industry_final_demand_for_other_coal_non_energetic_parent_share.csv
│   ├── industry_final_demand_for_other_coal_parent_share.csv
│   ├── industry_final_demand_for_other_crude_oil_non_energetic_parent_share.csv
│   ├── industry_final_demand_for_other_crude_oil_parent_share.csv
│   ├── industry_final_demand_for_other_electricity_parent_share.csv
│   ├── industry_final_demand_for_other_food_electricity_parent_share.csv
│   ├── industry_final_demand_for_other_network_gas_non_energetic_parent_share.csv
│   ├── industry_final_demand_for_other_network_gas_parent_share.csv
│   ├── industry_final_demand_for_other_paper_electricity_parent_share.csv
│   ├── industry_final_demand_for_other_steam_hot_water_parent_share.csv
│   ├── industry_final_demand_for_other_wood_pellets_non_energetic_parent_share.csv
│   ├── industry_final_demand_for_other_wood_pellets_parent_share.csv
│   ├── industry_final_demand_network_gas_non_energetic_parent_share.csv
│   ├── industry_final_demand_network_gas_parent_share.csv
│   ├── industry_final_demand_steam_hot_water_parent_share.csv
│   ├── industry_final_demand_wood_pellets_non_energetic_parent_share.csv
│   ├── industry_final_demand_wood_pellets_parent_share.csv
│   ├── industry_steel_blastfurnace_burner_coal_gas_parent_share.csv
│   ├── industry_transformation_generic_coal_parent_share.csv
│   ├── residences_final_demand_coal_parent_share.csv
│   ├── residences_final_demand_crude_oil_parent_share.csv
│   ├── residences_final_demand_electricity_parent_share.csv
│   ├── residences_final_demand_for_appliances_electricity_parent_share.csv
│   ├── residences_final_demand_for_cooking_electricity_parent_share.csv
│   ├── residences_final_demand_for_cooling_electricity_parent_share.csv
│   ├── residences_final_demand_for_hot_water_electricity_parent_share.csv
│   ├── residences_final_demand_for_hot_water_network_gas_parent_share.csv
│   ├── residences_final_demand_for_lighting_electricity_parent_share.csv
│   ├── residences_final_demand_for_space_heating_electricity_parent_share.csv
│   ├── residences_final_demand_for_space_heating_network_gas_parent_share.csv
│   ├── residences_final_demand_network_gas_parent_share.csv
│   ├── residences_final_demand_steam_hot_water_parent_share.csv
│   ├── residences_final_demand_wood_pellets_parent_share.csv
│   ├── residences_new_houses_useful_demand_for_cooling_child_share.csv
│   ├── residences_new_houses_useful_demand_for_heating_child_share.csv
│   ├── residences_old_houses_useful_demand_for_cooling_child_share.csv
│   ├── residences_old_houses_useful_demand_for_heating_child_share.csv
│   ├── residences_space_heater_micro_chp_network_gas_child_share.csv
│   ├── residences_useful_demand_for_cooling_after_insulation_parent_share.csv
│   ├── residences_useful_demand_for_hot_water_after_solar_heater_and_p2h_parent_share.csv
│   ├── residences_useful_demand_for_hot_water_for_houses_with_p2h_child_share.csv
│   ├── residences_useful_demand_for_hot_water_for_houses_with_solar_heater_child_share.csv
│   ├── residences_useful_demand_for_space_heating_after_insulation_for_houses_with_solar_heater_child_share.csv
│   ├── residences_useful_demand_for_space_heating_after_insulation_parent_share.csv
│   ├── residences_water_heater_fuel_cell_chp_network_gas_child_share.csv
│   ├── residences_water_heater_micro_chp_network_gas_child_share.csv
│   ├── residences_water_heater_solar_thermal_parent_share.csv
│   ├── transport_final_demand_bio_ethanol_parent_share.csv
│   ├── transport_final_demand_biodiesel_parent_share.csv
│   ├── transport_final_demand_diesel_parent_share.csv
│   ├── transport_final_demand_electricity_parent_share.csv
│   ├── transport_final_demand_for_road_electricity_parent_share.csv
│   ├── transport_final_demand_for_road_greengas_parent_share.csv
│   ├── transport_final_demand_for_road_natural_gas_parent_share.csv
│   ├── transport_final_demand_gasoline_parent_share.csv
│   ├── transport_road_mixer_compressed_network_gas_parent_share.csv
│   ├── transport_road_mixer_diesel_mix_parent_share.csv
│   ├── transport_road_mixer_gasoline_mix_parent_share.csv
│   ├── transport_road_mixer_lng_child_share.csv
│   ├── transport_shipping_mixer_diesel_child_share.csv
│   └── transport_shipping_mixer_lng_child_share.csv
└── time_curves
    ├── energy_distribution_woody_biomass_time_curve.csv
    ├── energy_extraction_coal_time_curve.csv
    ├── energy_extraction_crude_oil_time_curve.csv
    ├── energy_extraction_lignite_time_curve.csv
    ├── energy_extraction_natural_gas_time_curve.csv
    └── energy_extraction_uranium_oxide_time_curve.csv

5 directories, 125 files

What exactly needs to be scaled and what doesn't need to be scaled? I heared that @jorisberkhout recalled that there was an issue about this explaining that.


Files that needs to be changed when automatically generating a dataset:

etsource/datasets.yml (add a row with which dataset there is)
mv etsource/datasets/<local_dastaset>/<source_dataset>.ad -> etsource/datasets/<local_dastaset>/<local_dataset>.ad
jorisberkhout commented 8 years ago

I heared that @jorisberkhout recalled that there was an issue about this explaining that.

Not so much an issue, but the fact that we already have the possibility to scale a scenario. This is not an answer to your question, because the current scaling functionality scales the graph and the slider settings (right, @antw ?) and might serve as a source of inspiration.