Must-run Profiles for MO start on same weekday regardless of year

[Richard-Deuchler]

I had a look at the profiles in Dropbox/Quintel/Projects/Merit order/Part Two (EnergieNederland)/Data/Curves and found out that

• all building_chp profiles start on a _Sunday_ (for 2009, 2010 and 2011).
• industry_chp are not concerned as they are always on.
• agriculture_chp always start on a _Saturday_ (for 2009, 2010 and 2011).

However, the demand (data from TenneT) starts on the weekday that the year actually begins with. This would be a _Thursday_ for 2009 and a _Friday_ for 2010. Therefore, the profiles need to be time-shifted!

I have plotted the first two weeks, respecively

[Richard-Deuchler]

assigning to me.

[Richard-Deuchler]

another strange thing: The buildings CHP profile is based on the annual natural gas consumption per household. This data has been researched by Chris (source: unknown). The document is in Dropbox/Quintel/Projects/ClimateSlider20120831 and called verbruik huishouden NL.xlsx. _However, the document contains data until the end of 2012, while the document itself is created before the end of 2012._

---

edit: The data of the document comes from a model from GasTerra. It forecasts the hourly demand for gas and does not measure it.

[Richard-Deuchler]

I made new data-sets that contain corrected profiles. ~/Dropbox/Quintel/Projects/Merit order/Part Two (EnergieNederland)/Data/Curves RD new/2010

The dataset for 2010 is complete and functional (only the buildings_CHP is based on (shifted) 2012 data) The dataset for 2012 is complete and can be used for comparison, sensitivity analysis... A dataset for 2011 is coming up soon

assigning to @ChaelKruip

[ChaelKruip]

@Richard-Deuchler thanks for the work! There is one detail left, however: after some inspection I found that the profiles have quite different significant digits. The output from my terminal when using "wc" (word count) on the current profiles and your profiles shows that some of the new ones have (much) less bits of information (third column) then the original ones:

➜  load_profiles git:(master) wc ~/Dropbox/Quintel/Projects/Merit\ order/Part\ Two\ \(EnergieNederland\)/Data/Curves\ RD\ new/2010/*.csv
       0    8760   56847 /Users/kruip/Dropbox/Quintel/Projects/Merit order/Part Two (EnergieNederland)/Data/Curves RD new/2010/agriculture_chp.csv
       0    8760  236519 /Users/kruip/Dropbox/Quintel/Projects/Merit order/Part Two (EnergieNederland)/Data/Curves RD new/2010/buildings_chp.csv
    8759    8760  105119 /Users/kruip/Dropbox/Quintel/Projects/Merit order/Part Two (EnergieNederland)/Data/Curves RD new/2010/industry_chp.csv
       0    8760  105119 /Users/kruip/Dropbox/Quintel/Projects/Merit order/Part Two (EnergieNederland)/Data/Curves RD new/2010/solar_pv.csv
       0    8760   78839 /Users/kruip/Dropbox/Quintel/Projects/Merit order/Part Two (EnergieNederland)/Data/Curves RD new/2010/total_demand.csv
       0    8760  105119 /Users/kruip/Dropbox/Quintel/Projects/Merit order/Part Two (EnergieNederland)/Data/Curves RD new/2010/wind_coastal.csv
       0    8760  105119 /Users/kruip/Dropbox/Quintel/Projects/Merit order/Part Two (EnergieNederland)/Data/Curves RD new/2010/wind_inland.csv
       0    8760  100139 /Users/kruip/Dropbox/Quintel/Projects/Merit order/Part Two (EnergieNederland)/Data/Curves RD new/2010/wind_offshore.csv
    8759   70080  892820 total
➜  load_profiles git:(master) wc *.csv
    8759    8760  105119 agriculture_chp.csv
    8759    8760  105119 buildings_chp.csv
    8759    8760  105119 industry_chp.csv
    8759    8760  105119 river.csv
    8759    8760  105119 solar_pv.csv
    8759    8760  105119 total_demand.csv
    8759    8760  105119 wind_coastal.csv
    8759    8760  105119 wind_inland.csv
    8759    8760  105119 wind_offshore.csv
   78831   78840  946071 total

@Richard-Deuchler please ask @JAlsem on how he made the original profiles with 5 significant digits. Assigned to @Richard-Deuchler

[Richard-Deuchler]

2010 profiles have been corrected in Dropbox/Quintel/Projects/Merit order/Part Two (EnergieNederland)/Data/Curves RD new/2010 assigning back to @ChaelKruip

[Richard-Deuchler]

I checked with Anne Braaksma (GasTerra) if we could have more data about the residential gas use (for making the buildings_CHP profile). He assured me that the temperature (and therefore also gas use) was very similar in 2010 and 2011. I suggest, we keep using the original buildijngs_chp for the years 2010-2012. It only requires a time-shift, so that the weekends match.

[ChaelKruip]

It only requires a time-shift, so that the weekends match.

@Richard-Deuchler did you already incorporate that shift in your profiles (in Dropbox/Quintel/Projects/Merit order/Part Two (EnergieNederland)/Data/Curves RD new/2010)? How about the other years?

[Richard-Deuchler]

relevant for the milestone: Only the buildings and agriculture profiles needed a time shift to match the 2010 weekends. This step has been done by me. (there is a mathematica notebook in the ABOUT folder, which should show that demand, buildings and agriculture profiles are in sync).

Unfortunately, there was an issue with the "newline commands" when saving the profiles to csv ( \n vs. \r ). Saving the profiles as Windows-CSV (Excel save-as file format) should solve this problem (only relevant for Mac). But this procedure has not been tested.

I updated buildings and agriculture. @ChaelKruip , could you double-check whether the newline commands are ok now? Then these two are ready to go (and all 2010 profiles will be in sync).

to be discussed: I also made changes to the wind and solar profiles in order to match the full load hours defined in the ETM. We should have a discussion on these profiles when I am back in the office. So for now, I only suggest to upload buildings and agriculture.

[ChaelKruip]

Closed with https://github.com/quintel/merit/commit/7236558ead650dcaf50a63189b5c68177d8b8e34