electricitymaps / electricitymaps-contrib

The open source repository for Electricity Maps App and data parsers that enables a real-time visualisation of the CO2 emissions of electricity consumption
https://app.electricitymaps.com
GNU Affero General Public License v3.0
3.6k stars 945 forks source link

Real-time production data for South Korea #1563

Closed scottlee120 closed 4 years ago

scottlee120 commented 6 years ago

http://epsis.kpx.or.kr/epsisnew/selectMain.do

Data is provided in 5-minute intervals across the country as a whole. For now, there's only numbers on total production capacity (공급능력(MW)), actual production (현재부하(MW)), and a reserve capacity/ratio. Working on seeing if there's more detail on production mix.

The EN and KR versions are not the same - for live data, it seems available only on the KR version although CSV exports are available only on the EN version seemingly.

scottlee120 commented 6 years ago

http://epsis.kpx.or.kr/epsisnew/selectMainEpsMep.ajax

Chart data raw format

scottlee120 commented 6 years ago

Historical data by year with a composition breakdown (thermal, nuclear, etc.)

http://epsis.kpx.or.kr/epsisnew/selectEkesKepGrid.do?menuId=010400

systemcatch commented 6 years ago

Further info in #855 that might help you.

jarek commented 6 years ago

Hi @scottlee120, were you able to find real-time production mix for South Korea?

alixunderplatz commented 5 years ago

SUMMARY

From the data sources presented here and in #855, we could write a parser with all nuclear + hydro generation and fill the rest as "unknown". @brunolajoie @corradio do you think that is enough info to begin with?


nuclear hydro (incl. pumped storage) coal oil gas RES Sum
22,529 6,489 36,709 4,155 37,838 9,187 116,908

Nuclear is the sum of all these NPPs' units (22.5 GW):

Status of the NPPs (maintenance etc) http://cms.khnp.co.kr/sub/main05.do?mnCd=FN05


Hydro

Load

or from


I'll try to find some PV or wind sources and will try to provide an average emission factor for the unknown share ;)

brunolajoie commented 5 years ago

Thanks Alex! And I guess the power exchanges are not that big for South Korea, so doing the delta between total consumption and partial production would make sense. Let us know if you find wind or PV values (even historical only)

alixunderplatz commented 5 years ago

For the "unknown" share's carbon intensity, this could be helpful: http://www.keei.re.kr/keei/download/EnergyInfo2017.pdf

image

systemcatch commented 5 years ago

I'm thinking of taking a crack at writing a basic parser here, but before I start are we happy with @alixunderplatz's suggestion of a breakdown of nuclear, hydro and unknown (with a specific emissions factor)? Since there's no exchanges this setup shouldn't 'contaminate' the rest of the data set.

brunolajoie commented 5 years ago

I'm pretty much aligned with @alixunderplatz's suggestion! 👍

planetbb commented 5 years ago

This is monthly data breakdown into production source (KR, available up to DEC2017). Let me contact them for more updated veraion. BTW, why do you need real-time data anyway?

http://kosis.kr/statisticsList/statisticsListIndex.do?menuId=M_01_01&vwcd=MT_ZTITLE&parmTabId=M_01_01&parentId=G.1;G2.2;339_33901.3;#SelectStatsBoxDiv

jarek commented 5 years ago

BTW, why do you need real-time data anyway?

In some regions the production mix changes greatly on a daily basis. Check out California's CO2eq intensity when their solar kicks in as an example. Changes to European CO2 intensity from wind tend to take closer to 48 hours, but nevertheless make a big difference. Electricity Map was built to track (and predict) these intra-day CO2 intensity differences, so it needs hourly data.

In the following chart you'd want to know the best time to use environmentally-friendly electricity - it's at noon when solar peaks, or 12 hours after when wind kicks in, and not during the evening peak.

image

scottlee120 commented 5 years ago

hey guys - just logged in and saw this. unknown in KR is going to be pretty high (i guess like 60% coal minimum as LNG is usually more expensive). not sure you'll get much of a reply if you contact KOSIS directly but if you see a phone number, let me know and i might be able to call them -> generally, in korea, you need eventually to call someone to get an answer as email is not a suitable means of first contact.

systemcatch commented 5 years ago

Hey everyone I've made a rough draft of the parser, couple of things I need help with atm.

  1. Carbon intensity for the unknown portion of generation.
  2. Each source returns data at different times, e.g. right now hydro is 18:20, load 18:30, nuclear 18:33. How do we combine these together?
alixunderplatz commented 5 years ago

@systemcatch

  1. Here's the carbon intensity based on electricity data of IEA for South Korea: 2016: 41.8% coal, 3.1% oil, 22.5% gas, 1.1% biofuels, 0.9% solar, 0.3% wind This leads to a carbon intensity of 680 g/kWh for the unknown part (nuclear and hydro excluded). Solar capacity in 2018 has nearly doubled since 2016, but the share is still small.

  2. In my opinion, it's never 100% sure whether the timestamp is for a discrete value, an average period or the starting or ending time of the measured period, so I think using a unified timestamp should do. What about implementing a check if the time of each source is within a limit to the actual time and each timestamp is in the same range (like 15 min to 30 min), and then applying a unified timestamp for the data (e.g. from the load)? Should still be sufficiently accurate. Nuclear won't change too much over time, hydro has a very small influence only, so the load will be what's jumping up and down most of the time.

systemcatch commented 5 years ago

@alixunderplatz Brilliant I will implement your suggestions for both.

systemcatch commented 5 years ago

Seems like the load url (http://power.kpx.or.kr/powerinfo_en.php) is no longer working.

We might be able to scrape http://kpx.or.kr/eng/index.do instead.

alixunderplatz commented 5 years ago

@systemcatch There also is some load/forecast data on this page: http://epsis.kpx.or.kr/epsisnew/# The continuous values in the graph seem to come from: http://epsis.kpx.or.kr/epsisnew/selectMainEpsMep.ajax (URL was posted in the second comment of this issue) The figure behind each "Value2": is the load of the 5 min period. Not sure if it's worth the effort to scrape it. We better just stick with the "most recent" data of any of these pages.

By the way: there also is load data for the island Jeju, 100 km south of the mainland. http://www.kpx.or.kr/www/contents.do?key=357 It's connected via 2 HVDC cables, but I think we don't have any transmission data to seperate it from the mainland.

systemcatch commented 4 years ago

Closing this for now as there is nothing else to do.