search

electricitymaps / electricitymaps-contrib

The open source repository for Electricity Maps App and data parsers that enables a real-time visualisation of the CO2 emissions of electricity consumption
https://app.electricitymaps.com
GNU Affero General Public License v3.0
3.63k stars 951 forks source link

Data for Vietnam 🇻🇳 #1974

Closed martincollignon closed 1 year ago

corradio commented 5 years ago

do you have any source? Else I don't think it makes much sense to open an issue (imagine if we opened an issue for every country in the world)

On Sat, Sep 28, 2019 at 9:03 AM martincollignon notifications@github.com wrote:

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/tmrowco/electricitymap-contrib/issues/1974?email_source=notifications&email_token=AAMUIKDIOE73BSPGGUDZ563QL36UPA5CNFSM4I3NBWR2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4HOJL2SA, or mute the thread https://github.com/notifications/unsubscribe-auth/AAMUIKH5AOK64MCTNFXQYNDQL36UPANCNFSM4I3NBWRQ .

--

Olivier Corradi

Founder, CEO

https://www.linkedin.com/in/oliviercorradi https://twitter.com/corradio

tmrow.com

martincollignon commented 5 years ago

I imagine this to be an easier way to allow people to see that it's something missing. It's a maximum of 198 issues ;)

jarek commented 5 years ago

https://en.evn.com.vn/ is a major organizer, but there are regional grid operators with - as I understand it - considerable degree of operational independence, for example https://www.evnhcmc.vn/

alixunderplatz commented 4 years ago

GOOD NEWS :) I have found load data for Vietnam from the National Load Dispatch Centre's website: https://www.nldc.evn.vn/

grafik

Data-URLs for 5th and 6th of May 2020 (DD/MM/YYYY): https://www.nldc.evn.vn/Chart24hHandle.ashx?d=05/05/2020&isChangeDate=0 https://www.nldc.evn.vn/Chart24hHandle.ashx?d=06/05/2020&isChangeDate=0

Unfortunately, that data is 2 days old as of today, so its lagging behind. Changing the &ChangeDate=0 to =1 allows you to show the most recent dataset as of "today", which should be empty for the last 2 dates. https://www.nldc.evn.vn/Chart24hHandle.ashx?d=08/05/2020&isChangeDate=1

However, there is more data in the chart right next to the bars with hourly load info in MW and electricity prices for 4 zones. This would allow 3 separate "consumption zones" for Vietnam and a total system load: H.Thống: System (=total load) M.Bắc: North M.Trung: Center M.Nam: South

Clicking "Phụ tải" will open a separate view with some lines representing the zones. Here's thr URL for the load data: Phụ tải https://www.nldc.evn.vn/PhuTaiHandle.ashx?d=08/05/2020 And for the electricity market price: Giá thị trường https://www.nldc.evn.vn/GiaBienHandle.ashx?d=08/05/2020

Load data goes back as far as 2012. For some reason, it will show me not 24 but less entries, no matter which day I select. You'll see as many hours for a day in the past as already shown for the recent day.

Load of 05/05/2020: https://www.nldc.evn.vn/PhuTaiHandle.ashx?d=05/05/2020

Load of 01/01/2012: https://www.nldc.evn.vn/PhuTaiHandle.ashx?d=01/01/2012 Price: Giá thị trường

What totally freaks me out: Look how the load has increased... from 10 GW total load in 2012 to over 30 GW in 2020!

Here you can see the borders of the zones. They are interconnected, but we have no info on the interregional power flows. Hovering over the zones will reveal info on something like "actual load" (really? that would be too low, so forget about that) and what I assume to be "installed capacity" grafik

Here is another website with the load data in a cleaner chart: https://www.nldc.evn.vn/FullNewsg/100/Thong-tin-thi-truong-dien/default.aspx

If anybody wants to split the provinces to the electrical zones, compare with: https://en.wikipedia.org/wiki/List_of_regions_of_Vietnam

If you like, we could add Vietnam as a whole, displaying its load data with a fixed carbon intensity on the map. Imports were like <1% in 2017, so no real impact.

Shares of the fuels according to IEA are leading to an average carbon intensity of 373 g/kWh: type share intensity based on share
hydro 45% 11
coal 34% 279
gas 21% 101
oil 0% 2
wind 0% 0
biofuels 0% 0
  TOTAL: 373

Between 2018 and 2019, solar skyrocketed from 100 MW to 5.5 GW within a year (https://theaseanpost.com/article/vietnam-leading-aseans-solar-pv-market). this will have an influence on a daily basis, but we have no absolute output data yet to include it in the intensity.

TO-DOs:

martincollignon commented 4 years ago

Yaaaaasss!

alixunderplatz commented 4 years ago

@martincollignon I'm trying to write a parser for Vietnam's available data :)

ajanssens commented 4 years ago

I can provide translation if needed. :)

benoit-cty commented 4 years ago

Hello,

I just have a look and unfortunately the data is outdated for the API used in the PR. Today (6th October) the latest data if for September the 1st :

But it is possible to get data since 2011.

The API used by the chart has more recent data but still outdated (1st October) : https://www.nldc.evn.vn/Chart24hHandle.ashx?d=01/10/2020&isChangeDate=1 and give only one number per hour, no split in energy source. The price in this API is at 0 since September the 1st.

Is it still useful ?

floriandierickx commented 4 years ago

Maybe also relevant for this issue:

Something more relevant @martincollignon @corradio : Pete Tunbridge and Euan Graham from @ember-climate published a report on data transparency in Asia today (including China) with an assessment of time granularity, fuel/source breakdown, spatial breakdown, additional data (capacity, ...) and ease of access. Might be interesting for future developments...

image

Originally posted by @floriandierickx in https://github.com/tmrowco/electricitymap-contrib/issues/1973#issuecomment-734809221

madsnedergaard commented 2 years ago

Thanks for all the valuable information shared here! 🙌

We're closing this issue as it is not currently possible to build a real-time parser given the data provided here. If you find new information that might help us get it done, please comment and reopen the issue when a parser is buildable :)

alixunderplatz commented 1 year ago

wørking on this one now, so I'm reopening 🇻🇳 everything still as described above

"raw" parser-output status for consumption:

Fetching price and load data for: 08/02/2023 at 08/02/2023 13:08:24 local Vietnamese time.
LOAD: {'hour': datetime.time(12, 30), 'north_load': 12038, 'central_load': 2413, 'south_load': 12948, 'vietnam_load': 27399}
LOAD: {'hour': datetime.time(13, 0), 'north_load': 11851, 'central_load': 2569, 'south_load': 13960, 'vietnam_load': 28381}
LOAD: {'hour': datetime.time(13, 30), 'north_load': 12700, 'central_load': 2741, 'south_load': 14429, 'vietnam_load': 29870}
LOAD: {'hour': datetime.time(14, 0), 'north_load': 13254, 'central_load': 2804, 'south_load': 14849, 'vietnam_load': 30907}

raw parser-output for price:
PRICE: {'hour': datetime.time(12, 30), 'north': 1, 'central': 0, 'south': 0}
PRICE: {'hour': datetime.time(13, 0), 'north': 0, 'central': 0, 'south': 0}
PRICE: {'hour': datetime.time(13, 30), 'north': 1779, 'central': 0, 'south': 0}
PRICE: {'hour': datetime.time(14, 0), 'north': 1536, 'central': 0, 'south': 0}

Getting the time format working for half hourly entries was a bit tough for my very limited python skill, but found a way :-) I think it makes sense if one of you pro-pythoneers went to get the consumption assigned to the 3 regions, as I'm struggling with extracting stuff from dicts 😄