search

electricitymaps / electricitymaps-contrib

A real-time visualisation of the CO2 emissions of electricity consumption
https://app.electricitymaps.com
GNU Affero General Public License v3.0
3.58k stars 946 forks source link

ERR: Sweden - Poland: incorrect direction and values. #2052

Closed AdaBla closed 4 years ago

AdaBla commented 5 years ago

Today EM is showing export from Poland to Sweden.

image

This apparently is wrong according to PSE (Polskie Sieci Energetyczne) a Polish TSO.

PSE shows import FROM Sweden.

image

Something is not right here, but I can't figure it out.

Source file: https://www.pse.pl/dane-systemowe/funkcjonowanie-kse/raporty-dobowe-z-pracy-kse/wymiana-miedzysystemowa-przeplywy-mocy?fbclid=IwAR0LfNJJz_fsqv9sZH9um9YEyaTiNW8w71plXK_Oa8fwqQrg5rYx6AO8Rc4

corradio commented 5 years ago

It seems like the data provider is sending us wrong data

On Mon, Oct 21, 2019 at 4:48 PM AdaBla notifications@github.com wrote:

Today EM is showing export from to Sweden.

[image: image] https://user-images.githubusercontent.com/56835320/67215653-26e33280-f422-11e9-95d3-8236bab4d3f1.png

This apparently is wrong according to PSE (Polskie Sieci Energetyczne) a Polish TSO.

PSE shows import FROM Sweden.

[image: image] https://user-images.githubusercontent.com/56835320/67215792-67db4700-f422-11e9-8f2a-9ffee3afbdba.png

Something is not right here, but I can't figure it out.

Source file:

https://www.pse.pl/dane-systemowe/funkcjonowanie-kse/raporty-dobowe-z-pracy-kse/wymiana-miedzysystemowa-przeplywy-mocy?fbclid=IwAR0LfNJJz_fsqv9sZH9um9YEyaTiNW8w71plXK_Oa8fwqQrg5rYx6AO8Rc4

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/tmrowco/electricitymap-contrib/issues/2052?email_source=notifications&email_token=AAMUIKG7GCS2LEB4WOEEYIDQPW6KPA5CNFSM4JC6N2IKYY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4HTGGSTA, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAMUIKDWSI6TL7ZG6CPLXPTQPW6KPANCNFSM4JC6N2IA .

--

Olivier Corradi

Founder, CEO

https://www.linkedin.com/in/oliviercorradi https://twitter.com/corradio

tmrow.com

swakter commented 5 years ago

Hi,

There are a number of TSOs providing data for the Nordic electricity grid.

Both SvK (Sweden) and Statnett (NO) seem to show that Sweden is importing. I can't find any data from energinet (Denmark) for SE-PL and Fingrid (Finland) refers to statnett for border flows.

If you look at the market platform providers, Nordpool, website under "Exchange" [1], which gets data from SvK, you will see that the flow for Lithuania, Finland and Poland are all shown with the same sign (minus) but the flows shown on SvK map [2] indicate that Sweden is exporting to Finland and Lithuania but importing from Poland.

Looking at the result from the DA auctions under "Day-ahead flow" on the Nordpool website [3] seems to indicate more clearly that Sweden is in fact exporting to Poland as you can view export by each direction (SE4>PL and PL>SE4). Again, here the flow is shown as export from Sweden to Finland, Lithuania and Poland.

Polish TSO, PSE, also shows that Poland is importing from Sweden [4] This is also supported by entso-e website [5] but I'm not sure where they get their data from.

Does this help or what else can I help with?

[1] https://www.nordpoolgroup.com/Market-data1/Power-system-data/Exchange1/SE/Hourly2/?view=table

[2] https://www.svk.se/drift-av-stamnatet/kontrollrummet/

[3] https://www.nordpoolgroup.com/Market-data1/Dayahead/Flow1/Flow/SE/Norway1/?view=table

[4] https://www.pse.pl/web/pse-eng

[5] https://transparency.entsoe.eu/transmission-domain/physicalFlow/show?name=&defaultValue=false&viewType=TABLE&areaType=BORDER_BZN&atch=false&dateTime.dateTime=21.10.2019+00:00|CET|DAY&border.values=CTY|10YSE-1--------K!BZN_BZN|10Y1001A1001A47J_BZN_BZN|10YPL-AREA-----S&dateTime.timezone=CET_CEST&dateTime.timezone_input=CET+(UTC+1)+/+CEST+(UTC+2)

alixunderplatz commented 5 years ago

Hi @AdaBla and @swakter ! Thank you for your comments and the research you've done :)

As you wrote, data on entsoe and PSE shows a flow from Sweden to Poland and you guys are right with your assumption: image

I think the exchanges of the nordic countries are parsed by the stattnet.py parser. (@corradio are they?) An option to make sure which data is correct is the indicated power in each single hour on both sources. Right now on the map, the Stattnett.py parser returns 604 MW to Sweden (which is wrong directionwise as described above), while the ENTSOE website shows 595 MW to Poland. I assume the Stattnett value for Sweden is measured on the Swedish side of the interconnector, the ENTSOE parser takes the TSO measures by PSE on the Polish end of the cable. This physically explains the difference of 9 MW between these sources due to cable resistance and/or conversion losses. So the flow should really be SE->PL.

If you like to check the parser which is responsible for returning the faulty direction, go ahead and fix the issue if you like and comment in case you need any help :)

If you contact statnett to fix this issue on their map, make sure to check if the parser is still returning the right data afterwards.

corradio commented 5 years ago

Indeed the stattnet parser is used. What would be helpful at this stage is to list the different data sources and mark clearly if it currently shows the right direction of not. Based on that we should either contact stattnet or change the data source. As far as I know the parser implementation is correct but the data provider is sending wrong data.

AdaBla commented 5 years ago

There is clearly a bug in stattnet, so they should know about this.

The PSE source is a just HTML page.

corradio commented 5 years ago

This still seems to be happening. Has anyone been able to talk with StattNet? I think we should probably revert to ENTSOE..

AdaBla commented 4 years ago

Now SvK is working https://www.svk.se/drift-av-stamnatet/kontrollrummet/ but not https://www.electricitymap.org/?page=map&solar=false&remote=true&wind=false we can put the blame on Statnett https://driftsdata.statnett.no/Web/Map/?language=en ?

On Mon, 21 Oct 2019, 17:05 Olivier Corradi, notifications@github.com wrote:

It seems like the data provider is sending us wrong data

On Mon, Oct 21, 2019 at 4:48 PM AdaBla notifications@github.com wrote:

Today EM is showing export from to Sweden.

[image: image] < https://user-images.githubusercontent.com/56835320/67215653-26e33280-f422-11e9-95d3-8236bab4d3f1.png

This apparently is wrong according to PSE (Polskie Sieci Energetyczne) a Polish TSO.

PSE shows import FROM Sweden.

[image: image] < https://user-images.githubusercontent.com/56835320/67215792-67db4700-f422-11e9-8f2a-9ffee3afbdba.png

Something is not right here, but I can't figure it out.

Source file:

https://www.pse.pl/dane-systemowe/funkcjonowanie-kse/raporty-dobowe-z-pracy-kse/wymiana-miedzysystemowa-przeplywy-mocy?fbclid=IwAR0LfNJJz_fsqv9sZH9um9YEyaTiNW8w71plXK_Oa8fwqQrg5rYx6AO8Rc4

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub < https://github.com/tmrowco/electricitymap-contrib/issues/2052?email_source=notifications&email_token=AAMUIKG7GCS2LEB4WOEEYIDQPW6KPA5CNFSM4JC6N2IKYY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4HTGGSTA , or unsubscribe < https://github.com/notifications/unsubscribe-auth/AAMUIKDWSI6TL7ZG6CPLXPTQPW6KPANCNFSM4JC6N2IA

.

--

Olivier Corradi

Founder, CEO

https://www.linkedin.com/in/oliviercorradi <https://twitter.com/corradio

tmrow.com

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/tmrowco/electricitymap-contrib/issues/2052?email_source=notifications&email_token=ANRTZ6HU2OUKFL5OHA5NRZTQPXAKPA5CNFSM4JC6N2IKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEB2UUWA#issuecomment-544557656, or unsubscribe https://github.com/notifications/unsubscribe-auth/ANRTZ6DXJZTT6RK6F32CP3DQPXAKPANCNFSM4JC6N2IA .

AdaBla commented 4 years ago

This bug is still present. Maybe Electricity map can just change the sign? I will report back when they fix it.

corradio commented 4 years ago

Is there an alternative data source we can use? Maybe ENTSOE?

On Wed, Dec 4, 2019 at 10:12 AM AdaBla notifications@github.com wrote:

This bug is still present. Maybe Electricity map can just change the sign? I will report back when they fix it.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/tmrowco/electricitymap-contrib/issues/2052?email_source=notifications&email_token=AAMUIKBAMCBMVKKUAQ5UZ2TQW5YARA5CNFSM4JC6N2IKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOEF4IOQI#issuecomment-561547073, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAMUIKF6SDZAN2DXDCCI64TQW5YARANCNFSM4JC6N2IA .

--

Olivier Corradi

Founder, CEO

https://www.linkedin.com/in/oliviercorradi https://twitter.com/corradio

tmrow.com

alixunderplatz commented 4 years ago

Direction is correct now. Seems like the error was fixed by Statnett :) Closing this issue. Thanks a lot @AdaBla & @swakter