search

electricitymaps / electricitymaps-contrib

A real-time visualisation of the CO2 emissions of electricity consumption
https://app.electricitymaps.com
GNU Affero General Public License v3.0
3.5k stars 931 forks source link

Ireland is missing #2037

Closed DavidWeather closed 4 years ago

DavidWeather commented 4 years ago

Ireland (Republic) was working perfectly until this week.

Some data available here http://smartgriddashboard.eirgrid.com/ and http://live.windenergy.ie/

jarek commented 4 years ago

Hi, thanks for noticing! We do indeed have Ireland normally.

Kibana logs&_a=(columns:!(message,extra.key,level),filters:!(('$state':(store:appState),meta:(alias:!n,disabled:!f,index:'96f67170-0c49-11e9-85c1-1d63df8c862c',key:level,negate:!f,params:(query:ERROR,type:phrase),type:phrase,value:ERROR),query:(match:(level:(query:ERROR,type:phrase))))),index:'96f67170-0c49-11e9-85c1-1d63df8c862c',interval:auto,query:(language:lucene,query:IE),sort:!('@timestamp',asc))) have seemingly unrelated errors, like:

October 16th 2019, 13:03:42.380 query_production failed in ENTSOE.py. Reason: Max allowed requests per minute from each unique IP is max up to 400 only

That error seems to be logged about 5000 times in past 24 hours&_a=(columns:!(message,extra.key,level),filters:!(('$state':(store:appState),meta:(alias:!n,disabled:!f,index:'96f67170-0c49-11e9-85c1-1d63df8c862c',key:level,negate:!f,params:(query:ERROR,type:phrase),type:phrase,value:ERROR),query:(match:(level:(query:ERROR,type:phrase))))),index:'96f67170-0c49-11e9-85c1-1d63df8c862c',interval:auto,query:(language:lucene,query:'%22failed%20in%20ENTSOE.py.%20Reason:%20Max%20allowed%20requests%20per%20minute%20from%20each%20unique%20IP%20is%20max%20up%20to%20400%20only%22'),sort:!('@timestamp',asc)))

DavidWeather commented 4 years ago

Is this to do with your Irish data provider or something local to your service? Can I contact anyone?

Thank you!

jarek commented 4 years ago

Hi David, if my interpretation is correct and this is related to ENTSOE: ENTSOE is the EU-wide electricity data platform - the issue is with how Electricity Map queries it. So in that case not something that the Irish data provider would be responsible for.

corradio commented 4 years ago

You are right. We've just reached out to ENTSOE to fix this. cc @tth4vb

corradio commented 4 years ago

The rate limiting issue has now been fixed, but Ireland is still missing because it is missing from ENTSOE's side.

DavidWeather commented 4 years ago

Has anyone contacted ENTSOE in Belgium? Ireland is still grey on the map. I wonder are they aware of this problem?

corradio commented 4 years ago

Hello @dalius-entso-e, You might be interested in knowing that Ireland has been missing from the Transparency Platform since quite some time. Do you have any insights? Best, Olivier

chrismcg commented 4 years ago

While ideally the data would find its way back into ENTSOE I have data scraped from http://smartgriddashboard.eirgrid.com/ here: https://sg.chrismcg.com. It's behind a GraphQL API at the moment but I could easily add another output format if that was useful.

systemcatch commented 4 years ago

@chrismcg thanks for scraping that, Ireland looks to be working again on the map.

alixunderplatz commented 4 years ago

Ireland is up and running again, so I'll close this issue. We can keep the dashboard in mind as alternative datasource. I will add it to #1015 one day