electricitymaps / electricitymaps-contrib

The open source repository for Electricity Maps App and data parsers that enables a real-time visualisation of the CO2 emissions of electricity consumption
https://app.electricitymaps.com
GNU Affero General Public License v3.0
3.64k stars 954 forks source link

IL production parser down #6025

Open electricitymapsbot opened 1 year ago

electricitymapsbot commented 1 year ago

Description

This is an automatic error report generated for Israel (IL).

Issues:

Suggestions

You can see an overview of all parser issues here.

q-- commented 1 year ago

I get "The request is blocked." when visiting https://www.noga-iso.co.il/

Geoblocking? It might be worth trying to ask them to make an exception for ElectricityMap.

NeoUKR commented 1 year ago

It doesn't look like geo-blocking, rather the reason is that the server was shut down due to DDOS during the war.

q-- commented 1 year ago

From Googling the error message and looking at the HTTP headers I get the impression that's its the block page for rule(s) in the Microsoft Azure WAF (Web Application Firewall).

Could still be a geoblock, could be something else. Anyway, it should be possible for them to make an exception for ElectricityMap

NeoUKR commented 1 year ago

You are right. I check that the site is only accessible through Israel IPs. Can the task be closed?

q-- commented 1 year ago

No, because electricitymaps doesn't have a server in Israël. They would either need a contact for NOGA and ask them to make an exception for their IP address, or set up a proxy with an Israëli IP address.

NeoUKR commented 1 year ago

Understood. Thanks ))

VIKTORVAV99 commented 1 year ago

@unitrium would it be possible for us to add a proxy in Tel Aviv since Google have a cloud region there?

unitrium commented 1 year ago

I can set this up next week during slack week!

unitrium commented 1 year ago

I'm assigning myself, and will try it out next week.

pierresegonne commented 1 year ago

Has anyone been able to fetch data through a VPN? We can setup a proxy in Israel, but first it would be worth verifying that it is indeed because of geoblocking that we can't access the data.

With a VPN, I still get 403 on https://www.noga-iso.co.il/Umbraco/Api/Documents/GetElectricalData for example

chpauline commented 1 year ago

I'm also getting "The request is blocked" when clicking both links above. Until someone can fetch the data, I'm wondering if it's necessary to let users know that the data is not being updated in real time. As of now, the map is estimating the data to be from today (11/19/23).

Israel-Nov192023

pierresegonne commented 1 year ago

Hey, we are currently working on improving the communication around estimates, so the wording around what "estimated" means should become clearer in the coming weeks

@Alportan FYI - don't know if you had seen this case before

Alportan commented 1 year ago

Thanks for sharing @pierresegonne, I wasn't aware of this.

q-- commented 1 year ago

Has anyone been able to fetch data through a VPN? We can setup a proxy in Israel, but first it would be worth verifying that it is indeed because of geoblocking that we can't access the data.

With a VPN, I still get 403 on https://www.noga-iso.co.il/Umbraco/Api/Documents/GetElectricalData for example

There's a Google cache entry for today, so the site is still online. Most likely they're also blocking VPNs

NeoUKR commented 1 year ago

Has anyone been able to fetch data through a VPN? We can setup a proxy in Israel, but first it would be worth verifying that it is indeed because of geoblocking that we can't access the data.

With a VPN, I still get 403 on https://www.noga-iso.co.il/Umbraco/Api/Documents/GetElectricalData for example

image

q-- commented 11 months ago

if you want to ask them to make an exception from geoblocking for you, here are their contact details (from their public inquiries page):

Telephone - 077-6141252

Mail - public_relations@noga-iso.co.il

Address – 8 Moshe Fliman street, Haifa

Fax - 077-4371007

(I also posted this to #6255)