search

electricitymaps / electricitymaps-contrib

A real-time visualisation of the CO2 emissions of electricity consumption
https://app.electricitymaps.com
GNU Affero General Public License v3.0
3.4k stars 914 forks source link

Add Australia #378

Closed corradio closed 7 years ago

corradio commented 7 years ago

Some links:

corradio commented 7 years ago

@snoblenet is taking a look (sorry, can't assign because github only allows project members to be assigned)

corradio commented 7 years ago

We should use AREMI's http://services.aremi.nationalmap.gov.au/aemo/v3/csv/all. Will try to write a parser except if @snoblenet is already doing it?

snoblenet commented 7 years ago

yep -- will do -- will also update everyone on planned timelines soon -- on here or on slack?

corradio commented 7 years ago

Let's do it here - it's easier.

On Mon, Mar 13, 2017 at 10:07 AM, Steven Noble notifications@github.com wrote:

yep -- will do -- will also update everyone on planned timelines soon -- on here or on slack?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/corradio/electricitymap/issues/378#issuecomment-286050586, or mute the thread https://github.com/notifications/unsubscribe-auth/ABlEKP1K0gmnd8YHtHFRaEt-QA-fjZQ5ks5rlQdDgaJpZM4MCv_o .

snoblenet commented 7 years ago

On Monday 20 (or possible Monday 27) I start a new job that involves a 95 minute commute twice a day. For security reasons I can't do any of my job on my personal laptop out of the office, so that's 3 hours 10 minutes a day I want to largely devote to hacking for the public good. So I'm hoping to start this project then and finish it fairly quickly. Once I start my new job I won't have much time around the house to finish the renovation, so until then I'm hoping to focus on that instead. Does that timetable work for everyone?

corradio commented 7 years ago

Hi Steven,

That sounds good. Let me know if there's anything I can do to help! We'll focus on building the rest of the infrastructure so you can focus on the parser itself.

Olivier

On Mon, Mar 13, 2017 at 10:20 PM, Steven Noble notifications@github.com wrote:

On Monday 20 (or possible Monday 27) I start a new job that involves a 95 minute commute twice a day. For security reasons I can't do any of my job on my personal laptop out of the office, so that's 3 hours 10 minutes a day I want to largely devote to hacking for the public good. So I'm hoping to start this project then and finish it fairly quickly. Once I start my new job I won't have much time around the house to finish the renovation, so until then I'm hoping to focus on that instead. Does that timetable work for everyone?

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/tmrowco/electricitymap/issues/378#issuecomment-286247477, or mute the thread https://github.com/notifications/unsubscribe-auth/ABlEKCInEfrn9OuS2xUJkFvHCfnROtvfks5rlbMigaJpZM4MCv_o .

corradio commented 7 years ago

The frontend is ready:

image

There's a few questions to be answered still:

-- Initial mapping for reference: https://github.com/snoblenet/electricitymap/commit/75fcf468a7ac00d57a5bc53ca6a689a9740284c9

corradio commented 7 years ago

I've made a small test here: https://github.com/tmrowco/electricitymap/blob/master/parsers/AU.py

image

@brunolajoie @ThierryOllivero @snoblenet can you guys comment on whether or not this sounds reasonable? We can think about dividing into states in a later iteration.

snoblenet commented 7 years ago

Just looking at proportions not numbers, coal and wind seems about right, I would have expected hydro and gas to be higher. Much solar in Australia is domestic rooftop solar PV which may be showing up in the AEMO numbers as energy saving not production. Geothermal and nuclear are both zero in Australia.

snoblenet commented 7 years ago

Regarding your state-by-state question:

snoblenet commented 7 years ago

Our top-line figure for the common market (exclude WA etc) is 745g. According to the latest IPCC report, the top-line figure for Australia as a whole is 885g:

https://www.ipcc.ch/pdf/special-reports/sroc/Tables/t0305.pdf

You'd expect the national figure to be higher than the common market figure as our biggest hydro facilities are in the common the market, but maybe not that much higher...

snoblenet commented 7 years ago

Electricity price data is here: https://www.aemo.com.au/Electricity/National-Electricity-Market-NEM/Data-dashboard

snoblenet commented 7 years ago

State-by-state generation/demand/etc data presented in human readable form here:

https://www.aemo.com.au/Electricity/National-Electricity-Market-NEM/Data-dashboard#nem-dispatch-overview

But we'd have to build a scraper not a parser unless this data is available elsewhere in a machine readable format.

snoblenet commented 7 years ago

Comments from Ketan, who doesn't have a Github account:

I couldn't quite figure out how to respond, but no real-time output from WA as far as I'm aware that's easily accessible like NEM data is. Real time consumption - some limited stuff here: http://energyconsumersaustralia.com.au/connect/electricity-map/ … but only state level and probably not easily extractable for the purposes of the tool

corradio commented 7 years ago

Great so we can have access to:

Now we just need to know the production mix per state. We could allocate each generator in the CSV to a state, but how would one do that mapping? Based on location? Also, how do these guys (http://www.nem-watch.info/widgets/RenewEconomy/) do it?

snoblenet commented 7 years ago

We should be able to set up a manual mapping against generator name using Dr Google. Even for location names like 'Bayswater' that are very common in Australia, a search for the actual generator name like 'Bayswater Power Station' is definitive. The widget you identify is provided by a private company called Roam that no doubt did something similar.

corradio commented 7 years ago

OK. Could you or someone else prepare the mapping? Then I can try to figure out to get interstate exchanges.

snoblenet commented 7 years ago

yeah no problem — i’ll stick something up in a gist

Steven Noble http://snoble.net +61 (0) 4 0404 1928

On 21 Apr 2017, at 4.56pm, Olivier Corradi notifications@github.com wrote:

OK. Could you or someone else prepare the mapping? Then I can try to figure out to get interstate exchanges.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/tmrowco/electricitymap/issues/378#issuecomment-296098215, or mute the thread https://github.com/notifications/unsubscribe-auth/AADzRa1AoY4V--xl0E-wH7MMh4HFe3xrks5ryFMKgaJpZM4MCv_o.

snoblenet commented 7 years ago

here you go: https://gist.github.com/snoblenet/5831d19b5103039f98cc9bac6bf847d4

corradio commented 7 years ago

@snoblenet I don't have any stations for NT and Western. Is that normal?

corradio commented 7 years ago

Also, Eildon Power Station seems to be missing from the mapping.

snoblenet commented 7 years ago

Yeah, the dictionary lists all the power stations in the AREMI data for NEM, the common market that includes all Australia other than Western Australia, the Northern Territory and offshore territories (e.g. Christmas Island.) I'm not sure how to obtain data about those areas.

Lake Eildon is in Victoria, sorry.

corradio commented 7 years ago

👍

snoblenet commented 7 years ago

looks like WA data is here:

http://data.wa.aemo.com.au/#facility-scada

Not real time however

corradio commented 7 years ago

Closing this as we have a first version working!