Yay WA is now included! WA generation and consumption data lacking rooftop PV

[aleith]

I wonder if the postcode PV sources used for estimating RooftopPV on the NEM are applicable to WA? WA has some of the highest penetrations of rooftop PV (residential, commercial and now industrial is accelerating quickly) in Australia and it would make more sense of the hard ramping on coal units to see the rooftopPV flooding into the daytime market.

[simonhac]

definitely something we're looking at — very much in active development.

we currently use AEMO's ASEFS data feed, but they do not have a public equivalent for WA.

APVI has an estimate for WA, but last time we checked, their NEM estimates differed significantly from AEMOs.

watch this space.

[aleith]

I asked the head of AEMO in WA about this some time ago when I was looking to fork OpenNEM to show WA data and other things. He put me in touch with someone there, I can't find the email thread ATM. The short answer was the data is in a different format and they have no plans to harmonise it with ENM data format, but I don't see why it would be that hard to write a little shim code to convert it to the same data format that is used on NEM and which OpenNEM accesses ATM.

Happy to connect you with the relevant people at WA AEMO office if that helps. SEN has a good relationship with them.

[simonhac]

yes, please make the connection.

we will write an adaptor for any format.

[aleith]

just before i contact AEMO again, can I ask where you are getting the existing Live and historical data from for WA generation and demand? AEMO or SCADA?

[simonhac]

• https://aemo.com.au/aemo/data/wa/infographic/generation.csv
• http://data.wa.aemo.com.au/public/public-data/datafiles/facility-scada/facility-scada-{year}-{month}.csv
• http://data.wa.aemo.com.au/datafiles/facility-scada/

[aleith]

ta, in browser I get a 404 on the second one, does it need authenticated access?

[simonhac]

that URL includes {year} and {month} variable substitutions — i grabbed it directly from the code.

at runtime actual values are substituted in eg: http://data.wa.aemo.com.au/public/public-data/datafiles/facility-scada/facility-scada-2019-10.csv

[aleith]

Thx again, should have looked more closely...

one more thing I want to be sure of as I write to Dean at AEMO, does the public facing opennem.org.au include an approximation of behind the meter consumption, or is RooftopPV showing an approximation of purely exports from behind the meters. i.e. of RooftopPV and possibly BTM batteries?

[simonhac]

we use AEMO's ASEFS data. the ASEFS estimates all behind-the-meter solar generation, which is the same as self-consumption plus export.

(nb. we are also talking with AEMO, albeit east coast.)

[aleith]

great thx. I put you in touch with them as soon as i get a reply.

[aleith]

thanks and well done to those who licensed and wrangled the PV data !!