search

electricitymaps / electricitymaps-contrib

The open source repository for Electricity Maps App and data parser that enables a real-time visualisation of the CO2 emissions of electricity consumption
https://app.electricitymaps.com
GNU Affero General Public License v3.0
3.6k stars 946 forks source link

ALL Australia is broken #533

Closed superlonglong closed 7 years ago

corradio commented 7 years ago

It seems like the CSV we use (http://services.aremi.nationalmap.gov.au/aemo/v3/csv/all) was updated. Also it seems like new stations were added. Can you help me map them to the proper state? cc @snoblenet

feeder_1 | WARNING: station Yambuk Wind Farm does not belong to any state feeder_1 | WARNING: station Braemar Power Station does not belong to any state feeder_1 | WARNING: station Braemar Power Station does not belong to any state feeder_1 | WARNING: station Braemar Power Station does not belong to any state feeder_1 | WARNING: station Hunter Valley Gas Turbine does not belong to any state feeder_1 | WARNING: station Mt Mercer Wind Farm does not belong to any state feeder_1 | WARNING: station Bendeela / Kangaroo Valley Power Station does not belong to any state feeder_1 | WARNING: station Snowtown Wind Farm Units 1 to 47 does not belong to any state feeder_1 | WARNING: station Uranquinty Power Station does not belong to any state feeder_1 | WARNING: station Uranquinty Power Station does not belong to any state feeder_1 | WARNING: station Uranquinty Power Station does not belong to any state feeder_1 | WARNING: station Uranquinty Power Station does not belong to any state feeder_1 | WARNING: station Moranbah North Power Station, Grosvenor 1 Waste Coal Mine Gas Power Station does not belong to any state feeder_1 | WARNING: station Hornsdale Wind Farm does not belong to any state feeder_1 | WARNING: station Barcaldine Solar Farm does not belong to any state feeder_1 | WARNING: station Hornsdale Wind Farm 2 does not belong to any state

superlonglong commented 7 years ago

On mobile atm, will do.

On 5 May 2017 18:22, "Olivier Corradi" notifications@github.com wrote:

It seems like the CSV we use (http://services.aremi. nationalmap.gov.au/aemo/v3/csv/all) was updated. Also it seems like new stations were added. Can you help me map them to the proper state? cc @snoblenet https://github.com/snoblenet

feeder_1 | WARNING: station Yambuk Wind Farm does not belong to any state feeder_1 | WARNING: station Braemar Power Station does not belong to any state feeder_1 | WARNING: station Braemar Power Station does not belong to any state feeder_1 | WARNING: station Braemar Power Station does not belong to any state feeder_1 | WARNING: station Hunter Valley Gas Turbine does not belong to any state feeder_1 | WARNING: station Mt Mercer Wind Farm does not belong to any state feeder_1 | WARNING: station Bendeela / Kangaroo Valley Power Station does not belong to any state feeder_1 | WARNING: station Snowtown Wind Farm Units 1 to 47 does not belong to any state feeder_1 | WARNING: station Uranquinty Power Station does not belong to any state feeder_1 | WARNING: station Uranquinty Power Station does not belong to any state feeder_1 | WARNING: station Uranquinty Power Station does not belong to any state feeder_1 | WARNING: station Uranquinty Power Station does not belong to any state feeder_1 | WARNING: station Moranbah North Power Station, Grosvenor 1 Waste Coal Mine Gas Power Station does not belong to any state feeder_1 | WARNING: station Hornsdale Wind Farm does not belong to any state feeder_1 | WARNING: station Barcaldine Solar Farm does not belong to any state feeder_1 | WARNING: station Hornsdale Wind Farm 2 does not belong to any state

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/tmrowco/electricitymap/issues/533#issuecomment-299409092, or mute the thread https://github.com/notifications/unsubscribe-auth/Aa5sgzv9j96N_5MQOz724RgpJS9WGCzqks5r2txXgaJpZM4NRe0o .

snoblenet commented 7 years ago

Is it possible to change the matching algorithm to a fuzzy/regex match instead of an exact match? New power stations come and go and are officially renamed very slowly, but who knows how quickly AREMI changes the identifiers in the names column? Busy for the next two days but I might be able to progress this Sunday Australian time.

superlonglong commented 7 years ago

how can i submit this easiest? is there a table you want me to fill?

corradio commented 7 years ago

You can see the existing table here: https://github.com/tmrowco/electricitymap/blob/master/parsers/AU.py#L38 You can either submit a pull request to change that file, or you can just send us the changes here.

corradio commented 7 years ago

@snoblenet yes we could do regexp!

superlonglong commented 7 years ago

feeder_1 | WARNING: station Yambuk Wind Farm does not belong to any state,VIC feeder_1 | WARNING: station Braemar Power Station does not belong to any state,QLD feeder_1 | WARNING: station Braemar Power Station does not belong to any state,QLD feeder_1 | WARNING: station Braemar Power Station does not belong to any state,QLD feeder_1 | WARNING: station Hunter Valley Gas Turbine does not belong to any state,NSW feeder_1 | WARNING: station Mt Mercer Wind Farm does not belong to any state,VIC feeder_1 | WARNING: station Bendeela / Kangaroo Valley Power Station does not belong to any state,NSW feeder_1 | WARNING: station Snowtown Wind Farm Units 1 to 47 does not belong to any state,SA feeder_1 | WARNING: station Uranquinty Power Station does not belong to any state,NSW feeder_1 | WARNING: station Uranquinty Power Station does not belong to any state,NSW feeder_1 | WARNING: station Uranquinty Power Station does not belong to any state,NSW feeder_1 | WARNING: station Uranquinty Power Station does not belong to any state,NSW "feeder_1 | WARNING: station Moranbah North Power Station, Grosvenor 1 Waste Coal Mine Gas Power Station does not belong to any state",QLD feeder_1 | WARNING: station Hornsdale Wind Farm does not belong to any state,SA feeder_1 | WARNING: station Barcaldine Solar Farm does not belong to any state,QLD feeder_1 | WARNING: station Hornsdale Wind Farm 2 does not belong to any state,SA

superlonglong commented 7 years ago

So i discovered i dont know how to upload csv.

corradio commented 7 years ago

That's good enough thanks!