search

electricitymaps / electricitymaps-contrib

The open source repository for Electricity Maps App and data parsers that enables a real-time visualisation of the CO2 emissions of electricity consumption
https://app.electricitymaps.com
GNU Affero General Public License v3.0
3.61k stars 950 forks source link

USA Eastern Interconnection #903

Closed HansHyde closed 6 years ago

HansHyde commented 6 years ago

EIA on Overall North American Grid... https://www.eia.gov/todayinenergy/detail.php?id=27152

  1. NYISO 1 (A-F) <—> PJM Rest of MAAC
  2. NYISO 2 (GHI) <—> NYISO 3 (J&K)
  3. NYISO 2 (GHI) <—> PJM Eastern MAAC
  4. NYISO 3 (J&K) <—> PJM Eastern MAAC
  5. PJM Eastern MAAC <—> PJM Rest of MAAC
  6. PJM Rest of MAAC <—> PJM Rest of RTO
  7. PJM Rest of RTO <—> TVA
  8. PJM Rest of RTO <—> VACA
  9. FRCC <—> SOCO
  10. SOCO <—> TVA
  11. SOCO <—> VACA
  12. TVA <—> VACA

Here is a Flowchart for the Eastern Interconnection's BAs & Interfaces.... http://images.slideplayer.com/39/10987225/slides/slide_4.jpg

I have started an Excel file with the 26 BAs (parsers) & 58 Interfaces - happy to open up the Dropbox folder to those wanting access..

PS... is there a better way to use Github with the "Projects" for this???

jarek commented 6 years ago

Is there any real-time generation or fuel mix data?

HansHyde commented 6 years ago

@jarek We've already found NYISO (albeit IMHO the CO2 data is likely off by 20-50%).

I just found SPP... although I am not sure if their realtime info link showing on their page is something yet to be built/released or behind a non-US IP address firewall (which is stopping me from accessing ERCOT realtime info). Check it out here... https://www.spp.org

(deleted - unintended reference to political factors at play impacting CO2 emissions in the US)

HansHyde commented 6 years ago

@jacobbaratta @synfo fyi in regards to #143

HansHyde commented 6 years ago

Eastern Interconnect Flowchart.xlsx

This is a flowchart I have put together for the USA Eastern Interconnection - It represents everything from Manitoba in Canada south to ERCOT (Texas) and all points east to the Atlantic. It should spatially "resemble" the geography... but can't be perfect.

The "blocks" are the Balancing Authorities (where realtime will hopefully be available). The links between - all the interconnects (AC or DC) that if available will show as flows.

I will continue working on this... so it would be better if I house it in my Dropbox account and link all that want access. Just Slack DM me your email address.

corradio commented 6 years ago

Let's close the issue if we have no leads for interconnection data. Else, let's centralise real-time sources of data here.

Olivier

jarek commented 6 years ago

My earlier message (now deleted) was uncalled for and rude. I apologize. Let me rephrase:

Despite the somewhat generic name, Electricity Map is about finding and showcasing real-time CO2eq emissions by geographical region - it finds data for the sister project https://www.co2signal.com/. Consequently it is concerned with real-time or near-real-time generation / fuel mix for a given area.

For a number of mostly non-technical reasons, that data tends to be available mostly by political subdivisions.

Information on system setup, transmission lines, sub-grids, interchanges etc is useful here as far as it helps us calculate real-time emissions (as with NYISO and Ontario IESO being part of Eastern Interconnection but publishing their own data, and us supplementing it with interchange data). Leads for organisations that might have or make generation data available are appreciated. Beyond that, unfortunately it probably won't help us much.

HansHyde commented 6 years ago

@jared, @corradio,

Sorry, I missed your responses. We appear to be talking past each other right now, not with each other.

I have the framework (which Parsers & all their interconnections) for the entire eastern half of North America, as I outlined above. The only problem with this... they do not follow state lines. The second issue, the "interconnects" are not like they are in Europe (i.e., DC interconnections), they are more likely multiple different connections (with different real time date sources) which you guys will have to "sum together" to get the Interconnection on ElectricityMap to be correct.

The 26 Balancing Authorities I outline above is our best bet for getting information needed - this is where we will be focusing our efforts to find generation mix & flows to neighboring Balancing Authorities.

So the question I am asking you guys, do you want to mock the entire eastern half of North America from the start, and fill in data as we locate it, or not (and continue trying to chase out rabbit holes with State boundaries)? Based on @systemcatch work on NEISO, it would appear we could build the remaining Parsers (of the 26 needed) and link to a State geometry for the time being (until customized geometries are available).

You guys decide please, because honestly I feel like I am talking to a wall and wasting my time trying to help you guys out.

As Oli indicated that he does not want to set up a "project" - then I would suggest a separate issue for each of the Parser/Balancing Authorities we need to tick off.

corradio commented 6 years ago

Hi @HansHyde, Sorry about not taking the time to outline more clearly how we work (and explaining why we do it that way). Hopefully it will make sense to you and we'll be able to work more efficiently together.

Our process is always:

  1. identify a real-time data source (be it production or exchange)
  2. figure out if we have an associated geometry (could be a country, a state, or something completely different, like a custom grid geometry)
  3. deep dive into the data source to make sure the data is reliable
  4. find associated capacities, and update the map

The world is a big place, and starting to map out (i.e. what I believe you refer to as "mock") all zones and exchanges of the world would be an endless task. It would also be quite useless if we don't have associated data. What we should do instead is focussing on finding real-time data feeds, and mock the related areas as we find those. This will be much more productive, and our conversations and interactions will have a higher signal to noise ratio.

Therefore, I pragmatically will close this issue (as we don't have real-time data sources associated), but the information here-in will be kept nonetheless, as it is very useful once we get real-time data sources for the relevant areas. We should really focus on #913 in order to incorporate grid geometries (as this will probably happen very soon as we find new data sources). Remember FYI that a good first US area mapping was already done in https://github.com/tmrowco/electricitymap/issues/143#issuecomment-283915610 and that we previously identified https://www.eia.gov/beta/realtime_grid/#/status?end=20171218T01 as a good overview. If issues gets too long, we tend not to read what has been done before, and that's a shame. @HansHyde if you can help us identify real-time data sources, and leverage your network, that'd be awesome. As I said - mapping out the areas is secondary, and will be quite natural based on where the data comes from.

Let's discuss on Slack if there's anything unclear. Let's keep github issues strictly for tracking progress and adding new information (instead of asking questions indirectly related to the task at hand).

I hope this makes sense. In all cases we're happy to have you here helping us out!

HansHyde commented 6 years ago

Copy @corradio - I’ll be back online in about 4 hours.

I’ll add some issues of known areas where we can focus on tracking down info & data streams.

corradio commented 6 years ago

Terrific!