search

quintel / refinery

Calculates node demands and edge shares for sparse energy graphs.
2 stars 0 forks source link

Build first complete graph #23

Closed wmeyers closed 11 years ago

wmeyers commented 11 years ago

Creating a place for @antw to put the first pictures of the complete graph when ready :)

antw commented 11 years ago

Despite reducing the image by 25% GitHub wouldn't let me upload the diagram for being too big. So I split it up into three; not that it will be much value to you to be honest. You'll deserve a medal if you can extract anything useful from this mess of a diagram. :)

In fact, neither Preview nor Chrome dealt very well with the full (not split-up) image; I had to use Photoshop. I also told Graphviz (the diagram library) to put each sector into a box of it's own, but it completely ignored me in some cases and did it's own thing.

This shows the things which could be calculated. The 300-odd nodes/edges which couldn't are slightly greyed out.

Top Middle Bottom

There are two useful pieces of information I could extract, however:

  1. If something isn't calculable in the individual subgraphs, it probably isn't calculable in the full graph either.
  2. The previous statement isn't entirely true. :wink: Some parts of the energy sector (such as an outgoing edges from coal/gas distribution) do calculate successfully in the full graph.

I think instead of producing diagrams with all 500+ nodes, it would be more useful to calculate the graph as a whole, but then output separate diagrams for each sector.

ChaelKruip commented 11 years ago

I think instead of producing diagrams with all 500+ nodes, it would be more useful to calculate the graph as a whole, but then output separate diagrams for each sector.

:+1: Although the above images wouldn't look out of place in a museum of modern art they seem hard to decipher...

StijnDellaert commented 11 years ago

Wow That seems like a good idea, especially to be clear on what is still needed for the energy sector.

wmeyers commented 11 years ago

@antw, awesome! Thanks a lot :-) To be honest, I'm a bit worried about the number of nodes that cannot be calculated...

I also agree it's a good idea to calculated the whole graph, but output sub-graphs. It would be good if the nodes just outside of that sector are also displayed (instead of the SUPERSINK and SUPERSOURCE) so that its easier to see where things go wrong. Does this take a lot of time to implement?

Another question, is there a possibility to have the visualization module order the graph in a way that makes sense. Now a lot of times there are CHP's, distribution, import and production converters outlined on the same 'column'. That doesn't make it easy to read unfortunately.

antw commented 11 years ago

It would be good if the nodes just outside of that sector are also displayed (instead of the SUPERSINK and SUPERSOURCE)

Completely agree. I'll include the nodes in each sector, and any adjacent nodes from outside the sector; no super-anything. :smile:

Another question, is there a possibility to have the visualization module order the graph in a way that makes sense.

I agree here also. The Graphviz library is rather... finickity, and large graphs become quite hard to read. I'll take a look into this and see what can be done to improve the output.

To be honest, I'm a bit worried about the number of nodes that cannot be calculated...

Indeed. Keep in mind that the energy sector is the source of many of these incalculable nodes and edges; once improvements are made there I think the full-size graph will look a lot more promising.

ChaelKruip commented 11 years ago

Overview of sectors calculation status:

ChaelKruip commented 11 years ago

@StijnDellaert @wouterterlouw @Richard-Deuchler please log here if a sector is fully calculated. This will allow everyone to see the progress :smile:

Richard-Deuchler commented 11 years ago

Households should fall into place when https://github.com/quintel/refinery/issues/37 is closed.

wouterterlouw commented 11 years ago

I think the following issues are the bottlenecks at the moment:

Related to import and export via two different nodes:

Related to network/distribution losses (#40):

Other:

I included some thoughts about solutions between [ ].

ChaelKruip commented 11 years ago

The graph calculates (although there are some validation errors described on this ticket). Closing.

ChaelKruip commented 11 years ago

BTW: WHOOP WHOOP! :dancers: