search

LambdaConglomerate / x9115lam

2 stars 0 forks source link

Grapher #32

Closed aisobran closed 8 years ago

aisobran commented 8 years ago

I got grapher working with this setup and it now handles multiple situations(decisions, objectives). It takes in the frontier at each retry and adds it to the plot. Each retry is different color. Instead of a graph popping up it now writes it straight to the pics folder, I think that will make life easier.

It may also be useful to make a graph of the particles behaviors at each retry. That's a ton of graphs but at least it's useful for seeing how our heuristics affect behavior. This will also be written into it's own folder so we assess it after the run.

I tried to push the changes but there are conflicts. I'll resolve the conflicts tomorrow and push everything up when I'm fresh.

meneal commented 8 years ago

One thing we may want to make sure about is the size of the repo. If we push all of the graphs we could start to hit that limit pretty quickly. Not exactly sure how to get around it either. Def something to think about.

There's some limit to the total size the repo can be. Did you already add back the min max stuff referenced in the other issue?

aisobran commented 8 years ago

Pushed up the new grapher, it graphs the frontiers from adaptive. There are some example graphs under pics with only 4 retries. I'm doing a big run right now with 50 retries for each model and will push the results when done.

aisobran commented 8 years ago

Also adding in the optimal frontiers.

aisobran commented 8 years ago

There's another bug in graphing 3d objectives. Fixing it now.

aisobran commented 8 years ago

Pushed the fixes. And an initial coding of adding the PFs. Having some issues with some of the txt files for example:

TypeError: Cannot cast array data from dtype('float64') to dtype('S32') according to the rule 'safe'

I'm looking into it.

aisobran commented 8 years ago

You can see the Osyczka2 pics worked. The true PF is black and our frontier is aqua. Looks pretty poor but let me fix this then see how the other models come out.

Also, only did 3 retries for brevity.

aisobran commented 8 years ago

Pushed the fix, it was a typing issue with the 3d plots. Running a 10 retry run on all models to get some base pics.

I pushed a single retry run of DTLZ1 under pics. This also looks poor but lets see how the results pan out.

I think I will also do a run plotting all the vectors encountered in a run to make sure we're not picking worse vectors.

aisobran commented 8 years ago

The frontiers look way off for DTLZ1.

meneal commented 8 years ago

Definitely. It's just like I was saying the other day. We're really far off. I don't know why though. It's likely because we're just not running anywhere near long enough to get there though. Not only that with only one retry we're only going to end up with one frontier value for DTLZ1 as far as I have seen.

On Tue, Dec 1, 2015 at 10:29 AM, Alexander Sobran notifications@github.com wrote:

The frontiers look way off for DTLZ1.

— Reply to this email directly or view it on GitHub https://github.com/LambdaConglomerate/x9115lam/issues/32#issuecomment-161001758 .

aisobran commented 8 years ago

Just pushed up some 10 retry graphs. They all look really poor. Still need to do tanaka, viennets, and srinivas. Will be up shortly.

aisobran commented 8 years ago

ConstrEx has points that a better than the true PF. It had a bug, fixed it.

aisobran commented 8 years ago

Added a particle history functionality to grapher. It looks like this dtlz1trackedparticleobjectives

fonsecatrackedparticleobjectives

Where the greater the opacity the later in the timeline the point it.

meneal commented 8 years ago

Do you think this gives us any insight into what's happening? I'm just not sure.

On Sat, Dec 5, 2015 at 9:51 AM, Alexander Sobran notifications@github.com wrote:

Add a particle history functionality to grapher. It looks like this [image: dtlz1trackedparticleobjectives] https://cloud.githubusercontent.com/assets/8948489/11608390/906338ee-9b35-11e5-8114-c0368615b9e6.png

[image: fonsecatrackedparticleobjectives] https://cloud.githubusercontent.com/assets/8948489/11608397/97be3d82-9b35-11e5-8897-d78df8b185eb.png

Where the greater the opacity the later in the timeline the point it.

— Reply to this email directly or view it on GitHub https://github.com/LambdaConglomerate/x9115lam/issues/32#issuecomment-162202761 .

meneal commented 8 years ago

I think that it helps to some degree to see where the particles are in terms of objectives. but do you think it gives any sense of what to do about why we're not getting to the frontier on DTLZ?