search

Axelrod-Python / Axelrod

A research tool for the Iterated Prisoner's Dilemma
http://axelrod.readthedocs.org/
Other
726 stars 264 forks source link

Issue with run_axelrod csv writer #370

Closed drvinceknight closed 8 years ago

drvinceknight commented 9 years ago

On the gitter channel @mojones mentioned having some strange behaviour with the strategies.csv output when running with -r 1 -t 50

Here is some of what he is seeing (numbers are not less than 5 which they should all be as meant to be average payoff):

BackStabber,DoubleCrosser,Fool Me Once,Grudger,Meta Hunter,Davis,Shubik,Inverse Punisher,Retaliate (0.05),Limited Retaliate (0.05/20),Limited Retaliate (0.08/15),Forgiver,Limited Retaliate (0.1/20),Retaliate (0.08),Forgetful Grudger,Retaliate (0.1),Win-Stay Lose-Shift,Appeaser,Math Constant Hunter,Punisher,Forgiving Tit For Tat,Tit For Tat,Eventual Cycle Hunter,Once Bitten,Soft Go By Majority: 5,Hard Tit For Tat,Soft Go By Majority: 20,Soft Go By Majority: 40,Soft Go By Majority: 10,Two Tits For Tat,Soft Go By Majority,Hard Prober,Grumpy,Hard Tit For 2 Tats,Tit For 2 Tats,Fool Me Forever,Prober 3,Tricky Defector,Random Hunter,Cycle Hunter,Sneaky Tit For Tat,Tester,Bully,Prober,Defector Hunter,Alternator Hunter,Cooperator,Opposite Grudger,Prober 2,Suspicious Tit For Tat,Defector,Alternator,$\pi$,$e$,Anti Tit For Tat,Aggravater,$\phi$,Cooperator Hunter,AntiCycler,Cycler CCD,Tricky Cooperator,Cycler CCCD,Cycler CCCCCD,Nice Average Copier,Forgetful Fool Me Once,Inverse,Soft Joss: 0.9,Meta Majority,Meta Majority Finite Memory,Meta Majority Memory One,Meta Majority Long Memory,ZD-GTFT-2,GTFT: 0.33,Eatherley,Champion,Stochastic WSLS,Average Copier,Feld,Meta Minority,Grofman,Tullock,Calculator,Meta Winner Long Memory,Meta Winner Memory One,Joss: 0.9,Meta Winner,Meta Winner Finite Memory,Cautious QLearner,Arrogant QLearner,Hesitant QLearner,Random: 0.5,Risky QLearner,ZD-Extort-2 9.50434782609,9.49695652174,9.44217391304,9.37173913043,9.32695652174,9.24760869565,8.97282608696,8.88260869565,8.86434782609,8.84782608696,8.82369565217,8.80717391304,8.76652173913,8.75217391304,8.71717391304,8.71543478261,8.62760869565,8.62239130435,8.60434782609,8.52782608696,8.52043478261,8.51239130435,8.48434782609,8.45195652174,8.44108695652,8.39891304348,8.3352173913,8.325,8.31586956522,8.26413043478,8.22869565217,8.17586956522,8.12956521739,8.12695652174,8.02630434783,7.85260869565,7.3902173913,7.31782608696,7.23195652174,7.17673913043,7.12782608696,7.1147826087,7.11086956522,7.06369565217,7.04869565217,6.95152173913,6.89869565217,6.77630434783,6.76586956522,6.74695652174,6.64434782609,6.64282608696,6.53847826087,6.5302173913,6.52217391304,6.51195652174,6.45108695652,6.32543478261,6.11826086957,6.1152173913,6.05586956522,5.81826086957,5.56652173913,3.02804347826,2.92652173913,2.87304347826,2.79326086957,2.78804347826,2.76239130435,2.76043478261,2.75608695652,2.735,2.72434782609,2.71260869565,2.67413043478,2.65391304348,2.63130434783,2.57108695652,2.56934782609,2.48369565217,2.46826086957,2.44195652174,2.40804347826,2.37,2.36391304348,2.36152173913,2.35108695652,2.34695652174,2.3297826087,2.32869565217,2.30543478261,2.28304347826,2.2802173913

I wasn't able to immediately reproduce.

Note: I think that @mojones was running this on a system with matplotlib not installed. I'm mentioning this in case reproducing it has something to do with that (virtualenv etc...).

Raising the issue now as I don't want this to be forgotten but probably won't be able to look at immediately.

mojones commented 9 years ago

For reference: full command line

./run_axelrod --xc --xa -t 10 -r 1 -p 1 -v DEBUG --ne -o my_run

and full output of strategies.csv:

DoubleCrosser,BackStabber,Fool Me Once,Grudger,Meta Hunter,Davis,Shubik,Inverse Punisher,Retaliate (0.05),Limited Retaliate (0.05/20),Forgiver,Limited Retaliate (0.08/15),Retaliate (0.08),Limited Retaliate (0.1/20),Forgetful Grudger,Retaliate (0.1),Win-Stay Lose-Shift,Appeaser,Math Constant Hunter,Forgiving Tit For Tat,Tit For Tat,Punisher,Eventual Cycle Hunter,Soft Go By Majority: 5,Hard Tit For Tat,Once Bitten,Soft Go By Majority: 20,Soft Go By Majority: 10,Soft Go By Majority: 40,Two Tits For Tat,Soft Go By Majority,Hard Prober,Hard Tit For 2 Tats,Grumpy,Tit For 2 Tats,Fool Me Forever,Prober 3,Tricky Defector,Random Hunter,Bully,Cycle Hunter,Tester,Prober,Sneaky Tit For Tat,Defector Hunter,Alternator Hunter,Cooperator,Opposite Grudger,Defector,Suspicious Tit For Tat,Prober 2,Alternator,Aggravater,$e$,Anti Tit For Tat,$\pi$,$\phi$,Cooperator Hunter,AntiCycler,Cycler CCD,Tricky Cooperator,Cycler CCCD,Cycler CCCCCD,Nice Average Copier,Meta Minority,ZD-Extort-2,Meta Majority Long Memory,Meta Majority Finite Memory,Feld,Joss: 0.9,Inverse,Meta Majority,Forgetful Fool Me Once,Meta Majority Memory One,Calculator,Average Copier,Soft Joss: 0.9,ZD-GTFT-2,Random: 0.5,Champion,Grofman,GTFT: 0.33,Eatherley,Stochastic WSLS,Risky QLearner,Meta Winner Memory One,Meta Winner Finite Memory,Cautious QLearner,Meta Winner,Meta Winner Long Memory,Hesitant QLearner,Tullock,Arrogant QLearner
43.7956521739,43.7891304348,43.4,43.1380434783,42.9173913043,42.6032608696,41.3217391304,40.8043478261,40.7141304348,40.5967391304,40.5184782609,40.3902173913,40.2760869565,40.2097826087,40.0880434783,40.0434782609,39.5,39.4836956522,39.397826087,39.0489130435,39.0358695652,39.0293478261,38.8815217391,38.552173913,38.55,38.5402173913,38.1760869565,38.1065217391,38.102173913,37.9239130435,37.7304347826,37.5195652174,37.1543478261,37.1065217391,36.5902173913,35.8380434783,33.9304347826,33.3152173913,32.6108695652,32.4173913043,32.4065217391,32.275,32.1141304348,31.9847826087,31.8923913043,31.3467391304,30.9913043478,30.8293478261,30.6826086957,30.6641304348,30.6,29.9532608696,29.7880434783,29.3684782609,29.2793478261,29.2641304348,28.7695652174,28.1836956522,27.4565217391,27.3076086957,26.6173913043,25.9597826087,24.8913043478,2.9347826087,2.80434782609,2.79347826087,2.78260869565,2.77065217391,2.76739130435,2.76739130435,2.76630434783,2.76086956522,2.75543478261,2.75434782609,2.75108695652,2.7402173913,2.73913043478,2.73369565217,2.7152173913,2.70760869565,2.7,2.69891304348,2.675,2.64239130435,2.41739130435,2.41630434783,2.4097826087,2.40543478261,2.4,2.4,2.39891304348,2.39347826087,2.37065217391
drvinceknight commented 9 years ago

:+1:

On Sat, 17 Oct 2015, 19:50 mojones notifications@github.com wrote:

For reference: full command line

./run_axelrod --xc --xa -t 10 -r 1 -p 1 -v DEBUG --ne -o my_run

and full output of strategies.csv:

DoubleCrosser,BackStabber,Fool Me Once,Grudger,Meta Hunter,Davis,Shubik,Inverse Punisher,Retaliate (0.05),Limited Retaliate (0.05/20),Forgiver,Limited Retaliate (0.08/15),Retaliate (0.08),Limited Retaliate (0.1/20),Forgetful Grudger,Retaliate (0.1),Win-Stay Lose-Shift,Appeaser,Math Constant Hunter,Forgiving Tit For Tat,Tit For Tat,Punisher,Eventual Cycle Hunter,Soft Go By Majority: 5,Hard Tit For Tat,Once Bitten,Soft Go By Majority: 20,Soft Go By Majority: 10,Soft Go By Majority: 40,Two Tits For Tat,Soft Go By Majority,Hard Prober,Hard Tit For 2 Tats,Grumpy,Tit For 2 Tats,Fool Me Forever,Prober 3,Tricky Defector,Random Hunter,Bully,Cycle Hunter,Tester,Prober,Sneaky Tit For Tat,Defector Hunter,Alternator Hunter,Cooperator,Opposite Grudger,Defector,Suspicious Tit For Tat,Prober 2,Alternator,Aggravater,$e$,Anti Tit For Tat,$\pi$,$\phi$,Cooperator Hunter,AntiCycler,Cycler CCD,Tricky Cooperator,Cycler CCCD,Cycler CCCCCD,Nice Average Copier,Meta Minority,ZD-Extort-2,Meta Majorit y Long Memory,Meta Majority Finite Memory,Feld,Joss: 0.9,Inverse,Meta Majority,Forgetful Fool Me Once,Meta Majority Memory One,Calculator,Average Copier,Soft Joss: 0.9,ZD-GTFT-2,Random: 0.5,Champion,Grofman,GTFT: 0.33,Eatherley,Stochastic WSLS,Risky QLearner,Meta Winner Memory One,Meta Winner Finite Memory,Cautious QLearner,Meta Winner,Meta Winner Long Memory,Hesitant QLearner,Tullock,Arrogant QLearner 43.7956521739,43.7891304348,43.4,43.1380434783,42.9173913043,42.6032608696,41.3217391304,40.8043478261,40.7141304348,40.5967391304,40.5184782609,40.3902173913,40.2760869565,40.2097826087,40.0880434783,40.0434782609,39.5,39.4836956522,39.397826087,39.0489130435,39.0358695652,39.0293478261,38.8815217391,38.552173913,38.55,38.5402173913,38.1760869565,38.1065217391,38.102173913,37.9239130435,37.7304347826,37.5195652174,37.1543478261,37.1065217391,36.5902173913,35.8380434783,33.9304347826,33.3152173913,32.6108695652,32.4173913043,32.4065217391,32.275,32.1141304348,31.9847826087,31.8923913043,31.3467391304,30.9913043478,30.8293478261,30.6826086957,30.6641304348,30.6,29.9532608696,29.7880434783,29.3684782609,29.2793478261,29.2641304348,28.7695652174,28.1836956522,27.4565217391,27.3076086957,26.6173913043,25.9597826087,24.8913043478,2.9347826087,2.80434782609,2.79347826087,2.78260869565,2.77065217391,2.76739130435,2.76739130435,2.76630434783,2.76086956522,2.75543478261,2.75434782609,2.751086 95652,2.7402173913,2.73913043478,2.73369565217,2.7152173913,2.70760869565,2.7,2.69891304348,2.675,2.64239130435,2.41739130435,2.41630434783,2.4097826087,2.40543478261,2.4,2.4,2.39891304348,2.39347826087,2.37065217391

— Reply to this email directly or view it on GitHub https://github.com/Axelrod-Python/Axelrod/issues/370#issuecomment-148942576 .

mojones commented 9 years ago

On my home system, everything is fine:

martin@martin-H97-D3H:/media/martin/exports/Dropbox/Code/Axelrod$ ./run_axelrod --xc --xa -t 10 -r 1 -p 1 -v DEBUG --ne -o my_run
Cache file not found. Starting with empty cache
Starting basic_strategies tournament with 1 round robins of 10 turns per pair.
Passing cache with 0 entries to basic_strategies tournament
Playing first round robin to build cache
Playing 0 round robins with 8 parallel processes
Finished basic_strategies tournament in 0.0s
The matplotlib library is not installed. No plots will be produced
Cache now has 45 entries
Finished all basic_strategies tasks in 0.0s
Starting strategies tournament with 1 round robins of 10 turns per pair.
Passing cache with 45 entries to strategies tournament
Playing first round robin to build cache
Playing 0 round robins with 8 parallel processes
Finished strategies tournament in 1.0s
The matplotlib library is not installed. No plots will be produced
Cache now has 2016 entries
Finished all strategies tasks in 1.0s
Finished all tournaments in 1.0s
martin@martin-H97-D3H:/media/martin/exports/Dropbox/Code/Axelrod$ cat my_run/strategies.csv 
Limited Retaliate (0.08/15),Retaliate (0.08),Limited Retaliate (0.05/20),Punisher,Grudger,Nice Average Copier,Forgiver,Forgetful Grudger,Hard Prober,Retaliate (0.05),Limited Retaliate (0.1/20),Retaliate (0.1),Inverse Punisher,Prober 3,BackStabber,Fool Me Once,DoubleCrosser,Forgiving Tit For Tat,Forgetful Fool Me Once,Hard Tit For Tat,Soft Joss: 0.9,Meta Majority Finite Memory,Once Bitten,Tricky Defector,Meta Minority,Tit For Tat,Meta Majority Memory One,Alternator,Feld,Sneaky Tit For Tat,Joss: 0.9,Prober,ZD-GTFT-2,Meta Majority Long Memory,Two Tits For Tat,Stochastic WSLS,Soft Go By Majority: 5,Calculator,Soft Go By Majority: 10,Win-Stay Lose-Shift,Meta Majority,Shubik,Appeaser,Inverse,Grofman,Defector,Soft Go By Majority: 20,Soft Go By Majority,Soft Go By Majority: 40,Bully,ZD-Extort-2,Hard Tit For 2 Tats,Eatherley,Anti Tit For Tat,GTFT: 0.33,Champion,Average Copier,Random: 0.5,Tester,Tit For 2 Tats,Fool Me Forever,Meta Hunter,AntiCycler,$\phi$,$e$,Cycler CCD,$\pi$,Defector Hunter,Tricky Cooperator,Arrogant QLearner,Cooperator Hunter,Math Constant Hunter,Cycler CCCD,Suspicious Tit For Tat,Cooperator,Alternator Hunter,Prober 2,Eventual Cycle Hunter,Meta Winner,Meta Winner Finite Memory,Meta Winner Long Memory,Aggravater,Random Hunter,Davis,Meta Winner Memory One,Tullock,Cycle Hunter,Cycler CCCCCD,Cautious QLearner,Grumpy,Hesitant QLearner,Risky QLearner,Opposite Grudger
2.9652173913,2.96195652174,2.94673913043,2.94347826087,2.93913043478,2.93695652174,2.92934782609,2.925,2.91413043478,2.9097826087,2.89673913043,2.89456521739,2.87608695652,2.86086956522,2.84565217391,2.83369565217,2.83043478261,2.8,2.79782608696,2.79782608696,2.79456521739,2.79347826087,2.79130434783,2.78913043478,2.78913043478,2.78586956522,2.78152173913,2.78043478261,2.77934782609,2.77934782609,2.77391304348,2.77173913043,2.77065217391,2.76739130435,2.7652173913,2.76304347826,2.75869565217,2.74673913043,2.74673913043,2.74673913043,2.74130434783,2.73804347826,2.73586956522,2.7347826087,2.73043478261,2.72608695652,2.72608695652,2.72282608696,2.71847826087,2.71413043478,2.69239130435,2.68152173913,2.68043478261,2.67608695652,2.67391304348,2.65652173913,2.64782608696,2.64565217391,2.63043478261,2.62934782609,2.5847826087,2.56630434783,2.5597826087,2.55543478261,2.5402173913,2.53695652174,2.52391304348,2.49130434783,2.48369565217,2.48043478261,2.47391304348,2.45217391304,2.44565217391,2.44347826087,2.43586956522,2.43260869565,2.43043478261,2.42282608696,2.42282608696,2.42282608696,2.42282608696,2.41956521739,2.41630434783,2.41304347826,2.41304347826,2.4097826087,2.40760869565,2.40434782609,2.39239130435,2.38369565217,2.36630434783,2.3597826087,2.28369565217
drvinceknight commented 9 years ago

Do you have matplotlib installed on your home system?

drvinceknight commented 8 years ago

I'm closing this as we were unable to replicate. Please re open if need be.