search

Morgan-Griffiths / PokerAI

1 poker program to rule them all
MIT License
4 stars 4 forks source link

Test your Poker Agents on pokerwars.io #12

Open systats opened 4 years ago

systats commented 4 years ago

Hi Guys,

just wanna let you know that there is a Free Poker Bot Platform to test your agents in a more heterogenous environment. I think the current bots are already pretty competitive although it would be nice to compete against more ml experts. There are around 20-40 bots online almost 24/7.

Jump to pokerwars leaderboard or check out several API languages on pokerwars github

Hope to see some of you there and exchange some insights.

Cheers, Simon

PS: your performance analysis look very interesting!

Morgan-Griffiths commented 4 years ago

Hi!

Thank you for reaching out. I am mostly coding so i didn't notice this post until just now. I will check it out! I am currently bootstraping to the full game. I will have to check out what your game state representation is like. Since i'm coding the poker env and bots and everything else myself, it would be nice to have an env that is optimized etc. I'm guessing the API isn't useful for self play? Just for evaluation?

systats commented 4 years ago

Hi, very cool project! And sorry for the late responds. You can register your bot twice or run the same bot under a second account. But at the moment you get very limited information of card run outs if allin. I think the main purpose right now is for evaluation and maybe later for training. We are in discussion to get access to all played poker hands. This would allow off-policy learning with all the bots data. Hope we see you there.

Morgan-Griffiths commented 4 years ago

Thanks for the information! Off policy would be cool. In poker its a bit more involved as you have to keep track of who made which decisions. Since the same player can potentially act twice in a row (end of one street, beginning of the next). Currently i'm just doing online policy training, as it simplifies things. I've finally gotten to the full game. However i will be doing heads up first. So it might be a bit before i get to 3+ players. Do you have Heads up tournaments as well?

systats commented 4 years ago

Sounds cool. You can build two separate models or logics, one for hand pre-flop selection and in case of a heads up showdown you can switch in your agent. I am not affiliated to pokerwars other than heavily using it and there are no heads up rooms. But the tournament structure of 9 players gets certainly to the point of fierce heads up battle.