CSSLab / maia-chess

Maia is a human-like neural network chess engine trained on millions of human games.
https://maiachess.com
GNU General Public License v3.0
939 stars 120 forks source link

Slow play even with "fast" and one legal move #50

Closed skerin closed 1 year ago

skerin commented 1 year ago

I'm having an issue with Maia1 playing slow even in situations that should be fast. It took Maia several minutes to make the only legal move in this position even after typing "fast" in chat and getting the "I'll play instantly" reply. I'm not sure what to do with this and if there is anything I can do to make Maia1 play any faster. Thank you for your help. image

reidmcy commented 1 year ago

Can you give me a link to the game.

I suspect what is happening is that you are playing against one of the testing models. They should be slightly more human but take a lot more computing time to run, so we have them running on a small number of games each day to see if they're an improvement

skerin commented 1 year ago

https://lichess.org/VDQKK8PuP7G0 Here's the link. The actual game ends in just a few minutes now and this last move had Maia take over 3 hours and 40 minutes to make a move. I maxed the timer so I wouldn't need to worry about that since I'm still learning stuff and wanted to practice.

On Sat, Apr 22, 2023 at 5:16 PM Reid McIlroy-Young @.***> wrote:

Can you give me a link to the game.

I suspect what is happening is that you are playing against one of the testing models. They should be slightly more human but take a lot more computing time to run, so we have them running on a small number of games each day to see if they're an improvement

— Reply to this email directly, view it on GitHub https://github.com/CSSLab/maia-chess/issues/50#issuecomment-1518902706, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACMZNTNDYIIS43Q2NE6YMETXCRYG7ANCNFSM6AAAAAAXIB633Q . You are receiving this because you authored the thread.Message ID: @.***>

reidmcy commented 1 year ago

Thanks for the game ID.

This looks to have been some issue with the bot's communications with Lichess. After f8e7 the bot never got your next move from Lichess. So it thought it was waiting for you. I'll see if I can add some extra checks for this, but it's a rare event so it will be hard fix unless it starts happening more. There's just a small chance of failure with anything going over the internet.

Here's the raw logs in case you're interested (they're also a note for me):

-[ RECORD 3 ]-+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------------------------------------------
timestamp     | 2023-04-22 21:13:34.31601+00
bot_name      | maia1
server_name   | lichess
commit_hex    | ddf922
game_id       | VDQKK8Pu
kind          | STREAM
url           | /api/bot/game/stream/VDQKK8Pu
response_data | {"type": "opponentGone", "gone": false}
post_data     | null
-[ RECORD 4 ]-+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------------------------------------------
timestamp     | 2023-04-22 21:00:56.100411+00
bot_name      | maia1
server_name   | lichess
commit_hex    | ddf922
game_id       | VDQKK8Pu
kind          | STREAM
url           | /api/bot/game/stream/VDQKK8Pu
response_data | {"id": "VDQKK8Pu", "variant": {"key": "standard", "name": "Standard", "short": "Std"}, "clock": {"initial": 10800000, "increment": 180000}, "speed": "classical", "perf": {"name": "Classical"}, "rated": false, "createdAt": 1682195299658, "white": {"id": "dr_cave", "name": "Dr_Cave", "title": null, "rating": 1500, "provisional": true}, "black": {"id": "maia1", "name": "maia1", "title": "BOT", "rating": 1454}, "initialFen": "startpos", "type": "gameFull", "state": {"type": "gameState", "moves": "e2e4 e7e5 b1c3 f8c5 g1f3 d7d6 c3a4 c8g4 a4c5 d6c5 f1b5 c7c6 b5c4 g8f6 c4f7 e8f7 f3e5 f7e6 e5g4 f6g4 d1g4 e6f7 g4h5 g7g6 h5c5 h8e8 d2d3 b8d7 c5c4 f7f8 c1h6 f8e7 h6g5 d7f6 e4e5 e7f8 g5h6 f8e7", "wtime": 13154140, "btime": 12975210, "winc": 180000, "binc": 180000, "status": "started"}}
post_data     | null
-[ RECORD 5 ]-+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
timestamp     | 2023-04-22 21:00:55.952236+00
bot_name      | maia1
server_name   | lichess
commit_hex    | ddf922
game_id       | VDQKK8Pu
kind          | STREAM
url           | /api/bot/game/stream/VDQKK8Pu
response_data | {"type": "gameState", "moves": "e2e4 e7e5 b1c3 f8c5 g1f3 d7d6 c3a4 c8g4 a4c5 d6c5 f1b5 c7c6 b5c4 g8f6 c4f7 e8f7 f3e5 f7e6 e5g4 f6g4 d1g4 e6f7 g4h5 g7g6 h5c5 h8e8 d2d3 b8d7 c5c4 f7f8 c1h6 f8e7 h6g5 d7f6 e4e5 e7f8 g5h6
", "wtime": 13154290, "btime": 12877410, "winc": 180000, "binc": 180000, "status": "started"}
post_data     | null
-[ RECORD 6 ]-+-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-----------------------------------------------------------------------------------------------------
timestamp     | 2023-04-22 21:00:55.951087+00
bot_name      | maia1
server_name   | lichess
commit_hex    | ddf922
game_id       | VDQKK8Pu
kind          | POST
url           | /api/bot/game/VDQKK8Pu/move/f8e7
response_data | {"ok": true}
post_data     | null