tarantool / cartridge

Out-of-the-box cluster manager for Tarantool with a modern web UI
https://www.tarantool.io/en/cartridge/
BSD 2-Clause "Simplified" License
94 stars 30 forks source link

flaky test: integration.reboot.test_advertise_change #1664

Closed yngvar-antonsson closed 2 years ago

yngvar-antonsson commented 2 years ago
1) integration.reboot.test_advertise_change
412
Inappropriate state "ConnectingFullmesh" ~= desired "RolesConfigured"
413
stack traceback:
414
    builtin/box/net_box.lua:1100: in function '_request'
415
    builtin/box/net_box.lua:1149: in function 'eval'
416
    ./test/helper.lua:102: in function 'wish_state'
417
    ./test/integration/reboot_test.lua:211: in function 'integration.reboot.test_advertise_change'
418
    ...
419
    [C]: in function 'xpcall'
420

421
Captured stdout:
422
master | Using advertise_uri "localhost:13301"
423
master | Membership encryption enabled
424
master | Probe uri was successful
425
master | Membership BROADCAST sent to 127.0.0.1:13302
426
master | Membership BROADCAST sent to 10.1.255.255:13302
427
master | Membership BROADCAST sent to 172.17.255.255:13302
428
master | Membership BROADCAST sent to 127.0.0.1:13301
429
master | Membership BROADCAST sent to 10.1.255.255:13301
430
master | Membership BROADCAST sent to 172.17.255.255:13301
431
master | Membership BROADCAST sent to 127.0.0.1:3301
432
master | Membership BROADCAST sent to 10.1.255.255:3301
433
master | Membership BROADCAST sent to 172.17.255.255:3301
434
master | Membership BROADCAST sent to 127.0.0.1:13300
435
master | Membership BROADCAST sent to 10.1.255.255:13300
436
master | Membership BROADCAST sent to 172.17.255.255:13300
437
master | started
438
master | Listening HTTP on 0.0.0.0:8081
439
master | started
440
master | Remote control bound to 127.0.0.1:13301
441
master | Remote control ready to accept connections
442
master | Instance state changed:  -> Unconfigured
443
master | Cartridge scm-1
444
master | server alias master
445
master | advertise uri localhost:13301
446
master | working directory /tmp/tmp.cartridge.dbi4YKzZ_T_3/localhost-13301
447
master | Cartridge options:
448
master | advertise_uri = localhost:13301
449
master | alias = master
450
master | auth_backend_name = cartridge.auth-backend
451
master | auth_enabled = nil
452
master | bucket_count = 3000
453
master | console_sock = nil
454
master | http_enabled = true
455
master | http_host = 0.0.0.0
456
master | http_port = 8081
457
master | roles = ["cartridge.roles.vshard-storage","cartridge.roles.vshard-router","mymodule-dependency","mymodule-permanent","mymodule-hidden","mymodule"]
458
master | roles_reload_allowed = true
459
master | swim_broadcast = true
460
master | upgrade_schema = nil
461
master | upload_prefix = /tmp/tmp.cartridge.dbi4YKzZ_T_3/localhost-13301/../upload
462
master | vshard_groups = nil
463
master | webui_blacklist = nil
464
master | webui_enabled = true
465
master | webui_enforce_root_redirect = true
466
master | webui_prefix = 
467
master | workdir = /tmp/tmp.cartridge.dbi4YKzZ_T_3/localhost-13301
468
master | entering the event loop
469
master | Updating config clusterwide...
470
master | (2PC) patch_clusterwide upload phase...
471
master | (2PC) patch_clusterwide prepare phase...
472
master | Prepared for patch_clusterwide at localhost:13301
473
master | (2PC) patch_clusterwide commit phase...
474
master | Instance state changed: Unconfigured -> BootstrappingBox
475
master | Calling box.cfg()...
476
master | 2021-12-24 14:10:24.938 [6898] main/117/remote_control/127.0.0.1:43020 I> systemd: NOTIFY_SOCKET variable is empty, skipping
477
master | 2021-12-24 14:10:24.938 [6898] main/117/remote_control/127.0.0.1:43020 C> Tarantool 1.10.12-0-gc3cb70ec4
478
master | 2021-12-24 14:10:24.938 [6898] main/117/remote_control/127.0.0.1:43020 C> log level 5
479
master | 2021-12-24 14:10:24.938 [6898] main/117/remote_control/127.0.0.1:43020 I> mapping 268435456 bytes for memtx tuple arena...
480
master | 2021-12-24 14:10:24.938 [6898] main/117/remote_control/127.0.0.1:43020 I> Actual slab_alloc_factor calculated on the basis of desired slab_alloc_factor = 1.044274
481
master | 2021-12-24 14:10:24.938 [6898] main/117/remote_control/127.0.0.1:43020 I> mapping 134217728 bytes for vinyl tuple arena...
482
master | 2021-12-24 14:10:24.942 [6898] main/117/remote_control/127.0.0.1:43020 I> instance uuid aaaaaaaa-aaaa-0000-0000-000000000001
483
master | 2021-12-24 14:10:24.942 [6898] main/118/remote_control/127.0.0.1:43020 I> Cartridge scm-1
484
master | 2021-12-24 14:10:24.942 [6898] main/118/remote_control/127.0.0.1:43020 I> server alias master
485
master | 2021-12-24 14:10:24.942 [6898] main/118/remote_control/127.0.0.1:43020 I> advertise uri localhost:13301
486
master | 2021-12-24 14:10:24.942 [6898] main/118/remote_control/127.0.0.1:43020 I> working directory /tmp/tmp.cartridge.dbi4YKzZ_T_3/localhost-13301
487
master | 2021-12-24 14:10:24.942 [6898] main/117/remote_control/127.0.0.1:43020 I> initializing an empty data directory
488
master | 2021-12-24 14:10:24.948 [6898] main/117/remote_control/127.0.0.1:43020 I> assigned id 1 to replica aaaaaaaa-aaaa-0000-0000-000000000001
489
master | 2021-12-24 14:10:24.948 [6898] main/117/remote_control/127.0.0.1:43020 I> cluster uuid aaaaaaaa-0000-0000-0000-000000000000
490
master | 2021-12-24 14:10:24.950 [6898] snapshot/101/main I> saving snapshot `/tmp/tmp.cartridge.dbi4YKzZ_T_3/localhost-13301/00000000000000000000.snap.inprogress'
491
master | 2021-12-24 14:10:24.952 [6898] snapshot/101/main I> done
492
master | 2021-12-24 14:10:24.953 [6898] main/117/remote_control/127.0.0.1:43020 I> ready to accept requests
493
master | 2021-12-24 14:10:24.953 [6898] main/124/checkpoint_daemon I> started
494
master | 2021-12-24 14:10:24.953 [6898] main/124/checkpoint_daemon I> scheduled the next snapshot at Fri Dec 24 15:58:48 2021
495
master | 2021-12-24 14:10:24.954 [6898] main/117/remote_control/127.0.0.1:43020 I> Making sure user "admin" exists...
496
master | 2021-12-24 14:10:24.955 [6898] main/117/remote_control/127.0.0.1:43020 I> Granting replication permissions to "admin"...
497
master | 2021-12-24 14:10:24.955 [6898] main/117/remote_control/127.0.0.1:43020 I> Setting password for user "admin" ...
498
master | 2021-12-24 14:10:24.955 [6898] main/117/remote_control/127.0.0.1:43020 I> Remote control stopped
499
master | 2021-12-24 14:10:24.956 [6898] iproto/101/main I> binary: bound to 0.0.0.0:13301
500
master | 2021-12-24 14:10:24.956 [6898] main/106/remote_control/127.0.0.1:13301 I> stopped
651
master | 2021-12-24 14:10:25.262 [6910] main/107/lua I> recover from `/tmp/tmp.cartridge.dbi4YKzZ_T_3/localhost-13301/00000000000000000000.xlog'
652
master | 2021-12-24 14:10:25.262 [6910] main/107/lua I> done `/tmp/tmp.cartridge.dbi4YKzZ_T_3/localhost-13301/00000000000000000000.xlog'
653
master | 2021-12-24 14:10:25.262 [6910] main/107/lua I> recover from `/tmp/tmp.cartridge.dbi4YKzZ_T_3/localhost-13301/00000000000000000003.xlog'
654
master | 2021-12-24 14:10:25.262 [6910] main/107/lua I> done `/tmp/tmp.cartridge.dbi4YKzZ_T_3/localhost-13301/00000000000000000003.xlog'
655
master | 2021-12-24 14:10:25.262 [6910] main/107/lua I> ready to accept requests
656
master | 2021-12-24 14:10:25.262 [6910] main/107/lua C> leaving orphan mode
657
master | 2021-12-24 14:10:25.263 [6910] main/114/checkpoint_daemon I> started
658
master | 2021-12-24 14:10:25.263 [6910] main/114/checkpoint_daemon I> scheduled the next snapshot at Fri Dec 24 15:14:35 2021
659
master | 2021-12-24 14:10:25.263 [6910] main/107/lua I> set 'read_only' configuration option to true
660
master | 2021-12-24 14:10:25.264 [6910] main/107/lua I> Making sure user "admin" exists...
661
master | 2021-12-24 14:10:25.264 [6910] main/107/lua I> Remote control stopped
662
master | 2021-12-24 14:10:25.264 [6910] iproto/101/main I> binary: bound to 0.0.0.0:13301
663
master | 2021-12-24 14:10:25.264 [6910] main/106/remote_control/127.0.0.1:13301 I> stopped
664
master | 2021-12-24 14:10:25.264 [6910] main/107/lua I> set 'listen' configuration option to "13301"
665
master | 2021-12-24 14:10:25.264 [6910] main/107/lua I> Instance state changed: RecoveringSnapshot -> ConnectingFullmesh
666
master | 2021-12-24 14:10:25.264 [6910] main/107/lua I> connecting to 1 replicas
667
master | 2021-12-24 14:10:25.266 [6910] main/119/applier/admin@localhost:13301 I> remote master aaaaaaaa-aaaa-0000-0000-000000000001 at 127.0.0.1:13301 running Tarantool 1.10.12
yngvar-antonsson commented 2 years ago

Flaky test happening again: https://github.com/tarantool/cartridge/runs/4642524483?check_suite_focus=true