`TestIntegrations/CmdLabels` flakiness

[zmb3]

Failure

Link(s) to logs

• https://github.com/gravitational/teleport/actions/runs/4067295252/jobs/7004473695

Relevant snippet

integration_test.go:5237: 
[976](https://github.com/gravitational/teleport/actions/runs/4067295252/jobs/7004473695#step:6:977)
            Error Trace:    /__w/teleport/teleport/integration/integration_test.go:5237
[977](https://github.com/gravitational/teleport/actions/runs/4067295252/jobs/7004473695#step:6:978)
            Error:          Received unexpected error:
[978](https://github.com/gravitational/teleport/actions/runs/4067295252/jobs/7004473695#step:6:979)
                            failed connecting to node 00000000-0000-0000-0000-000000000000. Teleport proxy failed to connect to "node" agent "" over reverse tunnel:
[979](https://github.com/gravitational/teleport/actions/runs/4067295252/jobs/7004473695#step:6:980)

[980](https://github.com/gravitational/teleport/actions/runs/4067295252/jobs/7004473695#step:6:981)
                              no tunnel connection found: no node reverse tunnel for 00000000-0000-0000-0000-000000000000.local-site found
[981](https://github.com/gravitational/teleport/actions/runs/4067295252/jobs/7004473695#step:6:982)

[982](https://github.com/gravitational/teleport/actions/runs/4067295252/jobs/7004473695#step:6:983)
                            This usually means that the agent is offline or has disconnected. Check the
[983](https://github.com/gravitational/teleport/actions/runs/4067295252/jobs/7004473695#step:6:984)
                            agent logs and, if the issue persists, try restarting it or re-registering it
[984](https://github.com/gravitational/teleport/actions/runs/4067295252/jobs/7004473695#step:6:985)
                            with the cluster.
[985](https://github.com/gravitational/teleport/actions/runs/4067295252/jobs/7004473695#step:6:986)
            Test:           TestIntegrations/CmdLabels/Worker_only
[986](https://github.com/gravitational/teleport/actions/runs/4067295252/jobs/7004473695#step:6:987)
        --- FAIL: TestIntegrations/CmdLabels/Worker_only (1.14s)```

[zmb3]

Closing since there have been no recent reports

[GavinFrazar]

Different failure on branch/v15 https://github.com/gravitational/teleport/actions/runs/8913671313/job/24479656198

=== FAIL: integration TestIntegrations/CmdLabels/Both (1.91s)
WARNING: Multiple nodes matched label selector, running command on all.
Running command on server-02:
Running command on server-01:

[server-02] success
[server-01] success

2 host(s) succeeded; 0 host(s) failed
    integration_test.go:6315: 
            Error Trace:    /__w/teleport/teleport/integration/integration_test.go:6315
            Error:          []string{"[server-01] two[server-02] ", "two"} does not contain "[server-01] two"
            Test:           TestIntegrations/CmdLabels/Both
        --- FAIL: TestIntegrations/CmdLabels/Both (1.91s)

[ravicious]

v16 https://github.com/gravitational/teleport/actions/runs/9601609534/job/26480573055#step:6:1446

     integration_test.go:6252: 
            Error Trace:    /__w/teleport/teleport/integration/integration_test.go:6252
            Error:          "[[server-02] two]" should have 2 item(s), but has 1
            Test:           TestIntegrations/CmdLabels/Both
        --- FAIL: TestIntegrations/CmdLabels/Both (1.43s)

=== FAIL: integration TestIntegrations/CmdLabels/Worker_only (1.13s)
    integration_test.go:6250: 
            Error Trace:    /__w/teleport/teleport/integration/integration_test.go:6250
            Error:          Received unexpected error:
                            failed connecting to host 00000000-0000-0000-0000-000000000000:0: failed to receive cluster details response
                                failed to dial target host
                                Teleport proxy failed to connect to "node" agent "" over reverse tunnel:

                              no tunnel connection found: no node reverse tunnel for 00000000-0000-0000-0000-000000000000.local-site found

                            This usually means that the agent is offline or has disconnected. Check the
                            agent logs and, if the issue persists, try restarting it or re-registering it
                            with the cluster.
            Test:           TestIntegrations/CmdLabels/Worker_only
        --- FAIL: TestIntegrations/CmdLabels/Worker_only (1.13s)

[zmb3]

https://github.com/gravitational/teleport/actions/runs/9646182423/job/26602026666

=== FAIL: integration TestIntegrations/CmdLabels/Both (1.46s)
WARNING: Multiple nodes matched label selector, running command on all.
Running command on server-01:
Running command on server-02:

[server-01] success
[server-02] success

2 host(s) succeeded; 0 host(s) failed
    integration_test.go:6254: 
            Error Trace:    /__w/teleport/teleport/integration/integration_test.go:6254
            Error:          []string{"[server-02] two[server-01] ", "two"} does not contain "[server-01] two"
            Test:           TestIntegrations/CmdLabels/Both
        --- FAIL: TestIntegrations/CmdLabels/Both (1.46s)

=== FAIL: integration TestIntegrations/CmdLabels (5.56s)

[zmb3]

@atburke can you have a look at this one?