cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.07k stars 3.8k forks source link

ccl/jwtauthccl: TestJWTAuthWithCustomCACert failed #128214

Closed github-actions[bot] closed 1 month ago

github-actions[bot] commented 2 months ago

ccl/jwtauthccl.TestJWTAuthWithCustomCACert failed on release-24.2 @ 11e01456a2914c208e2698548869d443443ff49e:

        net/http.(*Transport).dialConnFor(0xc0040343c0, 0xc00c459a20)
            GOROOT/src/net/http/transport.go:1485 +0xcd
        created by net/http.(*Transport).queueForDial in goroutine 38156
            GOROOT/src/net/http/transport.go:1449 +0x3c9
        Leaked goroutine: goroutine 38180 [syscall]:
        syscall.Syscall(0x0, 0x7, 0xc002240600, 0x5ea)
            GOROOT/src/syscall/syscall_linux.go:69 +0x25
        syscall.read(0xc00db51d40?, {0xc002240600?, 0xcbded00?, 0xc00409b210?})
            GOROOT/src/syscall/zsyscall_linux_amd64.go:736 +0x38
        syscall.Read(...)
            GOROOT/src/syscall/syscall_unix.go:181
        internal/poll.ignoringEINTRIO(...)
            GOROOT/src/internal/poll/fd_unix.go:736
        internal/poll.(*FD).Read(0xc00db51d40, {0xc002240600, 0x5ea, 0x5ea})
            GOROOT/src/internal/poll/fd_unix.go:160 +0x2ae
        os.(*File).read(...)
            GOROOT/src/os/file_posix.go:29
        os.(*File).Read(0xc00d04e1a8, {0xc002240600?, 0x0?, 0x0?})
            GOROOT/src/os/file.go:118 +0x52
        os.ReadFile({0xc009483230?, 0x6b6dbc9?})
            GOROOT/src/os/file.go:793 +0x167
        crypto/x509.loadSystemRoots()
            GOROOT/src/crypto/x509/root_unix.go:70 +0x396
        crypto/x509.initSystemRoots()
            GOROOT/src/crypto/x509/root.go:30 +0x5c
        sync.(*Once).doSlow(0xc008bb3f80?, 0x10?)
            GOROOT/src/sync/once.go:74 +0xc2
        sync.(*Once).Do(...)
            GOROOT/src/sync/once.go:65
        crypto/x509.systemRootsPool()
            GOROOT/src/crypto/x509/root.go:21 +0x45
        crypto/x509.(*Certificate).Verify(0xc00202ab08, {{0xc0022109b0, 0x9}, 0xc008bb25d0, 0x0, {0xc1a36c29af3225b5, 0x58d01a6a3, 0xc935f60}, {0x0, 0x0, ...}, ...})
            GOROOT/src/crypto/x509/verify.go:784 +0x15d
        crypto/tls.(*Conn).verifyServerCertificate(0xc0040aa708, {0xc00ae028d0, 0x1, 0x1})
            GOROOT/src/crypto/tls/handshake_client.go:997 +0x819
        crypto/tls.(*clientHandshakeStateTLS13).readServerCertificate(0xc00409bbd0)
            GOROOT/src/crypto/tls/handshake_client_tls13.go:531 +0x273
        crypto/tls.(*clientHandshakeStateTLS13).handshake(0xc00409bbd0)
            GOROOT/src/crypto/tls/handshake_client_tls13.go:96 +0x29a
        crypto/tls.(*Conn).clientHandshake(0xc0040aa708, {0x84bdd80, 0xc0068fdd10})
            GOROOT/src/crypto/tls/handshake_client.go:263 +0x594
        crypto/tls.(*Conn).handshakeContext(0xc0040aa708, {0x84bde28, 0xc002625b20})
            GOROOT/src/crypto/tls/conn.go:1553 +0x3cb
        crypto/tls.(*Conn).HandshakeContext(...)
            GOROOT/src/crypto/tls/conn.go:1493
        net/http.(*persistConn).addTLS.func2()
            GOROOT/src/net/http/transport.go:1573 +0x6e
        created by net/http.(*persistConn).addTLS in goroutine 38169
            GOROOT/src/net/http/transport.go:1569 +0x309
--- FAIL: TestJWTAuthWithCustomCACert (9.95s)

Parameters:

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/cloud-identity

This test on roachdash | Improve this report!

Jira issue: CRDB-40867

pritesh-lahoti commented 2 months ago

This seems to be an intermittent failure. Noticed that the other runs before and after this occurrence had passed - https://mesolite.cluster.engflow.com/invocations?besKeywords=branch%3Drelease-24.2&besKeywords=job%3Dunit_tests&besKeywords=ci-unit-test&createdAfter=2024-07-31T18%3A30%3A00.000Z.

The failure is similar to the one observed here: https://github.com/cockroachdb/cockroach/issues/119052.

Removing the release-blocker label for now.

cockroach-teamcity commented 2 months ago

ccl/jwtauthccl.TestJWTAuthWithCustomCACert failed on release-24.2 @ aa5cfc570c2875548db61118978d6c293516f908:

        net/http.(*Transport).dialConnFor(0xc004827cc0, 0xc0042a1080)
            GOROOT/src/net/http/transport.go:1485 +0xcd
        created by net/http.(*Transport).queueForDial in goroutine 38199
            GOROOT/src/net/http/transport.go:1449 +0x3c9
        Leaked goroutine: goroutine 38230 [syscall]:
        syscall.Syscall(0x0, 0x8, 0xc003ab4e00, 0x32f)
            GOROOT/src/syscall/syscall_linux.go:69 +0x25
        syscall.read(0xc0097c9ec0?, {0xc003ab4e00?, 0xc003f0a5e8?, 0xc002663210?})
            GOROOT/src/syscall/zsyscall_linux_amd64.go:736 +0x38
        syscall.Read(...)
            GOROOT/src/syscall/syscall_unix.go:181
        internal/poll.ignoringEINTRIO(...)
            GOROOT/src/internal/poll/fd_unix.go:736
        internal/poll.(*FD).Read(0xc0097c9ec0, {0xc003ab4e00, 0x32f, 0x32f})
            GOROOT/src/internal/poll/fd_unix.go:160 +0x2ae
        os.(*File).read(...)
            GOROOT/src/os/file_posix.go:29
        os.(*File).Read(0xc008d64038, {0xc003ab4e00?, 0x0?, 0x0?})
            GOROOT/src/os/file.go:118 +0x52
        os.ReadFile({0xc003d7dfb0?, 0x6b6f3f7?})
            GOROOT/src/os/file.go:793 +0x167
        crypto/x509.loadSystemRoots()
            GOROOT/src/crypto/x509/root_unix.go:70 +0x396
        crypto/x509.initSystemRoots()
            GOROOT/src/crypto/x509/root.go:30 +0x5c
        sync.(*Once).doSlow(0xc001d61f80?, 0x10?)
            GOROOT/src/sync/once.go:74 +0xc2
        sync.(*Once).Do(...)
            GOROOT/src/sync/once.go:65
        crypto/x509.systemRootsPool()
            GOROOT/src/crypto/x509/root.go:21 +0x45
        crypto/x509.(*Certificate).Verify(0xc002d94688, {{0xc0075e9a10, 0x9}, 0xc001d616b0, 0x0, {0xc1a99777891bcc57, 0x507a793bb, 0xc9381c0}, {0x0, 0x0, ...}, ...})
            GOROOT/src/crypto/x509/verify.go:784 +0x15d
        crypto/tls.(*Conn).verifyServerCertificate(0xc008412a88, {0xc009aa5ce0, 0x1, 0x1})
            GOROOT/src/crypto/tls/handshake_client.go:997 +0x819
        crypto/tls.(*clientHandshakeStateTLS13).readServerCertificate(0xc002663bd0)
            GOROOT/src/crypto/tls/handshake_client_tls13.go:531 +0x273
        crypto/tls.(*clientHandshakeStateTLS13).handshake(0xc002663bd0)
            GOROOT/src/crypto/tls/handshake_client_tls13.go:96 +0x29a
        crypto/tls.(*Conn).clientHandshake(0xc008412a88, {0x84bfb60, 0xc006f56910})
            GOROOT/src/crypto/tls/handshake_client.go:263 +0x594
        crypto/tls.(*Conn).handshakeContext(0xc008412a88, {0x84bfc08, 0xc00437d180})
            GOROOT/src/crypto/tls/conn.go:1553 +0x3cb
        crypto/tls.(*Conn).HandshakeContext(...)
            GOROOT/src/crypto/tls/conn.go:1493
        net/http.(*persistConn).addTLS.func2()
            GOROOT/src/net/http/transport.go:1573 +0x6e
        created by net/http.(*persistConn).addTLS in goroutine 38212
            GOROOT/src/net/http/transport.go:1569 +0x309
--- FAIL: TestJWTAuthWithCustomCACert (10.77s)

Parameters:

See also: How To Investigate a Go Test Failure (internal)

Same failure on other branches

- #129112 ccl/jwtauthccl: TestJWTAuthWithCustomCACert failed [C-test-failure O-robot branch-release-24.2.0-rc release-blocker]

This test on roachdash | Improve this report!

blathers-crl[bot] commented 1 month ago

Based on the specified backports for linked PR #129802, I applied the following new label(s) to this issue: branch-release-24.2.1-rc. Please adjust the labels as needed to match the branches actually affected by this issue, including adding any known older branches.

:owl: Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.