redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.53k stars 582 forks source link

CI Failure (key symptom) in `OMBValidationTest.test_max_partitions` #21332

Closed vbotbuildovich closed 2 months ago

vbotbuildovich commented 3 months ago

https://buildkite.com/redpanda/vtools/builds/15105

Module: rptest.redpanda_cloud_tests.omb_validation_test
Class: OMBValidationTest
Method: test_max_partitions
test_id:    OMBValidationTest.test_max_partitions
status:     FAIL
run time:   3.444 seconds

CalledProcessError(1, ['tbot', 'start', '--data-dir=/tmp/tbot-data', '--destination-dir=/tmp/machine-id', '--auth-server=proxy.tp.redpanda.com:443', '--join-method=gcp', '--token=buildkite-tp-gcp', '--certificate-ttl=6h', '--renewal-interval=6h', '--oneshot'], '', 'WARN [TBOT]      CLI parameters are overriding onboarding config from  config/config.go:472\nINFO [TBOT]      Created directory "/tmp/tbot-data" config/destination_directory.go:132\nINFO [TBOT]      Anonymous telemetry is not enabled. Find out more about Machine ID\'s anonymous telemetry at https://goteleport.com/docs/machine-id/reference/telemetry/ tbot/anonymous_telemetry.go:83\nINFO [TBOT]      Attempting to generate new identity from token tbot/renew.go:510\nINFO [AUTH]      Attempting registration via proxy server. auth/register.go:283\nINFO [AUTH]      Attempting registration with auth server. auth/register.go:283\nWARN [AUTH]      Joining cluster without validating the identity of the Auth Server. This may open you up to a Man-In-The-Middle (MITM) attack if an attacker can gain privileged network access. To remedy this, use the CA pin value provided when join token was generated to validate the identity of the Auth Server. auth/register.go:502\n\x1b[31mERROR: \x1b[0mid token claims did not match any allow rules, remote error: tls: internal error\n\n')
Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 177, in _do_run
    self.test = self.test_context.cls(self.test_context)
  File "/home/ubuntu/redpanda/tests/rptest/redpanda_cloud_tests/omb_validation_test.py", line 156, in __init__
    super().__init__(test_ctx, *args, **kwargs)
  File "/home/ubuntu/redpanda/tests/rptest/tests/redpanda_cloud_test.py", line 25, in __init__
    self.redpanda = make_redpanda_cloud_service(test_context)
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 5093, in make_redpanda_cloud_service
    return RedpandaServiceCloud(context,
  File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 1697, in __init__
    self.__kubectl = KubectlTool(
  File "/home/ubuntu/redpanda/tests/rptest/clients/kubectl.py", line 60, in __init__
    self._setup_tbot()
  File "/home/ubuntu/redpanda/tests/rptest/clients/kubectl.py", line 388, in _setup_tbot
    self._local_cmd(cmd)
  File "/home/ubuntu/redpanda/tests/rptest/clients/kubectl.py", line 232, in _local_cmd
    raise subprocess.CalledProcessError(process.returncode, cmd, s_out,
subprocess.CalledProcessError: Command '['tbot', 'start', '--data-dir=/tmp/tbot-data', '--destination-dir=/tmp/machine-id', '--auth-server=proxy.tp.redpanda.com:443', '--join-method=gcp', '--token=buildkite-tp-gcp', '--certificate-ttl=6h', '--renewal-interval=6h', '--oneshot']' returned non-zero exit status 1.

JIRA Link: CORE-5558

vbotbuildovich commented 2 months ago

https://buildkite.com/redpanda/vtools/builds/15491 https://buildkite.com/redpanda/vtools/builds/15571

vbotbuildovich commented 2 months ago

*https://buildkite.com/redpanda/vtools/builds/15653

dotnwat commented 2 months ago

kubectl dupe thing