knative-extensions / eventing-kafka-broker

Alternate Kafka Broker implementation.
Apache License 2.0
170 stars 116 forks source link

Long-term testing of Knative Eventing Kafka components #2382

Open aslom opened 2 years ago

aslom commented 2 years ago

Problem Currently there is no easy way to run long-term testing of Knative Eventing Kafka components. For example to create and delete Kafka source every N minutes for M hours and see if there are any performance issues or resource leaks

Persona: Which persona is this feature for? Event consumer (developer), System Integrator, System Operator

Exit Criteria A measurable (binary) test that would indicate that the problem has been resolved. Running tests for at least 12 hours in Kubernetes cluster with Knative Eventing Kafka components

Time Estimate (optional): How many developer-days do you think this may take to resolve? 4d

Additional context (optional) Add any other context about the feature request here. This is addition to running tests to verify long term operations of Knative Eventing Kafka components

aslom commented 2 years ago

/assign

pierDipi commented 2 years ago

@aslom can you please share the plan before starting coding? Thanks!

aslom commented 2 years ago

I am modifying existing setup for testing duplicates[1] to run a simple script that executes kubectl command (simulating user interaction) either as crontab or just directly. Main trouble is to have necessary setup do kubectl can run but I am close to have it running in generic way with service account.

[1] https://github.com/aslom/reproduce-kafka-source/tree/main/duplicates1