Open kapyaar opened 3 months ago
Few Observations
Of the 4 pieces
Nginx Unit with php If I run the same load test to a basic nothing.php that has a single line
echo "Connected, Got Response";
the K6 test for 30 seconds results in ~7k requests per second. So, this does not seem to be the issue.
http_reqs......................: 204813 [6821.635938/s]
Bitnami/kafka:3.7.0 I had someone else test this part, he used python (instead of php), and the test completed without any stalls.
This makes me think that something between php/ rdkafka might be turning out the bottleneck. I may be wrong. But been battling this for a while. Hope someone can throw some light on this.
Description
I am using nginx in docker with kafka. I have the following setup.
DockerFile
docker-compose.yml
php producer, basic example from https://arnaud.le-blanc.net/php-rdkafka-doc/phpdoc/rdkafka.examples-producer.html
K6 test script
Resulted in this output:
The test runs fine until the request count reaches little above 28000, and then It gives the following error.
If I wait for a minute or so, and run the test again, it goes as normal at around 1300 req/s, until it hits the 28k mark, and stalls again.
Any idea, what is causing this stall? Been pulling hair on this for a while, can't seem to figure out. Much appreciate any assistance.
php-rdkafka Version
6.0.3
librdkafka Version
1.6
PHP Version
PHP 8.2
Operating System
Windows WSL Docker
Kafka Version
bitnami/kafka:3.7.0