search

locustio / locust

Write scalable load tests in plain Python 🚗💨
https://locust.cloud
MIT License
25.06k stars 3k forks source link

Failure events not being recorded #979

Closed ghost closed 5 years ago

ghost commented 5 years ago

Description of issue

I have locust 0.9.0 installed in a OracleLinux7 Docker image along with Python 2.7 with all dependencies. When I run this image in a container on Mac-OS, all events (both success and failure) are recorded and counted in the summary report properly. Failures also appear with detail information at the end of the summary report. Exporting the same image to a OracleLinux7 system and running it in a Docker container results in different behavior. No failures are reported and everything appears as a success in the summary report. No failures appear in the summary. However, viewing the Grafana metrics there are indeed failures appearing which are reported by the application under test. All tests are run against the same server and application. The only obvious difference is differing Docker versions on the host.

Expected behavior

Regardless of where the Docker image is run, Locust reports should reliably show success and failure metrics.

Actual behavior

Summary information is correct running the Docker image in a container under Mac-OS but missing information when the same Docker image is run in a container on Oraclelinux.

Environment settings

cgoldberg commented 5 years ago

not enough info.

ghost commented 5 years ago

What info is needed?

cgoldberg commented 5 years ago
ghost commented 5 years ago

Unable to provide a reproducible example because the issue only appears on a proprietary server.

cgoldberg commented 5 years ago

sorry, it's not possible for us to be of any further help.