search

apache / trafficserver

Apache Traffic Server™ is a fast, scalable and extensible HTTP/1.1 and HTTP/2 compliant caching proxy server.
https://trafficserver.apache.org/
Apache License 2.0
1.82k stars 804 forks source link

certifier plugin crash on master #9794

Open bneradt opened 1 year ago

bneradt commented 1 year ago

I'm a part of the team that manages the ASF ATS CI images. I did a routine update of the ci.trafficserver.apache.org/ats/rockylinux:8 image to make it slimmer by cleaning up build artifacts. We noticed, however, that with that update, the certifier.test.py test started failing due to what looked like a shutdown crash from ATS. Through some investigation, I observed:

  1. Start with the previous ci.trafficserver.apache.org/ats/rockylinux:8 docker image and run the certifier autest, it passes fine. The original image is available on docker1 in the CI system, which I have access to.
  2. Now run sudo yum update and update the system packages.
  3. Then rebuild ATS after a full git clean.
  4. Then re-run the certifier autest. The test now fails due to the ATS crash.

@maskit and @bryancall both reproduced this crash on later Fedora versions, so this isn't a peculiarity of the docker image itself. It's just occasioned by some package update.

@maskit found that the crash could be avoided by commenting out the debug log from a destructor in the certifier.cc file, see: https://github.com/apache/trafficserver/pull/9792

We agreed to merge that in temporarily to keep CI green so that PRs can be merged. However, we need to prioritize figuring out why that log results in a crash with that certifier test.

github-actions[bot] commented 5 months ago

This issue has been automatically marked as stale because it has not had recent activity. Marking it stale to flag it for further consideration by the community.