search

duesee / imap-codec

Rock-solid and complete codec for IMAP
Apache License 2.0
35 stars 13 forks source link

Review CI cache (due to potentially flaky coverage) #508

Closed duesee closed 2 weeks ago

HenningHolmDE commented 2 weeks ago

For some context: On #504, coverage failed with a somewhat strange behavior. While a locally generated report looked fine, the report on Coveralls looked rather strange.

Snippet from local report: local report Snippet from Coveralls report: coveralls report snippet

HenningHolmDE commented 2 weeks ago

I have now run a debug test build archiving the generated coverage report from the runner to be downloaded for inspection.

As is seems, the issue is not related to Coveralls but happens when generating the report on the runner: snippet from runner report

HenningHolmDE commented 2 weeks ago

... and yes, when disabling the GitHub build cache, the issue is resolved. So disabling the cache (at least for the coverage job) seems to be one way to go.

I will continue to investigate this a bit further, maybe there is a better way to fix this ...

HenningHolmDE commented 2 weeks ago

Clearing target/debug/* resolves the issue as well, so it seems like some build artifacts confuses the coverage data collection. Unfortunately, I was not able to pinpoint which specific build artifact causes this.

However, as opposed to disabling the GitHub cache all together, this at least leaves the cargo cache in the user's home directory in place.