astral-sh / ruff

An extremely fast Python linter and code formatter, written in Rust.
https://docs.astral.sh/ruff
MIT License
29.84k stars 975 forks source link

Odd ecosystem results on typeshed #11305

Open AlexWaygood opened 3 months ago

AlexWaygood commented 3 months ago

Seems like there's something up with the ecosystem check when it runs on typeshed currently. We've had issues on several PRs where the ecosystem check has produced surprising results that don't make logical sense and can't be reproduced locally:

No idea what's up here

MichaReiser commented 3 months ago

Would you mind listing some of the "odd" examples and explaining why they're odd?

AlexWaygood commented 3 months ago

Would you mind listing some of the "odd" examples and explaining why they're odd?

In all three comments I linked to above, the ecosystem check either surfaced new lint errors that could not be reproduced locally when running ruff with the PR branch, and/or failed to report errors going away even though locally running ruff with the PR branch led to existing lint errors going away