Separate CI concers into different workflows

ray-project / ray_beam_runner

Ray-based Apache Beam runner

Apache License 2.0

42 stars 12 forks source link

Closed pabloem closed 2 years ago

pabloem commented 2 years ago

This PR does the following:

Fixes flake8 checks for the whole repo (I think)
Adds pylint checks for the whole repo (these are currently failing)
Separates the Build workflow into:
- Code health: Formatting, lint, flake8
- Benchmakrs: Run benchmarks and store results
- Build for Python 3.8, 3.9, 3.10: Run unit tests

This way we can separate some concerns.

pabloem commented 2 years ago

r: @pdames @iasoon could you take a look?

jjyao commented 2 years ago

Seems CI/Benchmarks is failing.

pabloem commented 2 years ago

yeah - I believe the benchmark workflow is broken in general (see this failure for another PR: https://github.com/ray-project/ray_beam_runner/actions/runs/3239121252/jobs/5308126444) - that's part of why I separated the workflows like this

I've filed https://github.com/ray-project/ray_beam_runner/issues/46 to track resolution of the broken benchmark suite