GitHub actions need to be configured for testing code and automatic benchmarking

fmperf-project / fmperf

Cloud Native Benchmarking of Foundation Models

Apache License 2.0

21 stars 10 forks source link

Open wangchen615 opened 5 months ago

wangchen615 commented 5 months ago

We need GitHub actions configured to test the code.

In the future, we must set up pipelines to trigger automatic benchmarking for new models and accelerator support.

tdoublep commented 5 months ago

@wangchen615 I added a basic github action that is now pushing the image to quay every time we push to main:

Work is still needed for testing etc - we need some tests to start with :)

wangchen615 commented 5 months ago

Fantastic, thanks, @tdoublep.

wangchen615 commented 5 months ago

More todos:

Actions to trigger all format check and unit tests for all PRs
E2E tests, which might need a GPU cluster, need to be integrated and triggered for all PRs.