search

securefederatedai / openfl

An Open Framework for Federated Learning.
https://openfl.readthedocs.io/en/latest/index.html
Apache License 2.0
734 stars 207 forks source link

Pytest framework implementation with Task Runner GitHub Workflow #1133

Closed noopurintel closed 2 weeks ago

noopurintel commented 3 weeks ago

This PR aims to add the pytest framework based test cases in OpenFL repository.

Changes done:

Added end_to_end folder inside openfl/tests. Please go through README.md file for complete structure and related details. Added task_runner_e2e.yml workflow file inside .github/workflows - it will run various models for Task Runner API approach. For now, the workflow is expected to run every night with below matrix combination:

  1. model names - [torch_cnn_mnist, keras_cnn_mnist] # Other models have bugs associated with them
  2. python version - [3.8, 3.9, 3.10]

Successful test run (11th Nov 07:20 pm IST) - https://github.com/securefederatedai/openfl/actions/runs/11779770937

Final (12th Nov 04:35 pm IST) - https://github.com/securefederatedai/openfl/actions/runs/11795815852

noopurintel commented 2 weeks ago

@MasterSkepticista - this name openfl_e2e was decided during one of the discussions. But, the name end_to_end would be easier to comprehend as you have suggested, let me check and get back on this.

noopurintel commented 2 weeks ago

@theakshaypant - Fyi, we are planning to add accuracy and other details after every test run in subsequent PRs.