[CI] Update workflow script, ensure functional test determinism, fix coverage tests. - Githubissues

FlagOpen / FlagScale

FlagScale is a large model toolkit based on open-sourced projects.

Other

132 stars 40 forks source link

[CI] Update workflow script, ensure functional test determinism, fix coverage tests. #207

Closed phoenixdong closed 1 week ago

phoenixdong commented 2 weeks ago

Workflow Update

Updates

Modify test file names and optimize test scripts for a more concise and user-friendly implementation.
Fix randomness in functional testing to ensure consistent test results.

Unit Test Instructions

The previous usage has been improved: https://github.com/FlagOpen/FlagScale/pull/199#issue-2493813612.

If you add a new test folder and want it to run in the workflow, rather than just locally, modify the .github/workflows/test.yml file:

megatron-unit-tests:
  uses: ./.github/workflows/unit-tests.yml
  strategy:
    matrix:
      subset: 
        - data
        - ...
        # - add your own test folder here

Fixed Issues

Removed broken submodule.
Online coverage testing cannot recognize code modifications.

File Removal

Deleted redundant file: results_test in tests/functional_tests/test_cases/train.