deepmodeling / deepmd-kit

A deep learning package for many-body potential energy representation and molecular dynamics
https://docs.deepmodeling.com/projects/deepmd/
GNU Lesser General Public License v3.0
1.41k stars 487 forks source link

ci: fix test-python test_durations and its caches #3820

Closed njzjz closed 1 month ago

njzjz commented 1 month ago

The previous workflow file has several bugs.

Summary by CodeRabbit

coderabbitai[bot] commented 1 month ago
Walkthrough ## Walkthrough The `.github/workflows/test_python.yml` file has been updated to refine the handling of test durations in the CI workflow. This includes modifications to caching paths and keys, adjustments to the pytest command, and changes to the method of aggregating test duration data. These updates aim to improve the efficiency and accuracy of test duration management in the CI pipeline. ## Changes | File Path | Change Summary | |------------------------------------------|-----------------------------------------------------------------| | .github/workflows/test_python.yml | Updated paths and keys for caching test durations, adjusted the pytest command, and modified the approach to handling and aggregating test duration data. |

[!TIP]

New Features and Improvements ## Review Settings Introduced new personality profiles for code reviews. Users can now select between "Chill" and "Assertive" review tones to tailor feedback styles according to their preferences. The "Assertive" profile posts more comments and nitpicks the code more aggressively, while the "Chill" profile is more relaxed and posts fewer comments. ## AST-based Instructions CodeRabbit offers customizing reviews based on the Abstract Syntax Tree (AST) pattern matching. Read more about AST-based instructions in the [documentation](https://docs.coderabbit.ai/guides/review-instructions#ast-based). ## Community-driven AST-based Rules We are kicking off a community-driven initiative to create and share AST-based rules. Users can now contribute their AST-based rules to detect security vulnerabilities, code smells, and anti-patterns. Please see the [ast-grep-essentials](https://github.com/coderabbitai/ast-grep-essentials) repository for more information. ## New Static Analysis Tools We are continually expanding our support for static analysis tools. We have added support for `biome`, `hadolint`, and `ast-grep`. Update the settings in your `.coderabbit.yaml` file or head over to the settings page to enable or disable the tools you want to use. ## Tone Settings Users can now customize CodeRabbit to review code in the style of their favorite characters or personalities. Here are some of our favorite examples: - Mr. T: "You must talk like Mr. T in all your code reviews. I pity the fool who doesn't!" - Pirate: "Arr, matey! Ye must talk like a pirate in all yer code reviews. Yarrr!" - Snarky: "You must be snarky in all your code reviews. Snark, snark, snark!" ## Revamped Settings Page We have redesigned the settings page for a more intuitive layout, enabling users to find and adjust settings quickly. This change was long overdue; it not only improves the user experience but also allows our development team to add more settings in the future with ease. Going forward, the changes to `.coderabbit.yaml` will be reflected in the settings page, and vice versa. ## Miscellaneous - Turn off free summarization: You can switch off free summarization of PRs opened by users not on a paid plan using the `enable_free_tier` setting. - Knowledge-base scope: You can now set the scope of the knowledge base to either the repository (`local`) or the organization (`global`) level using the `knowledge_base` setting. In addition, you can specify Jira project keys and Linear team keys to limit the knowledge base scope for those integrations. - High-level summary placement: You can now customize the location of the high-level summary in the PR description using the `high_level_summary_placeholder` setting (default `@coderabbitai summary`). - Revamped request changes workflow: You can now configure CodeRabbit to auto-approve or request changes on PRs based on the review feedback using the `request_changes_workflow` setting.

Recent Review Details **Configuration used: CodeRabbit UI** **Review profile: CHILL**
Commits Files that changed from the base of the PR and between 8cd3cba4565d20980a766c3809b1ce8f25856074 and cfb5d986b1014936982c734987e6dce783bdc578.
Files selected for processing (1) * .github/workflows/test_python.yml (2 hunks)
Additional comments not posted (5)
.github/workflows/test_python.yml (5)
`45-45`: Ensure the new cache path `.test_durations` is correctly referenced throughout the workflow. --- `89-89`: The simplification of the command to combine test duration files using `jq -s add` is a good improvement. Ensure it functions as expected by testing the command with sample data.
Verification successful --- The `jq -s add` command for combining test duration files functions as expected. The test with sample data produced the correct combined JSON output. -
Scripts Executed The following scripts were executed for the analysis: --- Script: ```shell #!/bin/bash # Description: Test the new jq command for combining test duration files. # Test: Run the jq command with sample duration files to ensure it combines them correctly. echo '{"test1": 120}' > duration1.json echo '{"test2": 180}' > duration2.json jq -s add duration*.json ``` Length of output: 124
--- `49-53`: Verify that the new cache keys and restore-keys are correctly formatted and unique.
Verification successful --- The search results confirm the presence of the cache key pattern in the workflow file. The key appears to be correctly formatted and includes unique identifiers such as `github.run_id`, `github.run_number`, `matrix.python`, and `matrix.group`, which should ensure uniqueness. - `key: test2-durations-split-${{ github.run_id }}-${{ github.run_number}}-${{ matrix.python }}-${{ matrix.group }}` This format should provide a unique key for each run, considering the combination of run ID, run number, Python version, and group.
Scripts Executed The following scripts were executed for the analysis: --- Script: ```shell #!/bin/bash # Description: Verify the uniqueness and correct format of cache keys. # Test: Search for the cache key pattern in the workflow file. Expect: Unique and correctly formatted keys. rg --type yaml $'test2-durations-split-' ``` Length of output: 39 --- --- Script: ```shell #!/bin/bash # Description: Verify the uniqueness and correct format of cache keys. # Test: Search for the cache key pattern in the workflow file. Expect: Unique and correctly formatted keys. rg 'test2-durations-split-' .github/workflows/test_python.yml ``` Length of output: 182
--- `56-56`: The line moving `.test_durations` to a group-specific file has been removed. Confirm that this change aligns with the intended caching and test duration handling strategy.
Verification successful --- The search results indicate that `.test_durations` is not referenced elsewhere in the codebase, and the caching strategy in the workflow files primarily involves caching dependencies like `pip`. The removal of the line moving `.test_durations` to a group-specific file does not seem to impact the current caching strategy. - The `.test_durations` file is not used elsewhere in the codebase. - The caching strategy in the workflow files focuses on caching dependencies, not test durations.
Scripts Executed The following scripts were executed for the analysis: --- Script: ```shell #!/bin/bash # Description: Verify the removal of the line moving `.test_durations` to a group-specific file aligns with the caching strategy. # Test: Check if `.test_durations` is used elsewhere without group-specific handling. rg --type yaml $'.test_durations' ``` Length of output: 32 --- --- Script: ```shell #!/bin/bash # Description: Verify the removal of the line moving `.test_durations` to a group-specific file aligns with the caching strategy. # Test 1: Check if `.test_durations` is used elsewhere in the codebase. rg '.test_durations' # Test 2: Review the caching strategy in the workflow files. rg 'cache' .github/workflows/ ``` Length of output: 672
--- `81-82`: Ensure that the combined cache keys are correctly implemented and check if they align with the new caching strategy.
--- Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?
Share - [X](https://twitter.com/intent/tweet?text=I%20just%20used%20%40coderabbitai%20for%20my%20code%20review%2C%20and%20it%27s%20fantastic%21%20It%27s%20free%20for%20OSS%20and%20offers%20a%20free%20trial%20for%20the%20proprietary%20code.%20Check%20it%20out%3A&url=https%3A//coderabbit.ai) - [Mastodon](https://mastodon.social/share?text=I%20just%20used%20%40coderabbitai%20for%20my%20code%20review%2C%20and%20it%27s%20fantastic%21%20It%27s%20free%20for%20OSS%20and%20offers%20a%20free%20trial%20for%20the%20proprietary%20code.%20Check%20it%20out%3A%20https%3A%2F%2Fcoderabbit.ai) - [Reddit](https://www.reddit.com/submit?title=Great%20tool%20for%20code%20review%20-%20CodeRabbit&text=I%20just%20used%20CodeRabbit%20for%20my%20code%20review%2C%20and%20it%27s%20fantastic%21%20It%27s%20free%20for%20OSS%20and%20offers%20a%20free%20trial%20for%20proprietary%20code.%20Check%20it%20out%3A%20https%3A//coderabbit.ai) - [LinkedIn](https://www.linkedin.com/sharing/share-offsite/?url=https%3A%2F%2Fcoderabbit.ai&mini=true&title=Great%20tool%20for%20code%20review%20-%20CodeRabbit&summary=I%20just%20used%20CodeRabbit%20for%20my%20code%20review%2C%20and%20it%27s%20fantastic%21%20It%27s%20free%20for%20OSS%20and%20offers%20a%20free%20trial%20for%20proprietary%20code)
Tips ### Chat There are 3 ways to chat with [CodeRabbit](https://coderabbit.ai): - Review comments: Directly reply to a review comment made by CodeRabbit. Example: - `I pushed a fix in commit .` - `Generate unit testing code for this file.` - `Open a follow-up GitHub issue for this discussion.` - Files and specific lines of code (under the "Files changed" tab): Tag `@coderabbitai` in a new review comment at the desired location with your query. Examples: - `@coderabbitai generate unit testing code for this file.` - `@coderabbitai modularize this function.` - PR comments: Tag `@coderabbitai` in a new PR comment to ask questions about the PR branch. For the best results, please provide a very specific query, as very limited context is provided in this mode. Examples: - `@coderabbitai generate interesting stats about this repository and render them as a table.` - `@coderabbitai show all the console.log statements in this repository.` - `@coderabbitai read src/utils.ts and generate unit testing code.` - `@coderabbitai read the files in the src/scheduler package and generate a class diagram using mermaid and a README in the markdown format.` Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments. ### CodeRabbit Commands (invoked as PR comments) - `@coderabbitai pause` to pause the reviews on a PR. - `@coderabbitai resume` to resume the paused reviews. - `@coderabbitai review` to trigger a review. This is useful when automatic reviews are disabled for the repository. - `@coderabbitai resolve` resolve all the CodeRabbit review comments. - `@coderabbitai help` to get help. Additionally, you can add `@coderabbitai ignore` anywhere in the PR description to prevent this PR from being reviewed. ### CodeRabbit Configration File (`.coderabbit.yaml`) - You can programmatically configure CodeRabbit by adding a `.coderabbit.yaml` file to the root of your repository. - Please see the [configuration documentation](https://docs.coderabbit.ai/guides/configure-coderabbit) for more information. - If your editor has YAML language server enabled, you can add the path at the top of this file to enable auto-completion and validation: `# yaml-language-server: $schema=https://coderabbit.ai/integrations/schema.v2.json` ### Documentation and Community - Visit our [Documentation](https://coderabbit.ai/docs) for detailed information on how to use CodeRabbit. - Join our [Discord Community](https://discord.com/invite/GsXnASn26c) to get help, request features, and share feedback. - Follow us on [X/Twitter](https://twitter.com/coderabbitai) for updates and announcements.
codecov[bot] commented 1 month ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 82.48%. Comparing base (8cd3cba) to head (cfb5d98).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## devel #3820 +/- ## ======================================= Coverage 82.48% 82.48% ======================================= Files 516 516 Lines 49057 49057 Branches 2985 2986 +1 ======================================= Hits 40466 40466 Misses 7680 7680 Partials 911 911 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

wanghan-iapcm commented 1 month ago

LGTM, sry i missed it for a few days.