LLNL / UnifyFS

UnifyFS: A file system for burst buffers
Other
106 stars 31 forks source link

Add stage/transfer API tests to CI framework #685

Closed CamStan closed 3 years ago

CamStan commented 3 years ago

Description

This PR incorporates, finishes, and adds to the work done in PRs #596 and #644 Thanks to Craig for doing the majority of this.

Creates lower-level tests (t/ci/800-stage-tests.sh) to do a proof of concept of the transfer API. Also creates a higher-level file (t/ci/RUN_CI_STAGE_TESTS.sh) that runs the lower-level tests over a sweep of file sizes and server configurations.

Added a parallel transfer test to t/ci/800-stage-tests.sh as well. It is currently being skipped until the parallel transfer logic is fixed. Issue #686

Fixes a bug in serial transfer logic causing the destination file to be created as read-only, resulting in a failed transfer.

Update transfer docs to account for the various methods.

Motivation and Context

Add tests for UnifyFS transfer API

How Has This Been Tested?

Running the new 800-stage-tests.sh and RUN_CI_STAGE_TESTS.sh on one to four nodes with multiple processes per node.

Types of changes

Checklist:

CamStan commented 3 years ago

Pushed one last time to fix a couple typos.