During the upload stages of the TBP data ingestion workflow we don't want to work with partially transferred data but we don't want to leave large delays to ensure all data has been transferred. Therefore we will use the presence of the manifest file to signify that the dataset has been fully transferred (and that all the files are present, might want to calculate hashes, not sure).
Need to ensure that commands all wait until manifest file is present.
Acceptance Criteria
[ ] 1. transfers only complete after the manifest file has been created by the stage command
[ ] 2. uploads only start after the manifest file has been transferred by the transfer command
Metadata
Epic: #271 Feature: #273
Description
During the upload stages of the TBP data ingestion workflow we don't want to work with partially transferred data but we don't want to leave large delays to ensure all data has been transferred. Therefore we will use the presence of the manifest file to signify that the dataset has been fully transferred (and that all the files are present, might want to calculate hashes, not sure).
Need to ensure that commands all wait until manifest file is present.
Acceptance Criteria
stagecommandtransfercommand