Not sure what the specific trigger was, but a large number of empty files remain in a user allocation but there are no corresponding records. This may have happened when records were created and data uploaded from a test script, where the upload failed due to an endpoint error. Globus may have created the empty destination files despite the transfer failing. If this was the cause, need to change the delete logic to remove files even if the record indicates no raw data.
dvstans
commented
3 years ago
Not sure what the specific trigger was, but a large number of empty files remain in a user allocation but there are no corresponding records. This may have happened when records were created and data uploaded from a test script, where the upload failed due to an endpoint error. Globus may have created the empty destination files despite the transfer failing. If this was the cause, need to change the delete logic to remove files even if the record indicates no raw data.