This addresses #1 by reversing the old strategy of specifying exactly the files in the unload manifest and instead going back to transferring everything in the prefix, but excluding the manifest.
To make it less likely that the prefix contains other files it is no longer just a directory, The transfer is also validated after the transfer completes. If any files are missing, if there are too many files, or if any files have a different size than the ones in the manifest the transfer fails with an error that explains exactly what the problem is.
This addresses #1 by reversing the old strategy of specifying exactly the files in the unload manifest and instead going back to transferring everything in the prefix, but excluding the manifest.
To make it less likely that the prefix contains other files it is no longer just a directory, The transfer is also validated after the transfer completes. If any files are missing, if there are too many files, or if any files have a different size than the ones in the manifest the transfer fails with an error that explains exactly what the problem is.