search

kpfaulkner / azurecopy

copy blobs between azure, s3 and local storage
Apache License 2.0
36 stars 13 forks source link

-blobcopy : Exception System.ArgumentException: Empty String #20

Closed pb1911 closed 7 years ago

pb1911 commented 7 years ago

I can list files on both sides (S3 and Azure) however using -blobcopy or standard copy are both failing. Here is the command and stack trace for the cmd using -blobcopy

C:\azurecopy>azurecopy -i https://s3-us-west-2.amazonaws.com/xamarin-sevan -o https://7capprodblob.blob.core.windows.net/7capturedata -copyblod -db GetHandler start GetHandler retrieved azurecopy.S3Handler GetHandler start GetHandler retrieved azurecopy.AzureHandler Unknown error generated. Please report to Github page https://github.com/kpfaulkner/azurecopy/issues . Can view underlying stacktrace by adding -db flag. System.ArgumentException: Key is a required property and must be set before making this call. Parameter name: GetObjectRequest.Key at Amazon.S3.Model.Internal.MarshallTransformations.GetObjectRequestMarshaller.Marshall(GetObjectRequest getObjectRequest) at Amazon.Runtime.Internal.Marshaller.PreInvoke(IExecutionContext executionContext) at Amazon.Runtime.Internal.Marshaller.InvokeSync(IExecutionContext executionContext) at Amazon.Runtime.Internal.CallbackHandler.InvokeSync(IExecutionContext executionContext) at Amazon.S3.Internal.AmazonS3ExceptionHandler.InvokeSync(IExecutionContext executionContext) at Amazon.Runtime.Internal.ErrorCallbackHandler.InvokeSync(IExecutionContext executionContext) at Amazon.Runtime.Internal.MetricsHandler.InvokeSync(IExecutionContext executionContext) at Amazon.Runtime.Internal.RuntimePipeline.InvokeSync(IExecutionContext executionContext) at Amazon.Runtime.AmazonServiceClient.Invoke[TRequest,TResponse](TRequest request, IMarshaller2 marshaller, ResponseUnmarshaller unmarshaller) at Amazon.S3.AmazonS3Client.GetObject(GetObjectRequest request) at azurecopy.S3Handler.ReadBlob(String containerName, String blobName, String cacheFilePath) at azurecopycommand.Program.DoNormalCopy(Boolean debugMode) at azurecopycommand.Program.Main(String[] args) at Amazon.S3.Model.Internal.MarshallTransformations.GetObjectRequestMarshaller.Marshall(GetObjectRequest getObjectRequest) at Amazon.Runtime.Internal.Marshaller.PreInvoke(IExecutionContext executionContext) at Amazon.Runtime.Internal.Marshaller.InvokeSync(IExecutionContext executionContext) at Amazon.Runtime.Internal.CallbackHandler.InvokeSync(IExecutionContext executionContext) at Amazon.S3.Internal.AmazonS3ExceptionHandler.InvokeSync(IExecutionContext executionContext) at Amazon.Runtime.Internal.ErrorCallbackHandler.InvokeSync(IExecutionContext executionContext) at Amazon.Runtime.Internal.MetricsHandler.InvokeSync(IExecutionContext executionContext) at Amazon.Runtime.Internal.RuntimePipeline.InvokeSync(IExecutionContext executionContext) at Amazon.Runtime.AmazonServiceClient.Invoke[TRequest,TResponse](TRequest request, IMarshaller2 marshaller, ResponseUnmarshaller unmarshaller) at Amazon.S3.AmazonS3Client.GetObject(GetObjectRequest request) at azurecopy.S3Handler.ReadBlob(String containerName, String blobName, String cacheFilePath) at azurecopycommand.Program.DoNormalCopy(Boolean debugMode) at azurecopycommand.Program.Main(String[] args)

kpfaulkner commented 7 years ago

Hi

I notice in the command you have -copyblod instead of -blobcopy. Is this just a copy/paste issue with the git entry or was it also that when executing the command?

Also, can you confirm which parameters you setup in the azurecopy.exe.config file? Particularly I'm interested in the AWS flags, such as:

AWSAccessKeyID AWSSecretAccessKeyID AWSRegion SrcAWSAccessKeyID SrcAWSSecretAccessKeyID SrcAWSRegion TargetAWSAccessKeyID TargetAWSSecretAccessKeyID TargetAWSRegion

Which of those did you setup?

Thanks

Ken

pb1911 commented 7 years ago

Sorry Ken you are correct that the command and pasted output were incorrect. As such that entry does not reflect the error I was originally having.

C:\azurecopy>azurecopy -i https://s3-us-west-2.amazonaws.com/xamarin-sevan -o https://7capprodblob.blob.core.windows.net/7capturedata -blobcopy -db GetHandler start GetHandler retrieved azurecopy.S3Handler GetHandler start GetHandler retrieved azurecopy.AzureHandler Copy blob Unable to start copying Exception System.ArgumentException: The argument must not be empty string. Parameter name: blobName at Microsoft.WindowsAzure.Storage.Core.Util.CommonUtility.AssertNotNullOrEmpty(String paramName, String value) at Microsoft.WindowsAzure.Storage.Blob.CloudBlobContainer.GetBlockBlobReference(String blobName, Nullable1 snapshotTime) at azurecopy.AzureBlobCopyHandler.StartCopy(BasicBlobContainer origBlob, String DestinationUrl, DestinationBlobType destBlobType) at azurecopy.AzureBlobCopyHandler.StartCopyList(IEnumerable1 origBlobList, String destinationUrl, DestinationBlobType destBlobType, Boolean debugMode) New Batch

Failed: Aborted: Pending: Copy complete Operation took 594 ms

Config parameters listed below:

<?xml version="1.0" encoding="utf-8"?>

Hi I notice in the command you have -copyblod instead of -blobcopy. Is this just a copy/paste issue with the git entry or was it also that when executing the command? Also, can you confirm which parameters you setup in the azurecopy.exe.config file? Particularly I'm interested in the AWS flags, such as: AWSAccessKeyID AWSSecretAccessKeyID AWSRegion SrcAWSAccessKeyID SrcAWSSecretAccessKeyID SrcAWSRegion TargetAWSAccessKeyID TargetAWSSecretAccessKeyID TargetAWSRegion Which of those did you setup? Thanks Ken
pb1911 commented 7 years ago

Updated Title to reflect the correct Stack Trace error and the above post to remove unnecessary info.

kpfaulkner commented 7 years ago

Can you try the command:

azurecopy -i https://xamarin-sevan.s3-us-west-2.amazonaws.com/ -o https://7capprodblob.blob.core.windows.net/7capturedata/ -blobcopy -db

and let me know how it goes?

Although the bucket name can either be part of the host or the path I just want to eliminate some possibilities here. Please remember to include the trailing / for both URLs

Ken

pb1911 commented 7 years ago

Trailing slashes did it. Thank you ken. Did not see that in the documentation.

kpfaulkner commented 7 years ago

I'll make sure that's added somewhere :)

On Fri, Mar 3, 2017 at 8:18 AM, pb1911 notifications@github.com wrote:

Trailing slashes did it. Thank you ken. Did not see that in the documentation.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/kpfaulkner/azurecopy/issues/20#issuecomment-283784972, or mute the thread https://github.com/notifications/unsubscribe-auth/AAHGUvQtmruWh6BGAfAINO3Uf86DD4i7ks5rhzIegaJpZM4MRNUz .