search

aws-solutions / data-transfer-hub

Seamless User Interface for replicating data into AWS.
https://aws-solutions.github.io/data-transfer-hub/en/
Apache License 2.0
136 stars 22 forks source link

Unable to run S3 transfer task successfully #98

Closed victorconan closed 2 years ago

victorconan commented 2 years ago

Hi, I used to use data transfer hub to transfer S3 data from us-east-2 to cn-northwest-1. But recently I was not able to run the task successfully. I cannot see any error message regarding why the task failed. Do you have any suggestion on how to diagnose it?

Thanks

YikaiHu commented 2 years ago

Hi @victorconan, what's the version of Data Transfer Hub and your failed DTH S3 plugin?

You can check the earliest error message in CloudFormation console Event page.

victorconan commented 2 years ago

Hi @victorconan, what's the version of Data Transfer Hub and your failed DTH S3 plugin?

You can check the earliest error message in CloudFormation console Event page. This is the version of DTH:

(SO8001) - Data Transfer Hub with aws-solutions-constructs: This template deploys an one-stop toolset for transferring data from different sources into AWS. Template version v2.0.4

Thanks!

YikaiHu commented 2 years ago

@victorconan , v2.0.4 uses the python 3.6 so it can not be deployed anymore.

And I noticed that you are having problems during upgrading: https://github.com/awslabs/data-transfer-hub/issues/89.

There are two workaround:

  1. Delete the old Data Transfer Hub and deploy the latest version.

  2. Manually update the python version of your current Data Transfer Hub(v2.0.4), then upgrade to the latest version of Data Transfer Hub

    • Go to the AWS CloudFormation Console
    • Click your Data Transfer Hub main stack
    • Click Template tab
    • Click View in Designer button
    • Search for python3.6 in the template box at the bottom of the screen, and replace it with python3.9
    • image
    • Click "Create Stack" icon in the upper left of the screen
    • image
    • Click Next, Next, Create
    • Then follow the guide to upgrade to the latest version.
victorconan commented 2 years ago

@victorconan , v2.0.4 uses the python 3.6 so it can not be deployed anymore.

And I noticed that you are having problems during upgrading: #89.

There are two workaround:

  1. Delete the old Data Transfer Hub and deploy the latest version.

  2. Manually update the python version of your current Data Transfer Hub(v2.0.4), then upgrade to the latest version of Data Transfer Hub

    • Go to the AWS CloudFormation Console
    • Click your Data Transfer Hub main stack
    • Click Template tab
    • Click View in Designer button
    • Search for python3.6 in the template box at the bottom of the screen, and replace it with python3.9
    • image
    • Click "Create Stack" icon in the upper left of the screen
    • image
    • Click Next, Next, Create
    • Then follow the guide to upgrade to the latest version.

Thanks! It works now!