CDLUC3 / mrt-doc

Documentation and Information regarding the Merritt repository
8 stars 4 forks source link

Wasabi - on going replication #289

Closed dloy closed 3 years ago

dloy commented 4 years ago

Wasabi on going replication

Collections will be added over the period of the next 2-3 month to be replicated to Wasabi.

Daily reports will be made to validate the status of these collections moving forward.

Reports include

Fixing failed replications

Because of the number and size of objects to be copied. There occasionally will be failures as a result of the Wasabi service being overloaded and responding with 503 status. This typically indicates load threshold problems.

Reports on "completed" collection

A collection will be considered complete when at some specific time all new primaries for that collection have been added. After this point all content will be viewed as ongoing maintained replication.

As a collections are completed, they will be noted in this issue.

dloy commented 4 years ago

Entered manual phase requiring manual submission to previously failed processing

uc3-mrtreplic01x2-prd and uc3-mrtreplic02-prd have been removed from inv db queue processing Until perl URI available on EC2 requires a 2 step process from local machine to uc3-mrtsandbox2-prd for submission

Currently setting up exec on both local and sandbox to simplify processing