search

EMCECS / ecs-sync

ecs-sync is a bulk copy utility that can move data between various systems in parallel
Apache License 2.0
61 stars 22 forks source link

Using ECS Sync to migrate blobs from PostgreSQL to ECS #51

Closed arinsingh closed 3 years ago

arinsingh commented 5 years ago

I was looking at the ECS Sync wiki at https://github.com/EMCECS/ecs-sync/wiki

Under the section “Why use ecs-sync?”, the wiki states “With ecs-sync, you can pull blobs out of a database and move them into an S3 bucket”

However, if I look at the ECS sync storage plugins available at https://github.com/EMCECS/ecs-sync/wiki/Storage-Plugins , I can’t see a plugin for moving data from any structured data store to ECS

I was looking at guidance how we can achieve moving blobs from relational database to ECS ?

Thank you

twincitiesguy commented 3 years ago

This issue is quite old, and has had no activity, so I'm closing it. The wiki text in question was removed, since that feature is no longer supported. That said, I'll leave you with the following tidbit: Years ago, in pre- 3.x versions, there was a DB blob plugin, but that was dropped in 3.x because no one was using it, and it required updates to fit into the 3.0 storage plugin redesign. However, if you are still interested in this, you might take a look here:

https://github.com/EMCECS/ecs-sync/blob/2.x/src/main/java/com/emc/ecs/sync/source/SqlBlobSource.java

And see if it's worth updating that to become a read-only storage plugin, similar to AzureBlobStorage in 3.4.