open-mmlab / mmfashion

Open-source toolbox for visual fashion analysis based on PyTorch
https://open-mmlab.github.io/
Apache License 2.0
1.24k stars 281 forks source link

How to integrate CEPH with Amazon-S3? #126

Open sayonkumarsaha opened 3 years ago

sayonkumarsaha commented 3 years ago

I'm trying to adapt this project mmfashion on Amazon SageMaker that requires the CEPH module for backend. Unfortunately pip install ceph doesn't work. The only work-around was to build the ceph source-code manually by running in my container:

!git clone git://github.com/ceph/ceph 
!git submodule update --init --recursive

This does allow me to import ceph successfully. But it throws the following error when it comes to fecthing data from Amazon S3:

AttributeError: module 'ceph' has no attribute 'S3Client'

Has someone integrated CEPH with Amazon S3 Bucket or has suggestions in the same line on how to tackle this?