Open hkhawar opened 4 years ago
@hkhawar - @sMyn42 and I noticed that these file paths are pointing to the project folders in the S3 bucket, and not the efs storage. You should consider moving compute to efs (it'll be the same path, except replace s3://imaging/platform/projects
with /home/ubuntu/efs/
. EFS is faster than S3
Are you interacting with the files in an EC2 instance?
DATA COLLECTION
Initially for this project DMSO single data is collected and five replicate plates of 2015_10_05_DrugRepurposing_AravindSubramanian_GolubLab_Broad
s3://imaging-platform/projects/2015_10_05_DrugRepurposing_AravindSubramanian_GolubLab_Broad/
Location of DMSO single cell data on S3
s3://imaging-platform/projects/2015_10_05_DrugRepurposing_AravindSubramanian_GolubLab_Broad/workspace/backend/2016_04_01_a549_48hr_batch1/SQ00015201/SQ00015201_dmso.csv s3://imaging-platform/projects/2015_10_05_DrugRepurposing_AravindSubramanian_GolubLab_Broad/workspace/backend/2016_04_01_a549_48hr_batch1/SQ00015201/SQ00015142_dmso.csv s3://imaging-platform/projects/2015_10_05_DrugRepurposing_AravindSubramanian_GolubLab_Broad/workspace/backend/2016_04_01_a549_48hr_batch1/SQ00015201/SQ00015143_dmso.csv s3://imaging-platform/projects/2015_10_05_DrugRepurposing_AravindSubramanian_GolubLab_Broad/workspace/backend/2016_04_01_a549_48hr_batch1/SQ00015201/SQ00015144_dmso.csv s3://imaging-platform/projects/2015_10_05_DrugRepurposing_AravindSubramanian_GolubLab_Broad/workspace/backend/2016_04_01_a549_48hr_batch1/SQ00015201/SQ00015145_dmso.csv
Platemap s3://imaging-platform/projects/2015_10_05_DrugRepurposing_AravindSubramanian_GolubLab_Broad/workspace/metadata/2016_04_01_a549_48hr_batch1/platemap/C-7161-01-LM6-017.txt