search

broadinstitute / cellpainting-gallery

Cell Painting Gallery
https://broadinstitute.github.io/cellpainting-gallery/
MIT License
51 stars 8 forks source link

2018_06_05_cmQTL (cpg0022) #26

Closed ErinWeisbart closed 10 months ago

ErinWeisbart commented 1 year ago

Data can be public in RODA Immediately profile repo: https://github.com/broadinstitute/cmQTL cpg0022-cmqtl

Transfer to CellPainting Gallery:

If data is being published, prepare for publication:

Once published:

ErinWeisbart commented 1 year ago

I think I have cmQTL completely transferred to cpg. I am unable to run data-validation. I'm assuming that it is not worth the time for me to dig too deeply into it given that the validation script is currently written to look for JUMP-specific naming/structure? I have looked carefully at what has transferred and confirmed that everything that was in the imaging-platform bucket has moved to the cellpainting-gallery bucket and I moved all the profiles I found in https://github.com/broadinstitute/cmQTL to the gallery as well.

The one thing that I will flag is that batch PILOT_1 does have images, analysis files, and backends but I was unable to find profiles for them. In the cmQTL repo, the folder for pilot data the plates listed are those from 2019_05_13_Batch2 NOT PILOT_1.

@shntnu Thoughts?

shntnu commented 1 year ago

I agree – no need to run data validation at this stage because the code is looking for JUMP-specific columns in the metadata (should be a simple fix to generalize at this point but let's punt on that).

Regarding PILOT_1, the profiles are in backend

 aws s3 ls s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/PILOT_1/BR00098071/
2022-11-18 15:10:03   18679262 BR00098071.csv
2022-11-18 15:10:04 19352133632 BR00098071.sqlite
2022-11-18 15:14:10   18682116 BR00098071_augmented.csv
2022-11-18 15:14:11   18790045 BR00098071_augmented.gct
2022-11-18 15:14:13   19194075 BR00098071_normalized.csv
2022-11-18 15:14:14   19302004 BR00098071_normalized.gct
2022-11-18 15:14:16    3340077 BR00098071_normalized_variable_selected.csv
2022-11-18 15:14:16    3359822 BR00098071_normalized_variable_selected.gct```

Turns out this is also the case for possibly all other batches:

aws s3 ls s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103267/
2022-11-18 14:41:54   31142861 BR00103267.csv
2022-11-18 14:41:54 13099298816 BR00103267.sqlite
2022-11-18 14:42:40   31157110 BR00103267_augmented.csv
2022-11-18 14:42:41   27883812 BR00103267_colony.csv
2022-11-18 14:42:41   27896716 BR00103267_colony_augmented.csv
2022-11-18 14:42:41   28601118 BR00103267_colony_normalized.csv
2022-11-18 14:42:41    4024618 BR00103267_colony_normalized_variable_selected.csv
2022-11-18 14:42:42   31036454 BR00103267_isolated.csv
2022-11-18 14:42:42   31050703 BR00103267_isolated_augmented.csv
2022-11-18 14:42:42   31923521 BR00103267_isolated_normalized.csv
2022-11-18 14:42:42    4464820 BR00103267_isolated_normalized_variable_selected.csv
2022-11-18 14:42:42   31989142 BR00103267_normalized.csv
2022-11-18 14:42:43    4480421 BR00103267_normalized_variable_selected.csv
aws s3 ls s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_05_13_Batch2/BR00103267
2022-11-30 17:45:29    4024618 BR00103267_colony_normalized_variable_selected.csv
2022-11-30 17:45:29    4464820 BR00103267_isolated_normalized_variable_selected.csv
2022-11-30 17:45:29    4480421 BR00103267_normalized_variable_selected.csv
2022-11-30 17:45:29  588702622 BR00103267_single_cell_colony_profiles.tsv.gz
2022-11-30 17:45:29  157327762 BR00103267_single_cell_isolated_profiles.tsv.gz

This structure anomaly is because we were in transition between the old and new structures.

Here's what I'd recommend doing

Here's what I did (below). If all this looks good, you can delete profiles/ and backend/ and rename profiles_tmp to profiles and backend_tmp to backend

```sh aws s3 ls --recursive s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend|grep sqlite|cut -d"/" -f5,6|sort|tr "/" "," > batch_plate.csv cat batch_plate.csv # 2019_05_13_Batch2,BR00103267 # 2019_05_13_Batch2,BR00103268 # 2019_06_10_Batch3,cmqtlpl1.5-31-2019-mt # 2019_06_10_Batch3,cmqtlpl261-2019-mt # 2019_08_15_Batch4,BR00106708 # 2019_08_15_Batch4,BR00106709 # 2019_09_06_Batch5,BR00107338 # 2019_09_06_Batch5,BR00107339 # 2020_03_05_Batch6,cmQTLplate7-2-27-20 # 2020_07_22_Batch7,cmQTLplate7-7-22-20 # 2022_09_07_Batch8,cmQTL_CRISPRi_plate1 # 2022_09_22_Batch8Rerun,MT_rerun_20220919 # PILOT_1,BR00098071 # copy out backend sqlite from backend/ to backend_tmp cat batch_plate.csv | \ parallel -C, \ aws s3 sync \ --exclude "\"*\"" \ --include "\"{2}.sqlite\"" \ s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/{1}/{2}/ \ s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/{1}/{2}/ # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103268/BR00103268.sqlite to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2019_05_13_Batch2/BR00103268/BR00103268.sqlite # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2020_03_05_Batch6/cmQTLplate7-2-27-20/cmQTLplate7-2-27-20.sqlite to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2020_03_05_Batch6/cmQTLplate7-2-27-20/cmQTLplate7-2-27-20.sqlite # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103267/BR00103267.sqlite to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2019_05_13_Batch2/BR00103267/BR00103267.sqlite # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt.sqlite to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt.sqlite # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107338/BR00107338.sqlite to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2019_09_06_Batch5/BR00107338/BR00107338.sqlite # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/PILOT_1/BR00098071/BR00098071.sqlite to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/PILOT_1/BR00098071/BR00098071.sqlite # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106709/BR00106709.sqlite to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2019_08_15_Batch4/BR00106709/BR00106709.sqlite # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2022_09_07_Batch8/cmQTL_CRISPRi_plate1/cmQTL_CRISPRi_plate1.sqlite to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2022_09_07_Batch8/cmQTL_CRISPRi_plate1/cmQTL_CRISPRi_plate1.sqlite # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2022_09_22_Batch8Rerun/MT_rerun_20220919/MT_rerun_20220919.sqlite to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2022_09_22_Batch8Rerun/MT_rerun_20220919/MT_rerun_20220919.sqlite # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339.sqlite to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2019_09_06_Batch5/BR00107339/BR00107339.sqlite # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt.sqlite to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt.sqlite # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106708/BR00106708.sqlite to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2019_08_15_Batch4/BR00106708/BR00106708.sqlite # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2020_07_22_Batch7/cmQTLplate7-7-22-20/cmQTLplate7-7-22-20.sqlite to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2020_07_22_Batch7/cmQTLplate7-7-22-20/cmQTLplate7-7-22-20.sqlite # copy out backend csv from backend/ to backend_tmp cat batch_plate.csv | \ parallel -C, \ aws s3 sync \ --exclude "\"*\"" \ --include "\"{2}.csv\"" \ s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/{1}/{2}/ \ s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/{1}/{2}/ # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106708/BR00106708.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2019_08_15_Batch4/BR00106708/BR00106708.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2020_07_22_Batch7/cmQTLplate7-7-22-20/cmQTLplate7-7-22-20.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2020_07_22_Batch7/cmQTLplate7-7-22-20/cmQTLplate7-7-22-20.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/PILOT_1/BR00098071/BR00098071.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/PILOT_1/BR00098071/BR00098071.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103268/BR00103268.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2019_05_13_Batch2/BR00103268/BR00103268.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2022_09_22_Batch8Rerun/MT_rerun_20220919/MT_rerun_20220919.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2022_09_22_Batch8Rerun/MT_rerun_20220919/MT_rerun_20220919.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107338/BR00107338.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2019_09_06_Batch5/BR00107338/BR00107338.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2022_09_07_Batch8/cmQTL_CRISPRi_plate1/cmQTL_CRISPRi_plate1.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2022_09_07_Batch8/cmQTL_CRISPRi_plate1/cmQTL_CRISPRi_plate1.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103267/BR00103267.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2019_05_13_Batch2/BR00103267/BR00103267.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2020_03_05_Batch6/cmQTLplate7-2-27-20/cmQTLplate7-2-27-20.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2020_03_05_Batch6/cmQTLplate7-2-27-20/cmQTLplate7-2-27-20.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2019_09_06_Batch5/BR00107339/BR00107339.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106709/BR00106709.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend_tmp/2019_08_15_Batch4/BR00106709/BR00106709.csv # copy out profiles csv # copy out profiles csv from backend/ to profiles_tmp/ cat batch_plate.csv | \ parallel -C, \ aws s3 sync \ --exclude "\"*\"" \ --include "\"{2}_*\"" \ s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/{1}/{2}/ \ s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/{1}/{2}/ # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2020_03_05_Batch6/cmQTLplate7-2-27-20/cmQTLplate7-2-27-20_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2020_03_05_Batch6/cmQTLplate7-2-27-20/cmQTLplate7-2-27-20_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2020_03_05_Batch6/cmQTLplate7-2-27-20/cmQTLplate7-2-27-20_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2020_03_05_Batch6/cmQTLplate7-2-27-20/cmQTLplate7-2-27-20_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2020_03_05_Batch6/cmQTLplate7-2-27-20/cmQTLplate7-2-27-20_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2020_03_05_Batch6/cmQTLplate7-2-27-20/cmQTLplate7-2-27-20_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/PILOT_1/BR00098071/BR00098071_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/PILOT_1/BR00098071/BR00098071_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/PILOT_1/BR00098071/BR00098071_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/PILOT_1/BR00098071/BR00098071_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/PILOT_1/BR00098071/BR00098071_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/PILOT_1/BR00098071/BR00098071_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/PILOT_1/BR00098071/BR00098071_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/PILOT_1/BR00098071/BR00098071_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/PILOT_1/BR00098071/BR00098071_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/PILOT_1/BR00098071/BR00098071_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/PILOT_1/BR00098071/BR00098071_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/PILOT_1/BR00098071/BR00098071_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2020_07_22_Batch7/cmQTLplate7-7-22-20/cmQTLplate7-7-22-20_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2020_07_22_Batch7/cmQTLplate7-7-22-20/cmQTLplate7-7-22-20_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2020_07_22_Batch7/cmQTLplate7-7-22-20/cmQTLplate7-7-22-20_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2020_07_22_Batch7/cmQTLplate7-7-22-20/cmQTLplate7-7-22-20_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2020_07_22_Batch7/cmQTLplate7-7-22-20/cmQTLplate7-7-22-20_sampled.csv.gz to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2020_07_22_Batch7/cmQTLplate7-7-22-20/cmQTLplate7-7-22-20_sampled.csv.gz # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2020_07_22_Batch7/cmQTLplate7-7-22-20/cmQTLplate7-7-22-20_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2020_07_22_Batch7/cmQTLplate7-7-22-20/cmQTLplate7-7-22-20_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103267/BR00103267_isolated_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103267/BR00103267_isolated_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103267/BR00103267_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103267/BR00103267_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103267/BR00103267_colony_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103267/BR00103267_colony_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103267/BR00103267_colony_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103267/BR00103267_colony_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103267/BR00103267_colony.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103267/BR00103267_colony.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103267/BR00103267_isolated.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103267/BR00103267_isolated.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103267/BR00103267_isolated_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103267/BR00103267_isolated_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103267/BR00103267_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103267/BR00103267_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_colony_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_colony_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_isolated_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_isolated_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_isolated.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_isolated.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_colony_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_colony_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_colony.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_colony.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_colony_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_colony_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_isolated_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_isolated_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_isolated_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_isolated_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106709/BR00106709_colony_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_colony_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106709/BR00106709_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106709/BR00106709_isolated.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_isolated.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106709/BR00106709_isolated_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_isolated_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106709/BR00106709_colony_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_colony_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106709/BR00106709_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106709/BR00106709_colony.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_colony.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106709/BR00106709_colony_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_colony_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106709/BR00106709_isolated_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_isolated_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106709/BR00106709_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106709/BR00106709_isolated_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_isolated_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107338/BR00107338_isolated_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_isolated_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107338/BR00107338_colony_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_colony_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107338/BR00107338_isolated_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_isolated_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107338/BR00107338_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107338/BR00107338_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107338/BR00107338_colony.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_colony.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107338/BR00107338_colony_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_colony_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107338/BR00107338_isolated.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_isolated.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107338/BR00107338_colony_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_colony_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107338/BR00107338_isolated_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_isolated_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107338/BR00107338_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103268/BR00103268_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103268/BR00103268_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103268/BR00103268_isolated.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103268/BR00103268_isolated.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103268/BR00103268_isolated_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103268/BR00103268_isolated_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103268/BR00103268_colony.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103268/BR00103268_colony.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103268/BR00103268_colony_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103268/BR00103268_colony_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103268/BR00103268_colony_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103268/BR00103268_colony_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103268/BR00103268_isolated_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103268/BR00103268_isolated_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_05_13_Batch2/BR00103268/BR00103268_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103268/BR00103268_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106708/BR00106708_colony_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_colony_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106708/BR00106708_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106708/BR00106708_isolated.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_isolated.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106708/BR00106708_colony_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_colony_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106708/BR00106708_colony.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_colony.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106708/BR00106708_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106708/BR00106708_isolated_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_isolated_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106708/BR00106708_colony_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_colony_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106708/BR00106708_isolated_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_isolated_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106708/BR00106708_isolated_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_isolated_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_08_15_Batch4/BR00106708/BR00106708_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_colony_normalized_variable_selected_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_colony_normalized_variable_selected_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_colony_normalized_variable_selected_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_colony_normalized_variable_selected_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_colony_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_colony_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_isolated_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_isolated_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_isolated_normalized_variable_selected_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_isolated_normalized_variable_selected_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_isolated_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_isolated_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_isolated.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_isolated.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_normalized_variable_selected_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_normalized_variable_selected_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_normalized_variable_selected_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_normalized_variable_selected_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_colony_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_colony_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_isolated_normalized_variable_selected_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_isolated_normalized_variable_selected_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_colony_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_colony_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_colony.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_colony.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_isolated_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_isolated_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_colony_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_colony_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_colony_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_colony_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_count.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_count.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_colony_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_colony_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_colony.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_colony.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_colony_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_colony_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_colony_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_colony_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_colony_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_colony_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_isolated_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_isolated_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_isolated_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_isolated_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_normalized_variable_selected.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_normalized_variable_selected.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_isolated_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_isolated_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_isolated_augmented.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_isolated_augmented.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_isolated_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_isolated_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_isolated_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_isolated_normalized.gct # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_isolated.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_isolated.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/backend/2019_09_06_Batch5/BR00107339/BR00107339_normalized.gct to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107339/BR00107339_normalized.gct # copy out profiles csv from profiles/ to profiles_tmp/ cat batch_plate.csv | \ parallel -C, \ aws s3 sync \ --exclude "\"*\"" \ --include "\"{2}*\"" \ s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/{1}/ \ s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/{1}/{2}/ # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2022_09_07_Batch8/cmQTL_CRISPRi_plate1/cmQTL_CRISPRi_plate1.csv.gz to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2022_09_07_Batch8/cmQTL_CRISPRi_plate1/cmQTL_CRISPRi_plate1/cmQTL_CRISPRi_plate1.csv.gz # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2022_09_07_Batch8/cmQTL_CRISPRi_plate1/cmQTL_CRISPRi_plate1_normalized_feature_select_batch.csv.gz to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2022_09_07_Batch8/cmQTL_CRISPRi_plate1/cmQTL_CRISPRi_plate1/cmQTL_CRISPRi_plate1_normalized_feature_select_batch.csv.gz # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2022_09_07_Batch8/cmQTL_CRISPRi_plate1/cmQTL_CRISPRi_plate1_augmented.csv.gz to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2022_09_07_Batch8/cmQTL_CRISPRi_plate1/cmQTL_CRISPRi_plate1/cmQTL_CRISPRi_plate1_augmented.csv.gz # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2022_09_07_Batch8/cmQTL_CRISPRi_plate1/cmQTL_CRISPRi_plate1_normalized.csv.gz to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2022_09_07_Batch8/cmQTL_CRISPRi_plate1/cmQTL_CRISPRi_plate1/cmQTL_CRISPRi_plate1_normalized.csv.gz # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2022_09_22_Batch8Rerun/MT_rerun_20220919/MT_rerun_20220919.csv.gz to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2022_09_22_Batch8Rerun/MT_rerun_20220919/MT_rerun_20220919/MT_rerun_20220919.csv.gz # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2022_09_22_Batch8Rerun/MT_rerun_20220919/MT_rerun_20220919_normalized_feature_select_batch.csv.gz to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2022_09_22_Batch8Rerun/MT_rerun_20220919/MT_rerun_20220919/MT_rerun_20220919_normalized_feature_select_batch.csv.gz # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2022_09_22_Batch8Rerun/MT_rerun_20220919/MT_rerun_20220919_augmented.csv.gz to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2022_09_22_Batch8Rerun/MT_rerun_20220919/MT_rerun_20220919/MT_rerun_20220919_augmented.csv.gz # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2022_09_22_Batch8Rerun/MT_rerun_20220919/MT_rerun_20220919_normalized.csv.gz to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2022_09_22_Batch8Rerun/MT_rerun_20220919/MT_rerun_20220919/MT_rerun_20220919_normalized.csv.gz # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2020_07_22_Batch7/cmQTLplate7-7-22-20_count.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2020_07_22_Batch7/cmQTLplate7-7-22-20/cmQTLplate7-7-22-20_count.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2020_07_22_Batch7/cmQTLplate7-7-22-20_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2020_07_22_Batch7/cmQTLplate7-7-22-20/cmQTLplate7-7-22-20_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2020_07_22_Batch7/cmQTLplate7-7-22-20_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2020_07_22_Batch7/cmQTLplate7-7-22-20/cmQTLplate7-7-22-20_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2020_07_22_Batch7/cmQTLplate7-7-22-20_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2020_07_22_Batch7/cmQTLplate7-7-22-20/cmQTLplate7-7-22-20_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2020_03_05_Batch6/cmQTLplate7-2-27-20_count.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2020_03_05_Batch6/cmQTLplate7-2-27-20/cmQTLplate7-2-27-20_count.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2020_03_05_Batch6/cmQTLplate7-2-27-20_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2020_03_05_Batch6/cmQTLplate7-2-27-20/cmQTLplate7-2-27-20_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2020_03_05_Batch6/cmQTLplate7-2-27-20_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2020_03_05_Batch6/cmQTLplate7-2-27-20/cmQTLplate7-2-27-20_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2020_03_05_Batch6/cmQTLplate7-2-27-20_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2020_03_05_Batch6/cmQTLplate7-2-27-20/cmQTLplate7-2-27-20_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106709_count.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_count.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106709_isolated_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_isolated_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106709_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106709_colony_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_colony_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106709_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106709_colony_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_colony_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106709_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106709_colony_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_colony_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106709_isolated_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_isolated_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106709_isolated_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106709/BR00106709_isolated_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_09_06_Batch5/BR00107338_count.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_count.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_09_06_Batch5/BR00107338_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_09_06_Batch5/BR00107338_colony_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_colony_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_09_06_Batch5/BR00107338_isolated_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_isolated_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_09_06_Batch5/BR00107338_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_09_06_Batch5/BR00107338_isolated_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_isolated_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_09_06_Batch5/BR00107338_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_09_06_Batch5/BR00107338_colony_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_colony_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_09_06_Batch5/BR00107338_colony_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_colony_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_09_06_Batch5/BR00107338_isolated_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_09_06_Batch5/BR00107338/BR00107338_isolated_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_05_13_Batch2/BR00103268_colony_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103268/BR00103268_colony_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_05_13_Batch2/BR00103268_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103268/BR00103268_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_05_13_Batch2/BR00103268_isolated_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103268/BR00103268_isolated_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_05_13_Batch2/BR00103268_single_cell_isolated_profiles.tsv.gz to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103268/BR00103268_single_cell_isolated_profiles.tsv.gz # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_05_13_Batch2/BR00103268_single_cell_colony_profiles.tsv.gz to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103268/BR00103268_single_cell_colony_profiles.tsv.gz # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl261-2019-mt_count.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_count.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl261-2019-mt_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl261-2019-mt_isolated_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_isolated_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl261-2019-mt_colony_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_colony_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl261-2019-mt_colony_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_colony_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl261-2019-mt_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl261-2019-mt_isolated_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_isolated_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl261-2019-mt_isolated_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_isolated_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl261-2019-mt_colony_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_colony_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl261-2019-mt_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl261-2019-mt/cmqtlpl261-2019-mt_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106708_count.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_count.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106708_isolated_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_isolated_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106708_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106708_colony_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_colony_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106708_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106708_isolated_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_isolated_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106708_colony_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_colony_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106708_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106708_colony_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_colony_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_08_15_Batch4/BR00106708_isolated_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_08_15_Batch4/BR00106708/BR00106708_isolated_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt_count.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_count.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt_isolated_normalized_variable_selected_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_isolated_normalized_variable_selected_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt_colony_normalized_variable_selected_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_colony_normalized_variable_selected_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt_isolated_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_isolated_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt_colony_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_colony_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt_normalized_variable_selected_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_normalized_variable_selected_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt_colony_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_colony_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt_colony_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_colony_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt_isolated_augmented.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_isolated_augmented.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt_isolated_normalized.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_06_10_Batch3/cmqtlpl1.5-31-2019-mt/cmqtlpl1.5-31-2019-mt_isolated_normalized.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_05_13_Batch2/BR00103267_colony_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103267/BR00103267_colony_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_05_13_Batch2/BR00103267_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103267/BR00103267_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_05_13_Batch2/BR00103267_isolated_normalized_variable_selected.csv to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103267/BR00103267_isolated_normalized_variable_selected.csv # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_05_13_Batch2/BR00103267_single_cell_isolated_profiles.tsv.gz to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103267/BR00103267_single_cell_isolated_profiles.tsv.gz # copy: s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles/2019_05_13_Batch2/BR00103267_single_cell_colony_profiles.tsv.gz to s3://cellpainting-gallery/cpg0022-cmqtl/broad/workspace/profiles_tmp/2019_05_13_Batch2/BR00103267/BR00103267_single_cell_colony_profiles.tsv.gz ```
ErinWeisbart commented 1 year ago

Thanks so much for your help Shantanu! Looks good to me. I'll perform the delete/rename and then we can consider this dataset fully moved!

shntnu commented 1 year ago

Super! Thanks for wrapping it up!