bailey-lab / MIPTools

A suite of computational tools used for molecular inversion probe design, data processing, and analysis.
https://miptools.readthedocs.io
MIT License
6 stars 9 forks source link

Use basespace CLI in download app #25

Closed arisp99 closed 2 years ago

arisp99 commented 2 years ago

This PR creates a new basespace download app that uses the official basespace CLI. This PR supersedes the work in #13 and introduces one large change. Namely, in order to maintain backward compatibility, we supersede the original download app that uses a python script for downloading data. Users may, therefore, still use the old download app.

Closes #8.

arisp99 commented 2 years ago

Below we provide a comparison of the output directory file structure. The file structure is almost identical with the only differences being a nohop.out file with download progress and a .json file with metadata about the sequencing run. These differences will not make a difference in subsequent steps such as demultiplexing.

Superseded app:

new_download_app
└── 214264108
    ├── 210923_214264108.json
    ├── Config
    ├── Data
    ├── InstrumentAnalyticsLogs
    ├── InterOp
    ├── Logs
    ├── Recipe
    ├── RTAComplete.txt
    ├── RTAConfiguration.xml
    ├── RTALogs
    ├── RTARead1Complete.txt
    ├── RTARead2Complete.txt
    ├── RTARead3Complete.txt
    ├── RTARead4Complete.txt
    ├── RunCompletionStatus.xml
    ├── RunInfo.xml
    ├── RunParameters.xml
    └── SampleSheet.csv

8 directories, 11 files

New download app:

superseded_download_app
├── 214264108
│   ├── Config
│   ├── Data
│   ├── InstrumentAnalyticsLogs
│   ├── InterOp
│   ├── Logs
│   ├── Recipe
│   ├── RTAComplete.txt
│   ├── RTAConfiguration.xml
│   ├── RTALogs
│   ├── RTARead1Complete.txt
│   ├── RTARead2Complete.txt
│   ├── RTARead3Complete.txt
│   ├── RTARead4Complete.txt
│   ├── RunCompletionStatus.xml
│   ├── RunInfo.xml
│   ├── RunParameters.xml
│   └── SampleSheet.csv
└── nohup.out

8 directories, 11 files