ShouWenWang-Lab / snakemake_DARLIN

4 stars 3 forks source link

Running on HPC -- PEAR install through bioconda? FastQC/MultiQC Issues #10

Open jzussman opened 2 weeks ago

jzussman commented 2 weeks ago

Hello, I've been working with CARLIN data using the prior MATLAB pipeline and was very excited to migrate to this improved snakemake_DARLIN implementation for batch submissions. I would like to run the snakemake_DARLIN pipeline on an HPC with MATLAB available but PEAR installation has been tricky; is it sufficient to have PEAR installed into the conda environment via bioconda? Alternatively, I noticed that the python version of the pipeline does not seem to require a pear installation, is this true?

In addition, while running snakemake_DARLIN locally I was hoping to receive the Warnings.txt file in addition to the other outputs. Does this require fastqc/multiqc? I installed both to the snakemake_DARLIN conda environment but still did not receive a Warnings.txt file when running snakemake_DARLIN. How should fastqc and multiqc be installed in order to get the requisite QC info?

ShouWenWang commented 2 weeks ago

It is often needed to install pear on a HPC locally so that no root permission is needed. To do so, you can use ./configure --prefix /local/directory to install it locally where you do have access. Below is an example script for installing pear on HPC locally.

cd pear_installation_folder
./configure --prefix ~ # install at the local home directory
make
make install

The warning.txt file is not showing up because we modified the MatLab code. I don’t think this is that useful. You will need to inspect the output Results.txt file yourself to get how this could be wrong. Some of the guidelines for trouble shooting:

@.***

From: jzussman @.> Date: Friday, July 5, 2024 at 8:18 AM To: ShouWenWang-Lab/snakemake_DARLIN @.> Cc: Subscribed @.***> Subject: [ShouWenWang-Lab/snakemake_DARLIN] Running on HPC without sudo privileges -- PEAR install? FastQC/MultiQC Issues (Issue #10)

Hello, I've been working with CARLIN data using the prior MATLAB pipeline and was very excited to migrate to this improved snakemake_DARLIN implementation for batch submissions. I would like to run the snakemake_DARLIN pipeline on an HPC with MATLAB available but have been unable to install PEAR properly without sudo privileges -- do you have a recommended install method? Alternatively, I noticed that the python version of the pipeline does not seem to require a pear installation, is this true?

In addition, while running snakemake_DARLIN locally I was hoping to receive the Warnings.txt file in addition to the other outputs. Does this require fastqc/multiqc? I installed both to the snakemake_DARLIN conda environment but still did not receive a Warnings.txt file when running snakemake_DARLIN. How should fastqc and multiqc be installed in order to get the requisite QC info?

— Reply to this email directly, view it on GitHubhttps://github.com/ShouWenWang-Lab/snakemake_DARLIN/issues/10, or unsubscribehttps://github.com/notifications/unsubscribe-auth/ABDCASXCJS3IH6ETMPSMOILZKXQ6JAVCNFSM6AAAAABKMIFXQKVHI2DSMVQWIX3LMV43ASLTON2WKOZSGM4TCNJXGIZTCNI. You are receiving this because you are subscribed to this thread.Message ID: @.***>

jzussman commented 2 weeks ago

I was able to install PEAR locally on my HPC, thank you very much for the helpful suggestion! Regarding the Warnings.txt file -- no problem, I just wanted to make sure there wasn't a problem with my installation of the pipeline; I'm glad to hear that the Warnings.txt file is no longer intended to be included.

Did you perhaps mean to include something additional after "Some of the guidelines for trouble shooting:"

ShouWenWang commented 2 weeks ago
image
jzussman commented 2 weeks ago

Thank you!