Closed axiomcura closed 1 year ago
@gwaybio hopefully I have answered all your comments and suggestions. Let me know if there are any changes required.
If not, I'll merge this tomorrow, morning.
I have answered all your comments and suggestions. Let me know if there are any changes required.
I responded to two quick followups - up to you when to merge. You already have my approval!
This PR introduces a new feature that allows
CytoSnake
to create environments using themamba
environment manager.Motivation
As mentioned in #34,
conda
has a tendency to get extremely slow to create environments as the number of dependencies increase.Usage
Switching to
mamba
is very simple! Users need to go to theconfigs/configuration.yaml
file and look for theenv_manager
keyword.Then edit the
env_manager
tomamba
in the configs:And that's it!
benchmarking
Here are some tests that show the complete runtime of a workflow.
The Linux
time
command was used to quantify runtime.Below are the results:
Testing with
cp_process_singlecells
using NF1 data (SQLITE -> PARQUET)conda
:mamba
Even though the time difference is quite small, adding more software dependencies will cause
conda
to be exponentially longer thanmamba
when creating environments.additional notes
Snakemake
provides an output indicating whethermamba
is being used. here's an example below: