Open wwarriner opened 1 year ago
How to install and run an example with META in a personal workspace:
One-time setup:
cd ~
). I am assuming with the rest of these instructions you'll do the same thing. If not, file paths will be different.git clone https://git.computecanada.ca/syam/meta-farm.git
which will copy the code from the internet to ~/meta-farm
Each time you want to use their code:
~/meta-farm/bin/lockfile
executable to $PATH using PATH=$PATH:~/meta-farm/bin
cp -r ~/meta-farm/example ~/metatest
nano ~/metatest/job_script.sh
to open the file in the nano editor (or use your favorite editor)#SBATCH -A Your_account_name
or change Your_account_name
to $USER
. Both will work the same on our system.~/meta-farm/bin/submit.run 2
to try what they call META mode with two meta-jobs (i.e. two jobs doing independent processing).Step (3) can be automatically run in your .bashrc
file if you end up using this a lot. Or you can make a "startup script".
Step (5) can be automated by modifying the template ~/meta-farm/example/job_script.sh
file before copying.
What would you like to see added?
We have an article on workflow managers, but it is a stub. Let's flesh it out!
Technologies to consider:
Here is a big curated list: https://github.com/pditommaso/awesome-pipeline
Topics to discuss:
Some text to get things started:
Info on META is given below.