nanoporetech / dorado

Oxford Nanopore's Basecaller
https://nanoporetech.com/
Other
477 stars 59 forks source link

live basecalling on our cluster with ont_basecall_client and ont_dorado_server #663

Closed gerald2545 closed 6 months ago

gerald2545 commented 6 months ago

Hi, we would like to be able to basecall our pod5 files on our slurm cluster using ont_basecall_client and ont_dorado_server 7.2.13. I managed to run client, communicate with server using local socket on our GPU instances through slurm, to basecall some pod5 files present in a folder. No problem.

But now I would like to mimic MinKnow to automate all steps :

Did someone implement such a workflow? Would you be OK to share your work?

Thank you for your help

Gérald

HalfPhoton commented 6 months ago

Hi @gerald2545, Have you seen the Epi2Me wf-basecalling pipeline? I believe this is configurable to work on a cluster and might do what you want.

Kind regards, Rich

gerald2545 commented 6 months ago

Thank you for your answer. Yes we identified this workflow, but it is based on the standalone dorado (current version uses 0.5.2) not ont_basecall_client. We need this software to have the same version used on our promethion, and to be able to basecall locally on it or remotely on our cluster, and produce comparable results. If no other resource is available, the aim would be to adapt this workflow to use ont_basecall_client

HalfPhoton commented 6 months ago

@gerald2545, to the best of my knowledge we don't have a workflow like this unfortunately. We commonly use dorado standalone and create parallel jobs on our cluster and merge the output bams afterwards but we don't have one specifically using dorado basecall server. Sorry about that. Kind regards, Rich

gerald2545 commented 6 months ago

Thank you for your messages