search

dask / dask-jobqueue

Deploy Dask on job schedulers like PBS, SLURM, and SGE
https://jobqueue.dask.org
BSD 3-Clause "New" or "Revised" License
235 stars 142 forks source link

dask-jobqueue for Fujitsu HPC #573

Open MichaelChaoLi-cpu opened 2 years ago

MichaelChaoLi-cpu commented 2 years ago

In the dask-jobqueue, there are a lot of APIs for supercomputer structures. However, there is no Fujitsu HPC. Fujitsu structure is widely used in Japan. In the job script, it should be #PJM. Is it possible?

guillaumeeb commented 2 years ago

Hi @MichaelChaoLi-cpu,

Thanks for rising an issue here!

It's always possible to add new job queuing system implementation in dask-jobqueue. However it needs someone that knows well the underlying job scheduler and can devote time to this implementation. Would you want to give it a try?

MichaelChaoLi-cpu commented 2 years ago

Hi @guillaumeeb

Thanks for replying. I am not very familiar with this, but I will try to ask the supercomputer sysadmin to support this.

Let me contact him.

Anyway, thanks for your time!

guillaumeeb commented 2 years ago

@MichaelChaoLi-cpu, I'm going to delete your last message here. I see you posted the question on Dask Discourse which is really the good place for that. Moreover, this question didn't have anything to do with your first question.