Support for remote PBS

[rexissimus]

I would like to add support for remote PBS. Are there any plans to do this? Do you have any pointers on where to begin?

[troelsfr]

Adding support for remote PBS is probably possible, however, since I do not know remote PBS, I have not planned support for this. Could you briefly describe to me how it works? I guess it is a local commandline tool which you can use to submit jobs on a remote PBS? If this is the case, one needs to make a new queuing object - in the stable version this is somewhat tedious, while it should be a matter of minutes in the unstable version. As I suppose you want to use it with Vistrails, you will need to modify the stable version.

Could you direct me to documentation homepage on how this tool works?

[rexissimus]

Thanks, and sorry for the late reply. I had to learn PBS myself before I could answer, using this documentation: http://www.adaptivecomputing.com/resources/docs/torque/4-0-2/help.htm.

I guess there is not such thing as "Remote PBS", what I want to achieve is to access PBS remotely over SSH using BatchQ. This article suggests it should be similar to LSF: https://modelingguru.nasa.gov/docs/DOC-1040 If you already have LSF support maybe it is possible to just modify the calls?

What is the status of the unstable branch? If there are many improvements maybe it is better to use that branch and update the VisTrails code to work with it?

[troelsfr]

Actually, the main motivation for BatchQ is exactly to get remote access to LSF and other submission systems. At the moment we only support LSF - also in the version shipped with Vistrails.

However, this version is horribly slow, so if you want to do thousands of jobs, you probably want to use the unstable trunk version.

It does not make sense to write a new package for Vistrails yet, since the API changes a lot.

Maybe we should do a VC to discuss your needs?