Closed andre-merzky closed 12 years ago
Hi Andre,
this should be fixed now: https://github.com/saga-project/bliss/commit/d79db4cd6ec68d3e8e1ca5287ae7c64297f09efc
Can you please integrate the test below with the Bliss unit tests?
Thanks, Ole
On Jun 11, 2012, at 7:06 AM, Andre Merzky wrote:
job.Service.create_job(jd) should create a deep copy of the given job description. the following code should run 5 different jobs, but does not::
import bliss.saga as saga
jd = saga.job.Description() js = saga.job.Service('ssh://localhost/') jobs = []
for i in range(5): f = saga.filesystem.File('sftp://localhost/etc/passwd') f.copy ('sftp://localhost/tmp/input.%d' % i)
jd.executable = '/bin/cat' jd.arguments = ['/tmp/input.%d' % i] jd.workingDirectory = '/tmp/' jd.numberOfProcesses = 1 jd.output = '/tmp/bliss.out.%d' % i jd.error = '/tmp/bliss.err.%d' % i j = js.create_job (jd) jobs.append(j) print " job: prepped (%s)" % str(j.get_description())
for j in jobs : j.run() print " job: %s started" % j.get_job_id()
for j in jobs : j.wait() print " job: %s done" % j.get_job_id(), 't' print " : %s" % str(j.get_description())
It results in::
merzky@thinkie:~/saga/bliss (master *%) $ python t.py job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.0']','Error' : '/tmp/bliss.err.0','Output' : '/tmp/bliss.out.0',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.1']','Error' : '/tmp/bliss.err.1','Output' : '/tmp/bliss.out.1',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.2']','Error' : '/tmp/bliss.err.2','Output' : '/tmp/bliss.out.2',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.3']','Error' : '/tmp/bliss.err.3','Output' : '/tmp/bliss.out.3',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',}) job: [ssh://localhost/]-[3277] started job: [ssh://localhost/]-[3453] started job: [ssh://localhost/]-[3635] started job: [ssh://localhost/]-[3810] started job: [ssh://localhost/]-[3995] started job: [ssh://localhost/]-[3277] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3453] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3635] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3810] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3995] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',}
Reply to this email directly or view it on GitHub: https://github.com/saga-project/bliss/issues/57
Test is done.
Thanks, Andre.
On Mon, Jun 11, 2012 at 3:04 PM, Ole Weidner reply@reply.github.com wrote:
Hi Andre,
this should be fixed now: https://github.com/saga-project/bliss/commit/d79db4cd6ec68d3e8e1ca5287ae7c64297f09efc
Can you please integrate the test below with the Bliss unit tests?
Thanks, Ole
On Jun 11, 2012, at 7:06 AM, Andre Merzky wrote:
job.Service.create_job(jd) should create a deep copy of the given job description. the following code should run 5 different jobs, but does not::
import bliss.saga as saga
jd = saga.job.Description() js = saga.job.Service('ssh://localhost/') jobs = []
for i in range(5): f = saga.filesystem.File('sftp://localhost/etc/passwd') f.copy ('sftp://localhost/tmp/input.%d' % i)
jd.executable = '/bin/cat' jd.arguments = ['/tmp/input.%d' % i] jd.workingDirectory = '/tmp/' jd.numberOfProcesses = 1 jd.output = '/tmp/bliss.out.%d' % i jd.error = '/tmp/bliss.err.%d' % i
j = js.create_job (jd) jobs.append(j) print " job: prepped (%s)" % str(j.get_description())
for j in jobs : j.run() print " job: %s started" % j.get_job_id()
for j in jobs : j.wait() print " job: %s done" % j.get_job_id(), 't' print " : %s" % str(j.get_description())
It results in::
merzky@thinkie:~/saga/bliss (master *%) $ python t.py job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.0']','Error' : '/tmp/bliss.err.0','Output' : '/tmp/bliss.out.0',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.1']','Error' : '/tmp/bliss.err.1','Output' : '/tmp/bliss.out.1',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.2']','Error' : '/tmp/bliss.err.2','Output' : '/tmp/bliss.out.2',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.3']','Error' : '/tmp/bliss.err.3','Output' : '/tmp/bliss.out.3',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',}) job: [ssh://localhost/]-[3277] started job: [ssh://localhost/]-[3453] started job: [ssh://localhost/]-[3635] started job: [ssh://localhost/]-[3810] started job: [ssh://localhost/]-[3995] started job: [ssh://localhost/]-[3277] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3453] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3635] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3810] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3995] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',}
Reply to this email directly or view it on GitHub: https://github.com/saga-project/bliss/issues/57
Reply to this email directly or view it on GitHub: https://github.com/saga-project/bliss/issues/57#issuecomment-6243727
Nothing is ever easy...
BTW: running the unit tests gives a significant number of errors for me. Are they supposed to pass at this stage?
Cheers, Andre.
On Mon, Jun 11, 2012 at 7:40 PM, Andre Merzky andre@merzky.net wrote:
Test is done.
Thanks, Andre.
On Mon, Jun 11, 2012 at 3:04 PM, Ole Weidner reply@reply.github.com wrote:
Hi Andre,
this should be fixed now: https://github.com/saga-project/bliss/commit/d79db4cd6ec68d3e8e1ca5287ae7c64297f09efc
Can you please integrate the test below with the Bliss unit tests?
Thanks, Ole
On Jun 11, 2012, at 7:06 AM, Andre Merzky wrote:
job.Service.create_job(jd) should create a deep copy of the given job description. the following code should run 5 different jobs, but does not::
import bliss.saga as saga
jd = saga.job.Description() js = saga.job.Service('ssh://localhost/') jobs = []
for i in range(5): f = saga.filesystem.File('sftp://localhost/etc/passwd') f.copy ('sftp://localhost/tmp/input.%d' % i)
jd.executable = '/bin/cat' jd.arguments = ['/tmp/input.%d' % i] jd.workingDirectory = '/tmp/' jd.numberOfProcesses = 1 jd.output = '/tmp/bliss.out.%d' % i jd.error = '/tmp/bliss.err.%d' % i
j = js.create_job (jd) jobs.append(j) print " job: prepped (%s)" % str(j.get_description())
for j in jobs : j.run() print " job: %s started" % j.get_job_id()
for j in jobs : j.wait() print " job: %s done" % j.get_job_id(), 't' print " : %s" % str(j.get_description())
It results in::
merzky@thinkie:~/saga/bliss (master *%) $ python t.py job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.0']','Error' : '/tmp/bliss.err.0','Output' : '/tmp/bliss.out.0',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.1']','Error' : '/tmp/bliss.err.1','Output' : '/tmp/bliss.out.1',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.2']','Error' : '/tmp/bliss.err.2','Output' : '/tmp/bliss.out.2',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.3']','Error' : '/tmp/bliss.err.3','Output' : '/tmp/bliss.out.3',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',}) job: [ssh://localhost/]-[3277] started job: [ssh://localhost/]-[3453] started job: [ssh://localhost/]-[3635] started job: [ssh://localhost/]-[3810] started job: [ssh://localhost/]-[3995] started job: [ssh://localhost/]-[3277] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3453] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3635] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3810] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3995] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',}
Reply to this email directly or view it on GitHub: https://github.com/saga-project/bliss/issues/57
Reply to this email directly or view it on GitHub: https://github.com/saga-project/bliss/issues/57#issuecomment-6243727
Nothing is ever easy...
Nothing is ever easy...
Uh... yes they are supposed to pass ;-) They pass for me & I just manually started a buildbot run (on Ubuntu) and it seems to pass fine as well:
http://faust.cct.lsu.edu:8080/builders/Test%20Bliss%3A%20Local/builds/19/steps/unittests/logs/stdio
Please send me more details about the specific errors you are seeing!
Cheers! Ole
On Jun 11, 2012, at 12:43 PM, Andre Merzky wrote:
BTW: running the unit tests gives a significant number of errors for me. Are they supposed to pass at this stage?
Cheers, Andre.
On Mon, Jun 11, 2012 at 7:40 PM, Andre Merzky andre@merzky.net wrote:
Test is done.
Thanks, Andre.
On Mon, Jun 11, 2012 at 3:04 PM, Ole Weidner reply@reply.github.com wrote:
Hi Andre,
this should be fixed now: https://github.com/saga-project/bliss/commit/d79db4cd6ec68d3e8e1ca5287ae7c64297f09efc
Can you please integrate the test below with the Bliss unit tests?
Thanks, Ole
On Jun 11, 2012, at 7:06 AM, Andre Merzky wrote:
job.Service.create_job(jd) should create a deep copy of the given job description. the following code should run 5 different jobs, but does not::
import bliss.saga as saga
jd = saga.job.Description() js = saga.job.Service('ssh://localhost/') jobs = []
for i in range(5): f = saga.filesystem.File('sftp://localhost/etc/passwd') f.copy ('sftp://localhost/tmp/input.%d' % i)
jd.executable = '/bin/cat' jd.arguments = ['/tmp/input.%d' % i] jd.workingDirectory = '/tmp/' jd.numberOfProcesses = 1 jd.output = '/tmp/bliss.out.%d' % i jd.error = '/tmp/bliss.err.%d' % i j = js.create_job (jd) jobs.append(j) print " job: prepped (%s)" % str(j.get_description())
for j in jobs : j.run() print " job: %s started" % j.get_job_id()
for j in jobs : j.wait() print " job: %s done" % j.get_job_id(), 't' print " : %s" % str(j.get_description())
It results in::
merzky@thinkie:~/saga/bliss (master *%) $ python t.py job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.0']','Error' : '/tmp/bliss.err.0','Output' : '/tmp/bliss.out.0',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.1']','Error' : '/tmp/bliss.err.1','Output' : '/tmp/bliss.out.1',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.2']','Error' : '/tmp/bliss.err.2','Output' : '/tmp/bliss.out.2',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.3']','Error' : '/tmp/bliss.err.3','Output' : '/tmp/bliss.out.3',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',}) job: [ssh://localhost/]-[3277] started job: [ssh://localhost/]-[3453] started job: [ssh://localhost/]-[3635] started job: [ssh://localhost/]-[3810] started job: [ssh://localhost/]-[3995] started job: [ssh://localhost/]-[3277] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3453] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3635] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3810] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3995] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',}
Reply to this email directly or view it on GitHub: https://github.com/saga-project/bliss/issues/57
Reply to this email directly or view it on GitHub: https://github.com/saga-project/bliss/issues/57#issuecomment-6243727
Nothing is ever easy...
Nothing is ever easy...
Reply to this email directly or view it on GitHub: https://github.com/saga-project/bliss/issues/57#issuecomment-6251002
Hi Ole,
the failures were probably a fluke, caused by an old installed bliss version. Seems to run fine now :-)
Sorry for the noise,
Andre.
On Mon, Jun 11, 2012 at 11:29 PM, Ole Weidner reply@reply.github.com wrote:
Uh... yes they are supposed to pass ;-) They pass for me & I just manually started a buildbot run (on Ubuntu) and it seems to pass fine as well:
http://faust.cct.lsu.edu:8080/builders/Test%20Bliss%3A%20Local/builds/19/steps/unittests/logs/stdio
Please send me more details about the specific errors you are seeing!
Cheers! Ole
On Jun 11, 2012, at 12:43 PM, Andre Merzky wrote:
BTW: running the unit tests gives a significant number of errors for me. Are they supposed to pass at this stage?
Cheers, Andre.
On Mon, Jun 11, 2012 at 7:40 PM, Andre Merzky andre@merzky.net wrote:
Test is done.
Thanks, Andre.
On Mon, Jun 11, 2012 at 3:04 PM, Ole Weidner reply@reply.github.com wrote:
Hi Andre,
this should be fixed now: https://github.com/saga-project/bliss/commit/d79db4cd6ec68d3e8e1ca5287ae7c64297f09efc
Can you please integrate the test below with the Bliss unit tests?
Thanks, Ole
On Jun 11, 2012, at 7:06 AM, Andre Merzky wrote:
job.Service.create_job(jd) should create a deep copy of the given job description. the following code should run 5 different jobs, but does not::
import bliss.saga as saga
jd = saga.job.Description() js = saga.job.Service('ssh://localhost/') jobs = []
for i in range(5): f = saga.filesystem.File('sftp://localhost/etc/passwd') f.copy ('sftp://localhost/tmp/input.%d' % i)
jd.executable = '/bin/cat' jd.arguments = ['/tmp/input.%d' % i] jd.workingDirectory = '/tmp/' jd.numberOfProcesses = 1 jd.output = '/tmp/bliss.out.%d' % i jd.error = '/tmp/bliss.err.%d' % i
j = js.create_job (jd) jobs.append(j) print " job: prepped (%s)" % str(j.get_description())
for j in jobs : j.run() print " job: %s started" % j.get_job_id()
for j in jobs : j.wait() print " job: %s done" % j.get_job_id(), 't' print " : %s" % str(j.get_description())
It results in::
merzky@thinkie:~/saga/bliss (master *%) $ python t.py job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.0']','Error' : '/tmp/bliss.err.0','Output' : '/tmp/bliss.out.0',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.1']','Error' : '/tmp/bliss.err.1','Output' : '/tmp/bliss.out.1',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.2']','Error' : '/tmp/bliss.err.2','Output' : '/tmp/bliss.out.2',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.3']','Error' : '/tmp/bliss.err.3','Output' : '/tmp/bliss.out.3',}) job: prepped ({'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',}) job: [ssh://localhost/]-[3277] started job: [ssh://localhost/]-[3453] started job: [ssh://localhost/]-[3635] started job: [ssh://localhost/]-[3810] started job: [ssh://localhost/]-[3995] started job: [ssh://localhost/]-[3277] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3453] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3635] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3810] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',} job: [ssh://localhost/]-[3995] done t : {'Executable' : '/bin/cat','Arguments' : '['/tmp/input.4']','Error' : '/tmp/bliss.err.4','Output' : '/tmp/bliss.out.4',}
Reply to this email directly or view it on GitHub: https://github.com/saga-project/bliss/issues/57
Reply to this email directly or view it on GitHub: https://github.com/saga-project/bliss/issues/57#issuecomment-6243727
Nothing is ever easy...
Nothing is ever easy...
Reply to this email directly or view it on GitHub: https://github.com/saga-project/bliss/issues/57#issuecomment-6251002
Reply to this email directly or view it on GitHub: https://github.com/saga-project/bliss/issues/57#issuecomment-6256566
Nothing is ever easy...
job.Service.create_job(jd) should create a deep copy of the given job description. the following code should run 5 different jobs, but does not::
It results in::