goerz / gc3pie

Automatically exported from code.google.com/p/gc3pie
0 stars 0 forks source link

failed to copy geotop_wrap.sh #417

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
What steps will reproduce the problem?
1. Run ggeotop on an SGE cluster, from submit node.
2.
3.

What is the expected output? What do you see instead?
I expect a running simulation, but get an error "CRITICAL: Copying input file 
'/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/geotop_wrap.sh' 
to remote cluster 'thog2.hpcvl.carleton.ca' failed"

THe directory '/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/' 
exists, but the file "geotop_wrap.sh" does not. (Only: codeml.pl  
gc3pie.conf.example  logging.conf.example  rosetta.sh)  

Shell output and gc3pie.conf are included below.

What version of the product are you using? On what operating system?
Rocks Compute Node
Rocks 5.4.3 (Viper)

Please provide any additional information below.
gc3.gc3libs: DEBUG: Submitting GeotopApplication.117 ...
gc3.gc3libs: DEBUG: Performing brokering ...
gc3.gc3libs: DEBUG: Checking resource 'hpcvl' for compatibility with 
application requirements
gc3.gc3libs: DEBUG: Application scheduler returned 1 matching resources
gc3.gc3libs: DEBUG: Attempting submission to resource 'hpcvl'...
gc3.gc3libs: DEBUG: Checking auth: SshAuth
gc3.gc3libs: DEBUG: Opening LocalTransport...
gc3.gc3libs: INFO: Creating remote temporary folder: command 'mkdir -p 
$HOME/.gc3pie_jobs; mktemp -d $HOME/.gc3pie_jobs/lrms_job.XXXXXXXXXX'
gc3.gc3libs: DEBUG: Executed local command 'mkdir -p $HOME/.gc3pie_jobs; mktemp 
-d $HOME/.gc3pie_jobs/lrms_job.XXXXXXXXXX', got exit status: 0
gc3.gc3libs: DEBUG: Making remote directory 
'/home/hpc2700/.gc3pie_jobs/lrms_job.QSIHn23138'
gc3.gc3libs: DEBUG: Transferring file 
'/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/geotop_wrap.sh' 
to '/home/hpc2700/.gc3pie_jobs/lrms_job.QSIHn23138/geotop_wrap.sh'
gc3.gc3libs: DEBUG: Running method 'put'; source: 
/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/geotop_wrap.sh. 
destination: /home/hpc2700/.gc3pie_jobs/lrms_job.QSIHn23138/geotop_wrap.sh
gc3.gc3libs: CRITICAL: Copying input file 
'/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/geotop_wrap.sh' 
to remote cluster 'thog2.hpcvl.carleton.ca' failed
gc3.gc3libs: INFO: Error in submitting job to resource 'hpcvl': CopyError: 
Could not copy 
'/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/geotop_wrap.sh' 
to '/home/hpc2700/.gc3pie_jobs/lrms_job.QSIHn23138/geotop_wrap.sh': IOError: 
[Errno 2] No such file or directory: 
'/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/geotop_wrap.sh'
Traceback (most recent call last):
  File "/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/core.py", line 242, in __submit_application
    lrms.submit_job(app)
  File "/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/backends/__init__.py", line 150, in wrapper
    return fn(self, *args, **kwargs)
  File "/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/backends/batch.py", line 361, in submit_job
    self.transport.put(local_path.path, remote_path)
  File "/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/backends/transport.py", line 739, in put
    raise gc3libs.exceptions.CopyError(source, destination, ex)
CopyError: Could not copy 
'/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/geotop_wrap.sh' 
to '/home/hpc2700/.gc3pie_jobs/lrms_job.QSIHn23138/geotop_wrap.sh': IOError: 
[Errno 2] No such file or directory: 
'/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/geotop_wrap.sh'
gc3.gc3libs: ERROR: Ignored error in submitting task 'GeotopApplication.117': 
CopyError: Could not copy 
'/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/geotop_wrap.sh' 
to '/home/hpc2700/.gc3pie_jobs/lrms_job.QSIHn23138/geotop_wrap.sh': IOError: 
[Errno 2] No such file or directory: 
'/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/geotop_wrap.sh'
gc3.gc3libs: DEBUG: Ignored error in submitting task 'GeotopApplication.117': 
CopyError: Could not copy 
'/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/geotop_wrap.sh' 
to '/home/hpc2700/.gc3pie_jobs/lrms_job.QSIHn23138/geotop_wrap.sh': IOError: 
[Errno 2] No such file or directory: 
'/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/geotop_wrap.sh'
Traceback (most recent call last):
  File "/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/core.py", line 969, in progress
    self._core.submit(task)
  File "/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/core.py", line 168, in submit
    return self.__submit_application(app, resubmit, **extra_args)
  File "/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/core.py", line 271, in __submit_application
    raise ex
CopyError: Could not copy 
'/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/geotop_wrap.sh' 
to '/home/hpc2700/.gc3pie_jobs/lrms_job.QSIHn23138/geotop_wrap.sh': IOError: 
[Errno 2] No such file or directory: 
'/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/geotop_wrap.sh'
Status of jobs in the 'RL01' session: (at 12:47:15, 10/17/13)
gc3.gc3libs: DEBUG: Engine.stats: Restricting to object of class 'GeotopTask'
         NEW  144/144  (100.0%)
     RUNNING    0/144   (0.0%)
     STOPPED    0/144   (0.0%)
   SUBMITTED    0/144   (0.0%)
  TERMINATED    0/144   (0.0%)
 TERMINATING    0/144   (0.0%)
     UNKNOWN    0/144   (0.0%)
       total  144/144  (100.0%)
gc3.gc3utils: INFO: sleeping for 120 seconds...

(gc3pie)[hpc2700@compute-2-0 .gc3]$ m gc3pie.conf
# ~/.gc3/gc3utils.conf
#
#  Please see http://code.google.com/p/gc3pie/wiki/ConfigurationFile
#  for details on this file format and contents.

[DEFAULT]
# The `DEFAULT` section is entirely optional; if present, its values can
# be used to interpolate values in other sections, using the `%(name)s` syntax.
# See documentation of the `SafeConfigParser` object at:
#   http://docs.python.org/library/configparser.html
debug = 0

###############
# HPCVL
[resource/hpcvl]
enabled = True
type = sge
accounting_delay = 20
transport = local
frontend = thog2.hpcvl.carleton.ca
auth = ssh
max_cores_per_job = 1
max_memory_per_core = 8
max_walltime = 24
max_cores = 1
architecture = x86_64

[auth/ssh]
type = ssh
username = hpc2700
#################

Original issue reported on code.google.com by stephan....@carleton.ca on 17 Oct 2013 at 4:54

GoogleCodeExporter commented 9 years ago
Hi Stephan,

can you please run the following commands and paste the output here:

  ginfo --version

  cd /home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/
  svn info

Thanks,
Riccardo

Original comment by riccardo.murri@gmail.com on 17 Oct 2013 at 4:59

GoogleCodeExporter commented 9 years ago
(gc3pie)[hpc2700@compute-2-0 ~]$  ginfo --version
ginfo 2.1.1 version (SVN $Revision: 3705 $)

(gc3pie)[hpc2700@compute-2-0 ~]$ cd 
/home/hpc2700/gc3pie/lib/python2.7/site-packages/gc3libs/etc/
(gc3pie)[hpc2700@compute-2-0 etc]$  svn info
svn: '.' is not a working copy

Cheers,
Stephan

Original comment by stephan....@carleton.ca on 17 Oct 2013 at 5:33

GoogleCodeExporter commented 9 years ago
This issue was closed by revision r3718.

Original comment by riccardo.murri@gmail.com on 17 Oct 2013 at 5:42

GoogleCodeExporter commented 9 years ago
Hi Stephan,

I've just released version 2.1.2 of GC3Pie, which fixes this issue.
You can either re-install and get the latest version, or just
download the `geotop_wrap.sh` file in the correct directory.
You can get geotop_wrap.sh from:

https://gc3pie.googlecode.com/svn/branches/2.1/gc3pie/gc3libs/etc/geotop_wrap.sh

Cheers,
Riccardo

Original comment by riccardo.murri@gmail.com on 17 Oct 2013 at 5:50

GoogleCodeExporter commented 9 years ago
Thank you Riccardo, that solved the problem.

Cheers,
Stephan

Original comment by stephan....@carleton.ca on 17 Oct 2013 at 6:11

GoogleCodeExporter commented 9 years ago
This issue was closed by revision r3735.

Original comment by riccardo.murri@gmail.com on 21 Oct 2013 at 1:40