Griffin 0.8.5 does not support globus_ftp_client_exists method from GridFTP library

[GoogleCodeExporter]

What steps will reproduce the problem?
1. Using FTS3 Client to do the transfer

[karolis@test13 ~]$ usr/bin/fts-transfer-status -s 
https://fts3-pilot.cern.ch:8443/ -l 4816a533-b9b3-454f-8440-6e42f8b5398a -v
# Using endpoint: https://fts3-pilot.cern.ch:8443/
# Service version: 3.7.6-1
# Interface version: 3.7.0
# Schema version: 3.5.0
# Service features: glite-data-fts-service-3.7.6-1
# Client version: 0.0.1
# Client interface version: 0.0.1
Request ID: 4816a533-b9b3-454f-8440-6e42f8b5398a
Status: FAILED
Client DN: /O=dutchgrid/O=users/O=egi/CN=Karolis Eigelis
Reason: One or more files failed. Please have a look at the details for more 
information
Submission time: 2013-04-05 15:06:22
Files: 1
Priority: 3
VOName: dteam
    Active: 0
    Ready: 0
    Canceled: 0
    Finished: 0
    Submitted: 0
    Failed: 1
  Source:      srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/dteam/1M.rand
  Destination: gsiftp://data.repo.cineca.it:2812/CINECA01/home/EUDAT_STAFF/keigelis/1M.rand
  State:       FAILED
  Retries:     0
  Reason:      [gfalt_copy_file][plugin_filecopy][gfalt_copy_file][plugin_filecopy]globus_ftp_client: the server responded with an error 550 Requested action not taken. Path unavailable (e.g., path not found, no access).   
  Duration:    3

What is the expected output? What do you see instead?

Expected output is a successful transfer, but here we see failed reason which 
returned by Griffin 0.8.5:

"Reason:      
[gfalt_copy_file][plugin_filecopy][gfalt_copy_file][plugin_filecopy]globus_ftp_c
lient: the server responded with an error 550 Requested action not taken. Path 
unavailable (e.g., path not found, no access). "

What version of the product are you using? On what operating system?

0.8.5 / Linux

Please provide any additional information below.

The same transfer works fine with "globus-url-copy", because they use 
globus_ftp_client_mist as well as Griffin.

As reported by Michail Salichos (FTS3 Client/Server) FTS3 is using 
globus_ftp_client_exists, this works with most tested GridFTP endpoints within 
EGI, but not with Griffin 0.8.5 (we do not have access yet for 0.9.0 version).

Please, could you tell us if this issue maybe was already addressed in 0.9.0 
version of Griffin or it could be addressed now if it was not yet found.

Many Thanks,
Karolis

Original issue reported on code.google.com by karolis....@gmail.com on 5 Apr 2013 at 1:17

[GoogleCodeExporter]

We just tried 0.9.0 version as well and result is completely the same.

Regards,
Karolis

Original comment by karolis....@gmail.com on 5 Apr 2013 at 6:13

[GoogleCodeExporter]

Hi Karolis,
Would you be able to send me some Griffin log? Especially around when this 
happened?

Original comment by shunde.p...@gmail.com on 5 Apr 2013 at 11:58

[GoogleCodeExporter]

Just adding update from the emails.

From Michail Salichos:

Scenario, calling globus_ftp_client_exists against globus gridftp server from 
Toolkit 5.2.1, when file doesn't exist:
SIZE /lxbra1910.cern.ch:/tmp/file.outx
550 Command failed : stat error: No such file or directory

STAT /lxbra1910.cern.ch:/tmp/file.outx
500 Command failed : stat error: No such file or directory

MLST /lxbra1910.cern.ch:/tmp/file.outx
500 Command failed : stat error: No such file or directory

Now against  Griffin:

SIZE /CINECA01/home/EUDAT_STAFF/keigelis/1M.rand
550 Requested action not taken. Path unavailable (e.g., path not found, no 
access).

STAT /CINECA01/home/EUDAT_STAFF/keigelis/1M.rand
550 Requested action not taken. Path unavailable (e.g., path not found, no 
access).

MLST /CINECA01/home/EUDAT_STAFF/keigelis/1M.rand
500 Error: No such file or directory

It seems that the mapping of STAT error code between globus and Griffin is not 
the same.

From Shunde Zhang:

I've changed the error code of STAT and uploaded a new version.
@Giacomo, could you get it and try please?

From Giacomo Mariani:

@Karolis, I put the new version of griffin in place. As usual, can you please 
test it at data.repo.cineca.it:2812 ?

From Karolis Eigelis:

Still not a successful transfer, log below. (Michail is looking at the FTS3 
server side).

[karolis@test13 ~]$ lcg-cp file:///home/karolis/1M.rand 
srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/dteam/1M.rand

[karolis@test13 ~]$ usr/bin/fts-transfer-submit -o -r -s 
https://fts3-pilot.cern.ch:8443/ 
srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/dteam/1M.rand  
gsiftp://data.repo.cineca.it:2812/CINECA01/home/EUDAT_STAFF/keigelis/1M.rand
527da943-7965-48b4-96d2-93edcd8df64c

[karolis@test13 ~]$ date; usr/bin/fts-transfer-status -s 
https://fts3-pilot.cern.ch:8443/ -l 527da943-7965-48b4-96d2-93edcd8df64c -vWed 
May  1 13:48:23 CEST 2013
# Using endpoint: https://fts3-pilot.cern.ch:8443/
# Service version: 3.7.6-1
# Interface version: 3.7.0
# Schema version: 3.5.0
# Service features: glite-data-fts-service-3.7.6-1
# Client version: 0.0.1
# Client interface version: 0.0.1
Request ID: 527da943-7965-48b4-96d2-93edcd8df64c
Status: FAILED
Client DN: /O=dutchgrid/O=users/O=egi/CN=Karolis Eigelis
Reason: One or more files failed. Please have a look at the details for more 
information
Submission time: 2013-05-01 13:47:43
Files: 1
Priority: 3
VOName: dteam
    Active: 0
    Ready: 0
    Canceled: 0
    Finished: 0
    Submitted: 0
    Failed: 1
  Source:      srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/data/dteam/1M.rand
  Destination: gsiftp://data.repo.cineca.it:2812/CINECA01/home/EUDAT_STAFF/keigelis/1M.rand
  State:       FAILED
  Retries:     0
  Reason:      [gfalt_copy_file][plugin_filecopy][gfalt_copy_file][plugin_filecopy][gfal2_stat][gfal_plugin_statG][gfal_gridftp_statG]globus_ftp_client: a protocol error occurred
  Duration:    6
[karolis@test13 ~]$ 

Original comment by karolis....@gmail.com on 1 May 2013 at 2:11