Large recursive directory listings with CLI fail

JasonAlt / GridFTP-DSI-for-HPSS

GridFTP module that allows the Globus server to work with HPSS

Other

6 stars 2 forks source link

Large recursive directory listings with CLI fail #56

Closed JasonAlt closed 4 years ago

JasonAlt commented 5 years ago

Globus CLI Error: A Transfer API Error Occurred. 
HTTP status: 502 
request_id: vWzNJ3b5c 
code: ExternalError.DirListingFailed.ConnectFailed 
message: 
Command Failed: Error (list) 
Endpoint: XXXX (c1bXXX0-6765-11e9-8e59-029dXXXX24) 
Server: xxx.gov:2811 
Command: MLSC ~/ 
Message: The connection to the server was broken

related to globusonline/globus-toolkit#9. threads 1 is not a viable solution for this DSI.

JasonAlt commented 5 years ago

Going to use GLOBUS_GFS_DSI_DESCRIPTOR_BLOCKING to prevent thread starvation when using threads 1. Waiting on a dev/test machine.