search

h3abionet / HPCBio-Refgraph_pipeline

0 stars 6 forks source link

Prepare data for shipping from UIUC to ilifu #18

Closed grendon closed 3 years ago

grendon commented 3 years ago

On the UIUC side we analyzed nearly 200 samples. On the ilifu side, they want 100 samples.

Need to select, package and transfer only the results of the samples that are being analyzed.

cjfields commented 3 years ago

@grendon if you want to copy only the assembly files over, I rsynced the assemblies to the hackathon work directory for the group t play with: /home/classroom/hpcbio/h3a/assemblies

grendon commented 3 years ago

I just xref Gerit's list and mine. We analyzed 96 of the 100 samples he listed.

100 African samples - 1000 Genomes - Tracking info .xlsx

grendon commented 3 years ago

I need the classroom account info to transfer files

grendon commented 3 years ago

Transfer of results via GO failed. It says permission denied on the Ilifu DTN endpoint

Sun Dec 06 2020 12:13:29 GMT-0600 (Central Standard Time)
permission denied
Error (transfer)
Endpoint: Ilifu DTN (8e20a024-9e5d-11e9-b594-0e56e8fd6d5a)
Server: dtn01.ilifu.ac.za:2811
File: /cbio/projects/012/stream1/hupan/1kg-100-samples/uiuc/1000Genomes_RefGraph_results_96Samples.tar.gz
Command: STOR /cbio/projects/012/stream1/hupan/1kg-100-samples/uiuc/1000Genomes_RefGraph_results_96Samples.tar.gz
Message: Fatal FTP response
---
Details: 500-Command failed. : globus_gridftp_server_file.c:globus_l_gfs_file_recv:3014:\r\n500-globus_l_gfs_file_open failed.\r\n500-globus_gridftp_server_file.c:globus_l_gfs_file_open:2915:\r\n500-globus_xio_register_open failed.\r\n500-globus_xio_file_driver.c:globus_l_xio_file_open:653:\r\n500-Unable to open file /cbio/projects/012/stream1/hupan/1kg-100-samples/uiuc/1000Genomes_RefGraph_results_96Samples.tar.gz\r\n500-globus_xio_system_select.c:globus_xio_system_file_open:2251:\r\n500-System error in open: Permission denied\r\n500-globus_xio: A system call failed: Permission denied\r\n500 End.\r\n
grbot commented 3 years ago

@grendon can you please try again.

grendon commented 3 years ago

it finally went.

This is the full path of the tarball:

/cbio/projects/012/stream1/hupan/1kg-100-samples/uiuc/1000Genomes_RefGraph_results_96Samples.tar.gz

cjfields commented 3 years ago

thx @grendon !

grbot commented 3 years ago

Thank you @grendon we already started comparing.