search

NorwegianVeterinaryInstitute / DemultiplexRawSequenceData

A workflow automation script: demultiplex the library sequence, run quality checks, deliver to archiving and processing afterwards
GNU General Public License v3.0
1 stars 0 forks source link

Automatic transfer of data to NIRD #4

Closed karinlag closed 4 years ago

karinlag commented 4 years ago

We should figure out how to get the data automagically transferred to NIRD, so we can have the data available for those that will analyze it.

arvindsundaram commented 4 years ago

We need to create a bot user at NIRD. There that possible? If so, please let me know whom I should get in touch at NIRD.

karinlag commented 4 years ago

I am pretty certain we can't get a bot user at NIRD. However, if we have a user who would be comfortable with it, ssh keys can be set up so that the data can be uploaded without human intervention that way.

arvindsundaram commented 4 years ago

I think this option might work - I can create a personal user account in the VI VM (right now it is same username/password for all) and will be happy to store my ssh key there and automate the transfer. But it is also good to have Catherine/Someone else do this manually as there will be human check point.

arvindsundaram commented 4 years ago

@karinlag Once you have folder structure within NIRD for MiSeq data transfer, can you please update that information on this issue? Thanks!

karinlag commented 4 years ago

Hi!

This is the data delivery directory on NIRD:

/nird/projects/nird/NS9305K/SEQ-TECH/data_delivery

So. The process will be that all seqtech data goes there. People can then pick it up from there and move it to where it belongs in the datasets structure.

That way as long as they are in "our ownership" (that is seqtech project) they stay there. If we sequence for someone else, they pick them up and move them elsewhere.

arvindsundaram commented 4 years ago

The folder information has been updated on the MiSeq transfer SOP.