search

frazer-lab / cluster

Repo for cluster issues.
1 stars 0 forks source link

Install ResilioSync #266

Closed djakubosky closed 5 years ago

djakubosky commented 5 years ago

Hey Paul I know you are traveling, but I was curious if we could install resilio-sync (I need to be root to install). Is it possible for us to have this?

https://help.resilio.com/hc/en-us/articles/206178924-Installing-Sync-package-on-Linux

tatarsky commented 5 years ago

I'll take a look but I may ask if its complex you work with @hirokomatsui who does have root.

But I'll see if I can take a quick look before I drive again.

When is this needed by?

hirokomatsui commented 5 years ago

Let me work on the next week after Christmas.

djakubosky commented 5 years ago

This is a fairly urgent situation, but let me check with Kelly before you do anything @tatarsky and make sure she thinks its a worthy use of time. I'm worried my link to download the data might expire @hirokomatsui and we have been trying to obtain this data for a while. Its a strange situation also where the data is housed on someones personal computer, and we are dependent on that computer being functional when I open the link. He said he would leave his stuff powered on through the holiday, but it concerns me that I might not actually be able to get the data when we finally have this software. I'm exploring the possibility of mounting the share drive locally and trying to do resioliosync on my machine to share drive instead..

tatarsky commented 5 years ago

I've already done most of the process. I have done to this part of the howto on fl-hn1 and fl-hn2.

https://help.resilio.com/hc/en-us/articles/206178924-Installing-Sync-package-on-Linux

I've added the yum program. I've added the user and group. I'm starting the service.

I've got no idea how to use it though....

hirokomatsui commented 5 years ago

Do you have the VPN client?

djakubosky commented 5 years ago

Thank you @tatarsky and @hirokomatsui yes I do have it, I actually think this share drive method will work... I'm sorry for getting people involved, I was doubtful it would work

tatarsky commented 5 years ago

OK, Well, as far as I can tell the following is running on fl-hn2 but you'll have to read this part:

https://help.resilio.com/hc/en-us/articles/204762449-Guide-to-Linux

Appears you have to HTTP port forward or something to:

http://localhost:8888/gui/

Which can be done with SSH tunnels from say your laptop to fl-hn2:

ssh -L 8888:localhost:8888 flhn2.ucsd.edu

Then on your laptop if you go to that URL:

http://localhost:8888/gui/

You indeed get something:

sync

djakubosky commented 5 years ago

I think my local computer install is working, very slowly, to download the data into the share drive. using the linux version is probably a better solution overall though. I'm going to try @tatarsky solution now instead.

tatarsky commented 5 years ago

If you try that BTW and it doesn't work, drop me a note.

I am going out for a bit but then I'll check back. If you are stuck I'll see what I can do but I''ve never seen this pup.

It appears that I can make it listen to the Internet side compared to the localhost binding but see if that ssh tunnel works for you.

There is also some note that seems to imply you might need to add a group to any directory you use but that may just be for serving stuff.

rslsync user with minimum privileges is used by default by security reasons. Thus if you need to synchronize files owned by current user - just add rslsync user to group of your current user and ensure read-write permissions for the mentioned group for the folder to be synced, for example:

sudo usermod -aG user_group rslsync sudo chmod g+rw synced_folder

Thats a root action but if you tell me the folder I can add it.

tatarsky commented 5 years ago

I will also mention in the case where this person could use SFTP we have a way to upload data via a "guest" account. @hirokomatsui has some of those details as a backup but I can repeat. Of course that means the person with the data would need to upload it to us. And I suspect they are doing this to just make it up to you to grab the data.

tatarsky commented 5 years ago

FYI: I see all sorts of log stuff flying by. So I'm assuming you are getting somewhere. Drop me a note and I'll check back in an hour or so.

djakubosky commented 5 years ago

It looks like I was able to make an account, log in, and begin a transfer. I made a folder in my home dir and just chmod 777 it and it started working. I'll let you know if it ends up actually working, looks ok so far! thanks so much for the help

tatarsky commented 5 years ago

Noted! No prob.

tatarsky commented 5 years ago

Assume this worked OK. Let me know if you need it still on both machines. I can leave it on fl-hn2 as I think you used it there if you still need it! No rush on response.

tatarsky commented 5 years ago

@djakubosky just checking if this is still needed running or if I can shutdown until "the next need".

djakubosky commented 5 years ago

Hey Paul! Please leave running, we are using it now and will continue to use it with a collaborator to transfer large files. Thanks!

On Tue, Jan 15, 2019 at 10:28 AM Paul Tatarsky notifications@github.com wrote:

@djakubosky https://github.com/djakubosky just checking if this is still needed running or if I can shutdown until "the next need".

— You are receiving this because you were mentioned.

Reply to this email directly, view it on GitHub https://github.com/frazer-lab/cluster/issues/266#issuecomment-454499343, or mute the thread https://github.com/notifications/unsubscribe-auth/AOUvtu9q-KPzf_A0eZFLDP3NguO14pSDks5vDh3jgaJpZM4ZfCtJ .

-- ____

David Jakubosky

NLM Biomedical Informatics Pre-Doctoral Fellow Biomedical Sciences Graduate Program Laboratory of Kelly A. Frazer, PhD Institute for Genomic Medicine, University of California at San Diego

tatarsky commented 5 years ago

Do you need it on fl-hn1 as well? I put it over there besides fl-hn2 just in case. But I don't show it used on fl-hn1.

djakubosky commented 5 years ago

I only need it in flhn2, no need for it to run in both places.

On Tue, Jan 15, 2019 at 11:11 AM Paul Tatarsky notifications@github.com wrote:

Do you need it on fl-hn1 as well? I put it over there besides fl-hn2 just in case. But I don't show it used on fl-hn1.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/frazer-lab/cluster/issues/266#issuecomment-454513709, or mute the thread https://github.com/notifications/unsubscribe-auth/AOUvtuvw5lABAiyHih9M8SCE0A9Ent1Sks5vDifqgaJpZM4ZfCtJ .

-- ____

David Jakubosky

NLM Biomedical Informatics Pre-Doctoral Fellow Biomedical Sciences Graduate Program Laboratory of Kelly A. Frazer, PhD Institute for Genomic Medicine, University of California at San Diego

tatarsky commented 5 years ago

Thank you. Shutting it down on fl-hn1 but will keep around if you did. Closing ticket. Just advise if you cease to need it but no big if you continue to use!