search

datalad / datalad-ria

Adds functionality for RIA stores to DataLad
http://datalad.org
Other
0 stars 1 forks source link

Support for SFTP as a RIA store? #100

Open oesteban opened 1 year ago

oesteban commented 1 year ago

What is the problem?

We have a "secure" (just for the admins, TBH) system where scp has been disabled and only SFTP transfers are allowed.

Is it possible to set it up as a RIA store? It seems SFTP is not supported by git-annex as a special remote so I'm worried that the short answer is no.

What steps will reproduce the problem?

No response

DataLad information

Latest datalad

Additional context

No response

Have you had any success using DataLad before?

Lots -thanks for this tool

adswa commented 1 year ago

Hey! At the moment this is not possible indeed - sorry.

However, I'm transferring this issue into a different repository, where we are currently re-implementing everything relating to RIA, and plan to base it on a more flexible special remote base. While this base currently isn't handling ftp/sftp we at least know which hurdles we have to solve to make it possible, so it might be possible at some point. In that sense, thanks for the feature request!

adswa commented 1 year ago

I think a comment of mine got lost in transfer, or it is delayed. I'm reposting it in case it doesn't show up:

Hey! At the moment this is not possible indeed - sorry.

However, I'm transferring this issue into a different repository, where we are currently re-implementing everything relating to RIA, and plan to base it on a more flexible special remote base. While this base currently isn't handling ftp/sftp we at least know which hurdles we have to solve to make it possible, so it might be possible at some point. In that sense, thanks for the feature request!

oesteban commented 1 year ago

I see the comment twice :)

Thanks much!

In the meantime, do you think a solution with other software (http://git-annex.branchable.com/todo/add_sftp_special_remote/#comment-05afdee4824ee6d4dcc65a8a753f0bb6) would work?

mih commented 1 year ago

With this development here, it should be relatively straightforward to add sftp support. If things work out as planned, this would mean adding a handler for this protocol in this framework: https://github.com/datalad/datalad-next/tree/main/datalad_next/url_operations

There should then be nothing RIA-specific about it anymore.

We should see how this goes in a short while.

oesteban commented 1 year ago

With this development here, it should be relatively straightforward to add sftp support. If things work out as planned, this would mean adding a handler for this protocol in this framework: https://github.com/datalad/datalad-next/tree/main/datalad_next/url_operations

If I understand URL operations properly, this would allow retrieving data, but the pushing data operation would not be supported unless a RIA storage is developed, correct?

We should see how this goes in a short while

What is the time scale of this "short while" ? :D