VUIIS / dax

Distributed Automation for XNAT
MIT License
25 stars 24 forks source link

Testing if zipping whole directory instead of asterisk helps with the… #418

Open KarthikMasi opened 1 year ago

KarthikMasi commented 1 year ago

… 'argument list too long' problem. @baxpr this is very much in testing. Not ready for pulling yet. Pull request for the sake of having conversations.

baxpr commented 1 year ago

Sounds like that might do it yeah. I can test in the context of the workflow I'm working on

KarthikMasi commented 1 year ago

The extraction of the zip file on XNAT's side failed with this. I am trying an alternate approach using find and piping to zip. Will push that once my test is done.

KarthikMasi commented 1 year ago

My uploads are slow but the tests are on-going

baxpr commented 1 year ago

FYI we can't assume anything about filenames (like *.dcm). If you settle on the find strategy it needs to be something like find ${dir} -type f. But you may also be able to use the dir name in the zip command line instead of filenames (*).