stharrold / ARCHIVED_irods_module_iplant

IRODS module for iPlant collaboration.
MIT License
0 stars 0 forks source link

rules/core.re: irsync, iget truncates file output #16

Closed stharrold closed 9 years ago

stharrold commented 9 years ago

irsync and iget don't finish downloading files before process is terminated. The last file copied is cut short. Is this a concurrency issue?

in core.re:

# ORIGINAL:
# acBulkPutPostProcPolicy { msiSetBulkPutPostProcPolicy("off"); }
# IPLANT:
acBulkPutPostProcPolicy { msiSetBulkPutPostProcPolicy("on"); }

terminal output:

ubuntu@20140918t192000-irodsv331:~$ # Use the iPlant version of `core.re` from following `INSTALL.md`.
ubuntu@20140918t192000-irodsv331:~$ date
Thu Dec 11 03:47:40 UTC 2014
ubuntu@20140918t192000-irodsv331:~$ irsync -r $REPO/iplant/test i:$IPLANT
ubuntu@20140918t192000-irodsv331:~$ irsync -r i:$IPLANT $TMP_IPLANT
ubuntu@20140918t192000-irodsv331:~$ diff $REPO/iplant/test $TMP_IPLANT # Only $TMP_IPLANT has iplant.log. test1.fastq and test2.fastq should be common to both directories and identical.
Only in /tmp/iplant: iplant.log
diff /home/ubuntu/irods_module_iplant/iplant/test/test1.fastq /tmp/iplant/test1.fastq
4c4
< B7BF<BBFFBFFFIFIIIIBFB<FFFIFFFFFFBFFF<F0BFBBFFF<BFFFBBF7BF<FFBFFFIIBFFFFB7<<BBFFBBB<<<<BBBBB<BBBBBB07

---
> B7BF<BBFFBFFFIFIIIIBFB<FFFIFFFFFFBFFF<F0BFBBFFF<
\ No newline at end of file
diff /home/ubuntu/irods_module_iplant/iplant/test/test2.fastq /tmp/iplant/test2.fastq
4c4
< #0<FFFFFFFFFFIIIIIIFFIFIIIIIIIIIIIIIIIIIIFFIIIIIFIIIIIIIIIIIIIIIIIIIIIIIBFIFFIFFFFFFFFFFFBFFFBFBFBBB<

---
> #0<FFFFFFFFFFIIIIIIFFIFIIIIIIIIIIIIIIII
\ No newline at end of file
ubuntu@20140918t192000-irodsv331:~$ irm -f $IPLANT/test1.fastq $IPLANT/test2.fastq
ubuntu@20140918t192000-irodsv331:~$ rm -f $TMP_IPLANT/*.fastq
ubuntu@20140918t192000-irodsv331:~$ date
Thu Dec 11 03:47:46 UTC 2014
ubuntu@20140918t192000-irodsv331:~$ # Read `$IRODS/server/log/rodsLog.YYYY.MM.DD` between the timestamps from `date` to check execution.
ubuntu@20140918t192000-irodsv331:~$ # Read `$IPLANT_LOG` between the timestamps from `date` to check execution.

Same problem happens with iget.

stharrold commented 9 years ago

overlap with #17