try to avoid backup issues

[GoogleCodeExporter]

I've noticed that backing up many small files is very slow:

for example:

/export/uec-gs1/laird/users/huydinh/TCGA_analysis/Epityping/0913/

contains about 3 million very small files and takes forever to rsync

since it is in users/, it gets checked and backed up to gastorage3 on a regular 
basis. 

can we skip backing it up, or if it is indeed critical, can the structure be 
organized to reduce # files, ie tar it up, or move to sqlite etc

Original issue reported on code.google.com by zack...@gmail.com on 8 Oct 2013 at 10:16

[GoogleCodeExporter]

sync of data still not complete, so had to skip 
/export/uec-gs1/laird/users/huydinh/TCGA_analysis/Epityping from backup. 

Original comment by zack...@gmail.com on 9 Oct 2013 at 7:50

[GoogleCodeExporter]

Hi Zack,

yes, I will process those files asap.
just skip backup those folders for now.

Thanks a lot and sorry for late reply!
Huy

Original comment by huy.q.d...@gmail.com on 9 Oct 2013 at 7:52

[GoogleCodeExporter]

yeah thats fine, we can take care of it next week

Original comment by zack...@gmail.com on 9 Oct 2013 at 7:54

[GoogleCodeExporter]

Original comment by zack...@gmail.com on 12 Feb 2014 at 9:49

• Changed state: Done