rakyll / drive

Pull or push Google Drive files

471 stars 507 forks source link

Drive Push command repeats files when recursive #29

Open CountryBumkin opened 9 years ago

CountryBumkin commented 9 years ago

I am using drive to push a folder tree recursively to backup files. However each run will detect some already pushed files as requiring upload again, sometimes hundreds of files are involved.

For example on Linux Mint 17 64 bit using drive from both April 2014 and today and this script...

!/bin/sh -x

exec > ~/edev/drive/Gdrive.log
exec 2>&1

date drive push -r -no-prompt ~/gd/test1 echo "N" | drive push -r ~/gd/test1 date exit

The log file contains...

date Sun Nov 16 12:30:35 AEST 2014
drive push -r -no-prompt /home/zzzz/gd/test1 Resolving... [32m+[0m /gd/test1 [32m+[0m /gd/test1/IDCJCM0036_040282.csv [32m+[0m /gd/test1/IDCJDW4081.200701.csv [32m+[0m /gd/test1/IDCJDW4081.200702.csv [32m+[0m /gd/test1/IDCJDW4081.200703.csv [32m+[0m /gd/test1/IDCJDW4081.200704.csv [32m+[0m /gd/test1/IDCJDW4081.200705.csv [32m+[0m /gd/test1/IDCJDW4081.200706.csv [32m+[0m /gd/test1/IDCJDW4081.200707.csv [32m+[0m /gd/test1/IDCJDW4081.200708.csv [32m+[0m /gd/test1/IDCJDW4081.200709.csv [32m+[0m /gd/test1/IDCJDW4081.200710.csv [32m+[0m /gd/test1/IDCJDW4081.200711.csv [32m+[0m /gd/test1/IDCJDW4081.200712.csv [32m+[0m /gd/test1/IDCJDW4091.200701.csv [32m+[0m /gd/test1/IDCJDW4091.200702.csv [32m+[0m /gd/test1/IDCJDW4091.200703.csv [32m+[0m /gd/test1/IDCJDW4091.200704.csv [32m+[0m /gd/test1/IDCJDW4091.200705.csv [32m+[0m /gd/test1/IDCJDW4091.200706.csv [32m+[0m /gd/test1/IDCJDW4091.200707.csv [32m+[0m /gd/test1/IDCJDW4091.200708.csv [32m+[0m /gd/test1/IDCJDW4091.200709.csv [32m+[0m /gd/test1/IDCJDW4091.200710.csv [32m+[0m /gd/test1/IDCJDW4091.200711.csv [32m+[0m /gd/test1/IDCJDW4091.200712.csv [32m+[0m /gd/test1/IDCJDW4091.200801.csv [32m+[0m /gd/test1/IDCJDW4091.200802.csv [32m+[0m /gd/test1/IDCJDW4091.200803.csv [32m+[0m /gd/test1/IDCJDW4091.200804.csv [32m+[0m /gd/test1/IDCJDW4091.200805.csv [32m+[0m /gd/test1/IDCJDW4091.200806.csv [32m+[0m /gd/test1/IDCJDW4091.200807.csv [32m+[0m /gd/test1/IDCJDW4091.200808.csv [32m+[0m /gd/test1/IDCJDW4091.200809.csv [32m+[0m /gd/test1/IDCJDW4091.200810.csv [32m+[0m /gd/test1/IDCJDW4091.200811.csv [32m+[0m /gd/test1/IDCJDW4091.200812.csv [32m+[0m /gd/test1/IDCJDW4091.200901.csv [32m+[0m /gd/test1/IDCJDW4091.200902.csv [32m+[0m /gd/test1/IDCJDW4091.200903.csv [32m+[0m /gd/test1/IDCJDW4091.200904.csv [32m+[0m /gd/test1/IDCJDW4091.200905.csv [32m+[0m /gd/test1/IDCJDW4091.200906.csv [32m+[0m /gd/test1/IDCJDW4091.200907.csv [32m+[0m /gd/test1/IDCJDW4091.200908.csv [32m+[0m /gd/test1/IDCJDW4091.200909.csv [32m+[0m /gd/test1/IDCJDW4091.200910.csv [32m+[0m /gd/test1/IDCJDW4091.200911.csv [32m+[0m /gd/test1/IDCJDW4091.200912.csv [32m+[0m /gd/test1/IDCJDW4091.201201.csv [32m+[0m /gd/test1/IDCJDW4091.201202.csv [32m+[0m /gd/test1/IDCJDW4091.201203.csv [32m+[0m /gd/test1/IDCJDW4091.201204.csv [32m+[0m /gd/test1/IDCJDW4091.201205.csv [32m+[0m /gd/test1/IDCJDW4091.201206.csv [32m+[0m /gd/test1/IDCJDW4091.201207.csv [32m+[0m /gd/test1/IDCJDW4091.201208.csv [32m+[0m /gd/test1/IDCJDW4091.201209.csv [32m+[0m /gd/test1/IDCJDW4091.201210.csv [32m+[0m /gd/test1/IDCJDW4091.201211.csv [32m+[0m /gd/test1/IDCJDW4091.201212.csv [32m+[0m /gd/test1/IDCJDW4091.201301.csv [32m+[0m /gd/test1/IDCJDW4091.201302.csv [32m+[0m /gd/test1/IDCJDW4091.201303.csv [32m+[0m /gd/test1/IDCJDW4091.201304.csv [32m+[0m /gd/test1/IDCJDW4091.201305.csv [32m+[0m /gd/test1/IDCJDW4091.201306.csv [32m+[0m /gd/test1/IDCJDW4091.201307.csv [32m+[0m /gd/test1/IDCJDW4091.201308.csv [32m+[0m /gd/test1/IDCJDW4091.201309.csv [32m+[0m /gd/test1/IDCJDW4091.201310.csv [32m+[0m /gd/test1/IDCJDW4091.201312.csv [32m+[0m /gd/test1/IDCJDW4118.200701.csv [32m+[0m /gd/test1/IDCJDW4118.200702.csv [32m+[0m /gd/test1/IDCJDW4118.200703.csv [32m+[0m /gd/test1/IDCJDW4118.200704.csv [32m+[0m /gd/test1/IDCJDW4118.200705.csv [32m+[0m /gd/test1/IDCJDW4118.200706.csv [32m+[0m /gd/test1/IDCJDW4118.200707.csv [32m+[0m /gd/test1/IDCJDW4118.200708.csv [32m+[0m /gd/test1/IDCJDW4118.200709.csv [32m+[0m /gd/test1/IDCJDW4118.200710.csv [32m+[0m /gd/test1/IDCJDW4118.200711.csv [32m+[0m /gd/test1/IDCJDW4118.200712.csv 0 / 85 [---------------------------------------------------------------] 0.00 % 1 / 85 [>---------------------------------------------------------] 1.18 % 2m31s 2 / 85 [=>---------------------------------------------------------] 2.35 % 3m2s 3 / 85 [==>-------------------------------------------------------] 3.53 % 4m17s 4 / 85 [==>--------------------------------------------------------] 4.71 % 4m3s 5 / 85 [===>------------------------------------------------------] 5.88 % 3m50s 6 / 85 [====>-----------------------------------------------------] 7.06 % 3m41s 7 / 85 [====>-----------------------------------------------------] 8.24 % 3m47s 8 / 85 [=====>----------------------------------------------------] 9.41 % 3m41s 9 / 85 [======>--------------------------------------------------] 10.59 % 3m32s 10 / 85 [======>-------------------------------------------------] 11.76 % 3m40s 11 / 85 [=======>------------------------------------------------] 12.94 % 3m34s 12 / 85 [=======>------------------------------------------------] 14.12 % 3m30s 13 / 85 [========>-----------------------------------------------] 15.29 % 3m27s 14 / 85 [=========>----------------------------------------------] 16.47 % 3m24s 15 / 85 [==========>----------------------------------------------] 17.65 % 4m5s 16 / 85 [==========>---------------------------------------------] 18.82 % 3m59s

[snip boring lines]

83 / 85 [=========================================================>-] 97.65 % 5s 84 / 85 [===========================================================] 98.82 % 2s 85 / 85 [=======================================================] 100.00 % 4m11s

echo N
drive push -r /home/zzzz/gd/test1 Resolving... [33mM[0m /gd/test1/IDCJDW4091.200701.csv Proceed with the changes? [Y/n]: + date Sun Nov 16 12:34:56 AEST 2014
exit

The first run of drive correctly uploads the list of files but a second run immediately afterward wants to repeat one of the files, on some occasions hundreds of files from the directory tree.

Regards C Bumkin

odeke-em commented 9 years ago

Thanks for reporting this. This is most likely going to be fixed when #28 is merged in. Please watch the repo for a notification when the merge is made or I'll ping you up once it is in.