henrysher / duplicity

mirror of duplicity: https://code.launchpad.net/duplicity
81 stars 13 forks source link

Runs out of disk space trying to list files #27

Open RenaKunisaki opened 3 years ago

RenaKunisaki commented 3 years ago

I want to see how many files are backed up from yesterday:

duplicity list-current-files --time 1D rsync://xxxxx@xxxxx//mnt/backup/guilmon | less
Synchronizing remote metadata to local cache...
Copying duplicity-full-signatures.20200101T203804Z.sigtar.gz to local cache.
Traceback (innermost last):
  File "/usr/bin/duplicity", line 104, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 90, in with_tempdir
    fn()
  File "/usr/lib/python3.9/site-packages/duplicity/dup_main.py", line 1535, in main
    do_backup(action)
  File "/usr/lib/python3.9/site-packages/duplicity/dup_main.py", line 1561, in do_backup
    sync_archive(col_stats)
  File "/usr/lib/python3.9/site-packages/duplicity/dup_main.py", line 1343, in sync_archive
    copy_to_local(fn)
  File "/usr/lib/python3.9/site-packages/duplicity/dup_main.py", line 1291, in copy_to_local
    gpg.GzipWriteFile(src_iter, tdp.name, size=sys.maxsize)
  File "/usr/lib/python3.9/site-packages/duplicity/gpg.py", line 455, in GzipWriteFile
    outfile.write(new_block.data)
  File "/usr/lib/python3.9/gzip.py", line 288, in write
    self.fileobj.write(self.compress.compress(data))
  File "/usr/lib/python3.9/site-packages/duplicity/gpg.py", line 431, in write
    result = self.fileobj.write(buf)
 OSError: [Errno 28] No space left on device

It takes several hours to reach this point. I'm not sure which device it's referring to since none of the disks are full (I suppose it deleted whatever it had been writing when it failed?) or why it needs to do that.

RenaKunisaki commented 3 years ago

So I mounted a scratch disk to use as a temporary directory, and it seems like every operation makes it sync the entire cache every time.