search

zenseact / zod

Software Development Kit for the Zenseact Open Dataset (ZOD)
https://zod.zenseact.com
MIT License
92 stars 13 forks source link

unable to unzip #56

Open zheyuanWang opened 3 weeks ago

zheyuanWang commented 3 weeks ago

Hi, I used torrrent to download the Frames part of the dataset. But get into a problem when unzipping files.

the size of downloaded files is like : 

total 4.0T
drwxrwxr-x 2 nobody nogroup   27 6月   4 20:22 ./
drwxrwxr-x 3 nobody nogroup    2 6月   4 20:25 ../
-rw-rw-r-- 1 nobody nogroup 1.4G 6月   4 20:22 annotations.tar.gz
-rw-rw-r-- 1 nobody nogroup 882M 6月   4 20:22 frames_mini.tar.gz
-rw-rw-r-- 1 nobody nogroup  45G 6月   4 20:38 images_front_blur.tar.gz
-rw-rw-r-- 1 nobody nogroup  45G 6月   4 20:54 images_front_dnat.tar.gz
...

I am wondering weather the images_front_dnat.tar.gz is properly downloaded. Is a special way of unzipping required?

tar -tzvf images_front_dnat.tar.gz 

gzip: stdin: not in gzip format
tar: Child returned status 1
tar: Error is not recoverable: exiting now
zheyuanWang commented 3 weeks ago

I also tried using 7z to unzip. But it didn't work

 7z l images_front_dnat.tar.gz

7-Zip [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21
p7zip Version 16.02 (locale=en_US.UTF-8,Utf16=on,HugeFiles=on,64 bits,16 CPUs AMD Ryzen 7 3700X 8-Core Processor              (870F10),ASM,AES-NI)

Scanning the drive for archives:
1 file, 48038878924 bytes (45 GiB)

Listing archive: images_front_dnat.tar.gz

ERROR: images_front_dnat.tar.gz : images_front_dnat.tar.gz
Open ERROR: Can not open the file as [gzip] archive

ERRORS:
Is not archive

Errors: 1
zheyuanWang commented 3 weeks ago

judging from the file-size, I guess the downloading is done

total 7.0T
drwxrwxr-x 2 nobody nogroup   27 6月   4 20:22 ./
drwxrwxr-x 3 nobody nogroup    2 6月   6 10:01 ../
-rw-rw-r-- 1 nobody nogroup 1.4G 6月   4 20:22 annotations.tar.gz
-rw-rw-r-- 1 nobody nogroup 882M 6月   4 20:22 frames_mini.tar.gz
-rw-rw-r-- 1 nobody nogroup  45G 6月   4 20:38 images_front_blur.tar.gz
-rw-rw-r-- 1 nobody nogroup  45G 6月   4 20:54 images_front_dnat.tar.gz
-rw-rw-r-- 1 nobody nogroup 574M 6月   4 20:55 infos.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   4 22:37 lidar_velodyne_01after.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   5 00:19 lidar_velodyne_01before.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   5 02:00 lidar_velodyne_02after.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   5 03:55 lidar_velodyne_02before.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   5 05:27 lidar_velodyne_03after.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   5 07:19 lidar_velodyne_03before.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   5 08:57 lidar_velodyne_04after.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   5 10:35 lidar_velodyne_04before.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   5 12:15 lidar_velodyne_05after.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   5 13:50 lidar_velodyne_05before.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   5 15:44 lidar_velodyne_06after.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   5 17:44 lidar_velodyne_06before.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   5 19:17 lidar_velodyne_07after.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   5 20:53 lidar_velodyne_07before.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   5 22:43 lidar_velodyne_08after.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   6 00:30 lidar_velodyne_08before.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   6 02:06 lidar_velodyne_09after.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   6 03:52 lidar_velodyne_09before.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   6 05:27 lidar_velodyne_10after.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   6 07:03 lidar_velodyne_10before.tar.gz
-rw-rw-r-- 1 nobody nogroup 332G 6月   6 08:52 lidar_velodyne_core.tar.gz
-rw-rw-r-- 1 nobody nogroup  52G 6月   6 09:05 oxts.tar.gz

the target file size from torrent:

Files:
idx|path/length
===+===========================================================================
  1|./frames/annotations.tar.gz
   |1.3GiB (1,453,421,071)
---+---------------------------------------------------------------------------
  2|./frames/frames_mini.tar.gz
   |881MiB (924,749,420)
---+---------------------------------------------------------------------------
  3|./frames/images_front_blur.tar.gz
   |44GiB (47,998,884,660)
---+---------------------------------------------------------------------------
  4|./frames/images_front_dnat.tar.gz
   |44GiB (48,038,878,924)
---+---------------------------------------------------------------------------
  5|./frames/infos.tar.gz
   |573MiB (601,138,843)
---+---------------------------------------------------------------------------
  6|./frames/lidar_velodyne_01after.tar.gz
   |331GiB (355,962,679,940)
---+---------------------------------------------------------------------------
  7|./frames/lidar_velodyne_01before.tar.gz
   |331GiB (355,895,481,362)
---+---------------------------------------------------------------------------
  8|./frames/lidar_velodyne_02after.tar.gz
   |331GiB (355,962,885,112)
---+---------------------------------------------------------------------------
  9|./frames/lidar_velodyne_02before.tar.gz
   |331GiB (356,000,150,448)
---+---------------------------------------------------------------------------
 10|./frames/lidar_velodyne_03after.tar.gz
   |331GiB (355,841,548,586)
---+---------------------------------------------------------------------------
 11|./frames/lidar_velodyne_03before.tar.gz
   |331GiB (355,847,710,664)
---+---------------------------------------------------------------------------
 12|./frames/lidar_velodyne_04after.tar.gz
   |331GiB (355,883,273,284)
---+---------------------------------------------------------------------------
 13|./frames/lidar_velodyne_04before.tar.gz
   |331GiB (355,992,452,796)
---+---------------------------------------------------------------------------
 14|./frames/lidar_velodyne_05after.tar.gz
   |331GiB (355,801,205,036)
---+---------------------------------------------------------------------------
 15|./frames/lidar_velodyne_05before.tar.gz
   |331GiB (356,078,569,262)
---+---------------------------------------------------------------------------
 16|./frames/lidar_velodyne_06after.tar.gz
   |331GiB (355,782,727,886)
---+---------------------------------------------------------------------------
 17|./frames/lidar_velodyne_06before.tar.gz
   |331GiB (355,988,504,049)
---+---------------------------------------------------------------------------
 18|./frames/lidar_velodyne_07after.tar.gz
   |331GiB (355,771,648,649)
---+---------------------------------------------------------------------------
 19|./frames/lidar_velodyne_07before.tar.gz
   |331GiB (355,989,622,146)
---+---------------------------------------------------------------------------
 20|./frames/lidar_velodyne_08after.tar.gz
   |331GiB (355,748,935,995)
---+---------------------------------------------------------------------------
 21|./frames/lidar_velodyne_08before.tar.gz
   |331GiB (356,061,059,820)
---+---------------------------------------------------------------------------
 22|./frames/lidar_velodyne_09after.tar.gz
   |331GiB (355,779,772,823)
---+---------------------------------------------------------------------------
 23|./frames/lidar_velodyne_09before.tar.gz
   |331GiB (356,071,802,007)
---+---------------------------------------------------------------------------
 24|./frames/lidar_velodyne_10after.tar.gz
   |331GiB (355,795,439,161)
---+---------------------------------------------------------------------------
 25|./frames/lidar_velodyne_10before.tar.gz
   |331GiB (356,094,795,400)
---+---------------------------------------------------------------------------
 26|./frames/lidar_velodyne_core.tar.gz
   |331GiB (355,938,360,229)
---+---------------------------------------------------------------------------
 27|./frames/oxts.tar.gz
   |51GiB (55,663,382,614)
---+---------------------------------------------------------------------------
wljungbergh commented 3 weeks ago

Hi,

Can you try to run tar -xvf images_front_dnat.tar.gz instead?