Open dmkl opened 1 year ago
Please confirm if the mod_zip generated files are actually in zip64 format. From a quick look at the code, mod_zip only uses zip64 if the file size is > 4GB. If you have zip64 file encoded using the data descriptor method (stream) that works in Xiaomi, please upload it here, then it would be easier to debug the issue.
Yes, we are talking about 4Gb+ files that mod_zip streams as zip64. I've attached smaller files just as an example, because the problem is reproducible with them both with the native Xiaomi-phones archiver utility and with zipdetails
.
I meant, I want a file that works in Xiaomi, I am assuming the above one is not working in Xiaomi?
Sorry for the confusion. All mod_zip
files are working on Xiaomi, test.zip works on Xiaomi as well, test_zip64.zip doesn't work on Xiaomi.
Broken zstream
s zip64 files (both under and over 4Gb) either do not unpack on Xiaomi or extract files with 0 bytes content like on the screenshot below.
All mod_zip files are working on Xiaomi, test.zip works on Xiaomi as well, test_zip64.zip doesn't work on Xiaomi.
I want a zip64 file (with data descriptor encoding) that works on Xiaomi. The test.zip is non zip64 file generated by zstream.
I built the mod_zip locally and modified it to use zip64 for all file sizes. Since it knows the file size, it is setting the correct size in the local header itself
0031 Extra ID #0002 0001 'ZIP64'
0033 Length 0010
0035 Uncompressed Size 000000000000000A
003D Compressed Size 000000000000000A
This is not possible in zstream case, as it works on stream abstraction and doesn't know the file size. Full output below
0000 LOCAL HEADER #1 04034B50
0004 Extract Zip Spec 2D '4.5'
0005 Extract OS 00 'MS-DOS'
0006 General Purpose Flag 0808
[Bit 3] 1 'Streamed'
[Bit 11] 1 'Language Encoding'
0008 Compression Method 0000 'Stored'
000A Last Mod Time 5638780B 'Tue Jan 24 20:30:22 2023'
000E CRC 00000000
0012 Compressed Length FFFFFFFF
0016 Uncompressed Length FFFFFFFF
001A Filename Length 0006
001C Extra Length 0021
001E Filename '10.txt'
0024 Extra ID #0001 5455 'UT: Extended Timestamp'
0026 Length 0009
0028 Flags '03 mod access'
0029 Mod Time 63CFF287 'Tue Jan 24 20:30:23 2023'
002D Access Time 63CFF287 'Tue Jan 24 20:30:23 2023'
0031 Extra ID #0002 0001 'ZIP64'
0033 Length 0010
0035 Uncompressed Size 000000000000000A
003D Compressed Size 000000000000000A
0045 PAYLOAD 123456789.
004F STREAMING DATA HEADER 08074B50
0053 CRC E0117757
0057 Compressed Length 000000000000000A
005F Uncompressed Length 000000000000000A
0067 CENTRAL HEADER #1 02014B50
006B Created Zip Spec 2D '4.5'
006C Created OS 00 'MS-DOS'
006D Extract Zip Spec 2D '4.5'
006E Extract OS 00 'MS-DOS'
006F General Purpose Flag 0808
[Bit 3] 1 'Streamed'
[Bit 11] 1 'Language Encoding'
0071 Compression Method 0000 'Stored'
0073 Last Mod Time 5638780B 'Tue Jan 24 20:30:22 2023'
0077 CRC E0117757
007B Compressed Length FFFFFFFF
007F Uncompressed Length FFFFFFFF
0083 Filename Length 0006
0085 Extra Length 001D
0087 Comment Length 0000
0089 Disk Start 0000
008B Int File Attributes 0000
[Bit 0] 0 'Binary Data'
008D Ext File Attributes 081A4000
0091 Local Header Offset 00000000
0095 Filename '10.txt'
009B Extra ID #0001 5455 'UT: Extended Timestamp'
009D Length 0005
009F Flags '03 mod access'
00A0 Mod Time 63CFF287 'Tue Jan 24 20:30:23 2023'
00A4 Extra ID #0002 0001 'ZIP64'
00A6 Length 0010
00A8 Uncompressed Size 000000000000000A
00B0 Compressed Size 000000000000000A
00B8 ZIP64 END CENTRAL DIR 06064B50
RECORD
00BC Size of record 000000000000002C
00C4 Created Zip Spec 2D '4.5'
00C5 Created OS 00 'MS-DOS'
00C6 Extract Zip Spec 2D '4.5'
00C7 Extract OS 00 'MS-DOS'
00C8 Number of this disk 00000000
00CC Central Dir Disk no 00000000
00D0 Entries in this disk 0000000000000001
00D8 Total Entries 0000000000000001
00E0 Size of Central Dir 0000000000000051
00E8 Offset to Central dir 0000000000000067
00F0 ZIP64 END CENTRAL DIR 07064B50
LOCATOR
00F4 Central Dir Disk no 00000000
00F8 Offset to Central dir 00000000000000B8
0100 Total no of Disks 00000001
0104 END CENTRAL HEADER 06054B50
0108 Number of this disk 0000
010A Central Dir Disk no 0000
010C Entries in this disk 0001
010E Total Entries 0001
0110 Size of Central Dir 00000051
0114 Offset to Central Dir 00000067
0118 Comment Length 0000
Done
Here are some more examples:
Working file from mod_zip
https://dmkl.s3.eu-west-1.amazonaws.com/zip/4gb_mod_zip.zip (works on Xiaomi)
Broken file with the same content from zstream
https://dmkl.s3.eu-west-1.amazonaws.com/zip/4gb_zstream.zip
Is there a way to extend zstream
in the similar manner to fix the issue if we know file sizes upfront?
could you check if any of the following variation works?
Is there a way to extend zstream in the similar manner to fix the issue if we know file sizes upfront?
if crc and size available, this is possible, but might require a bit of work on zstream side
None of the three work on Xiaomi :\
We have the CRC and the size for all files. It would be fantastic to support this case!
if CRC and file size are available, and the coder is Zstream.Coder.Stored, then yes, it should be possible to drop the data descriptor and put all the details in the local header itself. I will see if I can get something out this weekend
Thanks a lot! Looking forward to it. Please let me know if I can help with anything.
could you try https://github.com/ananthakumaran/zstream/pull/19
Archives > 4Gb are still broken on Xiaomi 😢 zipdetails
shows this error:
▶ zipdetails ~/Desktop/4Gb.zip
000000000 PREFIX DATA
Unexpecded END at offset FFFFFFFF, value 00000000
Done
Here is a test archive https://take.ms/Z58ua
@dmkl I have pushed some changes which seem to remove the warnings messages I used to get on zipdetails. Can you give it another try. If it doesn't work, I need to find a way to run Xiaomi or something equivalent so I can test it.
Thanks for another attempt! It didn't fix the issue, unfortunatelly 😕 All is the same. Here is a test archive. Please let me know if I can help with any other tests or info.
Working file from mod_zip https://dmkl.s3.eu-west-1.amazonaws.com/zip/4gb_mod_zip.zip (works on Xiaomi)
I checked this file, you can find the zipdetails output below. This is not a zip64 file. My guess is, Xiaomi doesn't support zip64 at all? As per zip spec, zip64 is really needed if size/offset used in the file exceeds the 32 bit range. I am guessing, in this case individual file size didn't exceed 32 bit range and mod_zip decided to not use zip64. Anyways, We need to verify if Xioami archive utility supports zip64 at all. Also, is this something I can download? I have android phone and can check it, but can't figure out how to get the utility. Google search doesn't return anything useful.
000000000 LOCAL HEADER #1 04034B50
000000004 Extract Zip Spec 0A '1.0'
000000005 Extract OS 00 'MS-DOS'
000000006 General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
000000008 Compression Method 0000 'Stored'
00000000A Last Mod Time 56387526 'Tue Jan 24 20:11:12 2023'
00000000E CRC 7470E6F5
000000012 Compressed Length 079381AC
000000016 Uncompressed Length 079381AC
00000001A Filename Length 002B
00000001C Extra Length 000D
00000001E Filename '4gb/VM/VirtualBox-7.0.6-155176-
SunOS.tar.gz'
000000049 Extra ID #0001 5455 'UT: Extended Timestamp'
00000004B Length 0009
00000004D Flags '03 mod access'
00000004E Mod Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
000000052 Access Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
000000056 PAYLOAD
007938202 LOCAL HEADER #2 04034B50
007938206 Extract Zip Spec 0A '1.0'
007938207 Extract OS 00 'MS-DOS'
007938208 General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
00793820A Compression Method 0000 'Stored'
00793820C Last Mod Time 56387526 'Tue Jan 24 20:11:12 2023'
007938210 CRC 2856AEE9
007938214 Compressed Length 0005A188
007938218 Uncompressed Length 0005A188
00793821C Filename Length 001D
00793821E Extra Length 000D
007938220 Filename '4gb/VM/imager_1.7.3_amd64.deb'
00793823D Extra ID #0001 5455 'UT: Extended Timestamp'
00793823F Length 0009
007938241 Flags '03 mod access'
007938242 Mod Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
007938246 Access Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
00793824A PAYLOAD
0079923D2 LOCAL HEADER #3 04034B50
0079923D6 Extract Zip Spec 0A '1.0'
0079923D7 Extract OS 00 'MS-DOS'
0079923D8 General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
0079923DA Compression Method 0000 'Stored'
0079923DC Last Mod Time 56387526 'Tue Jan 24 20:11:12 2023'
0079923E0 CRC 8B7D71B1
0079923E4 Compressed Length 07979800
0079923E8 Uncompressed Length 07979800
0079923EC Filename Length 002A
0079923EE Extra Length 000D
0079923F0 Filename '4gb/VM/VirtualBox-7.0.6-155176-
Solaris.p5p'
00799241A Extra ID #0001 5455 'UT: Extended Timestamp'
00799241C Length 0009
00799241E Flags '03 mod access'
00799241F Mod Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
007992423 Access Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
007992427 PAYLOAD
00F30BC27 LOCAL HEADER #4 04034B50
00F30BC2B Extract Zip Spec 0A '1.0'
00F30BC2C Extract OS 00 'MS-DOS'
00F30BC2D General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
00F30BC2F Compression Method 0000 'Stored'
00F30BC31 Last Mod Time 56387526 'Tue Jan 24 20:11:12 2023'
00F30BC35 CRC 7A24D4FC
00F30BC39 Compressed Length 0580F63C
00F30BC3D Uncompressed Length 0580F63C
00F30BC41 Filename Length 0039
00F30BC43 Extra Length 000D
00F30BC45 Filename '4gb/VM/virtualbox-7.0_7.0.6-
155176~Ubuntu~jammy_amd64.deb'
00F30BC7E Extra ID #0001 5455 'UT: Extended Timestamp'
00F30BC80 Length 0009
00F30BC82 Flags '03 mod access'
00F30BC83 Mod Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
00F30BC87 Access Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
00F30BC8B PAYLOAD
014B1B2C7 LOCAL HEADER #5 04034B50
014B1B2CB Extract Zip Spec 0A '1.0'
014B1B2CC Extract OS 00 'MS-DOS'
014B1B2CD General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
014B1B2CF Compression Method 0000 'Stored'
014B1B2D1 Last Mod Time 56387526 'Tue Jan 24 20:11:12 2023'
014B1B2D5 CRC 84B89B9A
014B1B2D9 Compressed Length 06957008
014B1B2DD Uncompressed Length 06957008
014B1B2E1 Filename Length 0026
014B1B2E3 Extra Length 000D
014B1B2E5 Filename '4gb/VM/VirtualBox-7.0.6-155176-Win.exe'
014B1B30B Extra ID #0001 5455 'UT: Extended Timestamp'
014B1B30D Length 0009
014B1B30F Flags '03 mod access'
014B1B310 Mod Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
014B1B314 Access Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
014B1B318 PAYLOAD
01B472320 LOCAL HEADER #6 04034B50
01B472324 Extract Zip Spec 0A '1.0'
01B472325 Extract OS 00 'MS-DOS'
01B472326 General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
01B472328 Compression Method 0000 'Stored'
01B47232A Last Mod Time 56387526 'Tue Jan 24 20:11:12 2023'
01B47232E CRC DA2B6174
01B472332 Compressed Length 06F00BCA
01B472336 Uncompressed Length 06F00BCA
01B47233A Filename Length 0033
01B47233C Extra Length 000D
01B47233E Filename '4gb/VM/VirtualBox-7.0.6_BETA4-155176-
macOSArm64.dmg'
01B472371 Extra ID #0001 5455 'UT: Extended Timestamp'
01B472373 Length 0009
01B472375 Flags '03 mod access'
01B472376 Mod Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
01B47237A Access Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
01B47237E PAYLOAD
022372F48 LOCAL HEADER #7 04034B50
022372F4C Extract Zip Spec 0A '1.0'
022372F4D Extract OS 00 'MS-DOS'
022372F4E General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
022372F50 Compression Method 0000 'Stored'
022372F52 Last Mod Time 56387526 'Tue Jan 24 20:11:12 2023'
022372F56 CRC CE3A7E78
022372F5A Compressed Length E418D000
022372F5E Uncompressed Length E418D000
022372F62 Filename Length 002B
022372F64 Extra Length 000D
022372F66 Filename '4gb/Ubuntu/ubuntu-22.04.1-desktop-
amd64.iso'
022372F91 Extra ID #0001 5455 'UT: Extended Timestamp'
022372F93 Length 0009
022372F95 Flags '03 mod access'
022372F96 Mod Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
022372F9A Access Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
022372F9E PAYLOAD
1064FFF9E CENTRAL HEADER #1 02014B50
1064FFFA2 Created Zip Spec 2D '4.5'
1064FFFA3 Created OS 00 'MS-DOS'
1064FFFA4 Extract Zip Spec 0A '1.0'
1064FFFA5 Extract OS 00 'MS-DOS'
1064FFFA6 General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
1064FFFA8 Compression Method 0000 'Stored'
1064FFFAA Last Mod Time 56387526 'Tue Jan 24 20:11:12 2023'
1064FFFAE CRC 7470E6F5
1064FFFB2 Compressed Length 079381AC
1064FFFB6 Uncompressed Length 079381AC
1064FFFBA Filename Length 002B
1064FFFBC Extra Length 0009
1064FFFBE Comment Length 0000
1064FFFC0 Disk Start 0000
1064FFFC2 Int File Attributes 0000
[Bit 0] 0 'Binary Data'
1064FFFC4 Ext File Attributes 081A4000
1064FFFC8 Local Header Offset 00000000
1064FFFCC Filename '4gb/VM/VirtualBox-7.0.6-155176-
SunOS.tar.gz'
1064FFFF7 Extra ID #0001 5455 'UT: Extended Timestamp'
1064FFFF9 Length 0005
1064FFFFB Flags '03 mod access'
1064FFFFC Mod Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
106500000 CENTRAL HEADER #2 02014B50
106500004 Created Zip Spec 2D '4.5'
106500005 Created OS 00 'MS-DOS'
106500006 Extract Zip Spec 0A '1.0'
106500007 Extract OS 00 'MS-DOS'
106500008 General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
10650000A Compression Method 0000 'Stored'
10650000C Last Mod Time 56387526 'Tue Jan 24 20:11:12 2023'
106500010 CRC 2856AEE9
106500014 Compressed Length 0005A188
106500018 Uncompressed Length 0005A188
10650001C Filename Length 001D
10650001E Extra Length 0009
106500020 Comment Length 0000
106500022 Disk Start 0000
106500024 Int File Attributes 0000
[Bit 0] 0 'Binary Data'
106500026 Ext File Attributes 081A4000
10650002A Local Header Offset 07938202
10650002E Filename '4gb/VM/imager_1.7.3_amd64.deb'
10650004B Extra ID #0001 5455 'UT: Extended Timestamp'
10650004D Length 0005
10650004F Flags '03 mod access'
106500050 Mod Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
106500054 CENTRAL HEADER #3 02014B50
106500058 Created Zip Spec 2D '4.5'
106500059 Created OS 00 'MS-DOS'
10650005A Extract Zip Spec 0A '1.0'
10650005B Extract OS 00 'MS-DOS'
10650005C General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
10650005E Compression Method 0000 'Stored'
106500060 Last Mod Time 56387526 'Tue Jan 24 20:11:12 2023'
106500064 CRC 8B7D71B1
106500068 Compressed Length 07979800
10650006C Uncompressed Length 07979800
106500070 Filename Length 002A
106500072 Extra Length 0009
106500074 Comment Length 0000
106500076 Disk Start 0000
106500078 Int File Attributes 0000
[Bit 0] 0 'Binary Data'
10650007A Ext File Attributes 081A4000
10650007E Local Header Offset 079923D2
106500082 Filename '4gb/VM/VirtualBox-7.0.6-155176-
Solaris.p5p'
1065000AC Extra ID #0001 5455 'UT: Extended Timestamp'
1065000AE Length 0005
1065000B0 Flags '03 mod access'
1065000B1 Mod Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
1065000B5 CENTRAL HEADER #4 02014B50
1065000B9 Created Zip Spec 2D '4.5'
1065000BA Created OS 00 'MS-DOS'
1065000BB Extract Zip Spec 0A '1.0'
1065000BC Extract OS 00 'MS-DOS'
1065000BD General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
1065000BF Compression Method 0000 'Stored'
1065000C1 Last Mod Time 56387526 'Tue Jan 24 20:11:12 2023'
1065000C5 CRC 7A24D4FC
1065000C9 Compressed Length 0580F63C
1065000CD Uncompressed Length 0580F63C
1065000D1 Filename Length 0039
1065000D3 Extra Length 0009
1065000D5 Comment Length 0000
1065000D7 Disk Start 0000
1065000D9 Int File Attributes 0000
[Bit 0] 0 'Binary Data'
1065000DB Ext File Attributes 081A4000
1065000DF Local Header Offset 0F30BC27
1065000E3 Filename '4gb/VM/virtualbox-7.0_7.0.6-
155176~Ubuntu~jammy_amd64.deb'
10650011C Extra ID #0001 5455 'UT: Extended Timestamp'
10650011E Length 0005
106500120 Flags '03 mod access'
106500121 Mod Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
106500125 CENTRAL HEADER #5 02014B50
106500129 Created Zip Spec 2D '4.5'
10650012A Created OS 00 'MS-DOS'
10650012B Extract Zip Spec 0A '1.0'
10650012C Extract OS 00 'MS-DOS'
10650012D General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
10650012F Compression Method 0000 'Stored'
106500131 Last Mod Time 56387526 'Tue Jan 24 20:11:12 2023'
106500135 CRC 84B89B9A
106500139 Compressed Length 06957008
10650013D Uncompressed Length 06957008
106500141 Filename Length 0026
106500143 Extra Length 0009
106500145 Comment Length 0000
106500147 Disk Start 0000
106500149 Int File Attributes 0000
[Bit 0] 0 'Binary Data'
10650014B Ext File Attributes 081A4000
10650014F Local Header Offset 14B1B2C7
106500153 Filename '4gb/VM/VirtualBox-7.0.6-155176-Win.exe'
106500179 Extra ID #0001 5455 'UT: Extended Timestamp'
10650017B Length 0005
10650017D Flags '03 mod access'
10650017E Mod Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
106500182 CENTRAL HEADER #6 02014B50
106500186 Created Zip Spec 2D '4.5'
106500187 Created OS 00 'MS-DOS'
106500188 Extract Zip Spec 0A '1.0'
106500189 Extract OS 00 'MS-DOS'
10650018A General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
10650018C Compression Method 0000 'Stored'
10650018E Last Mod Time 56387526 'Tue Jan 24 20:11:12 2023'
106500192 CRC DA2B6174
106500196 Compressed Length 06F00BCA
10650019A Uncompressed Length 06F00BCA
10650019E Filename Length 0033
1065001A0 Extra Length 0009
1065001A2 Comment Length 0000
1065001A4 Disk Start 0000
1065001A6 Int File Attributes 0000
[Bit 0] 0 'Binary Data'
1065001A8 Ext File Attributes 081A4000
1065001AC Local Header Offset 1B472320
1065001B0 Filename '4gb/VM/VirtualBox-7.0.6_BETA4-155176-
macOSArm64.dmg'
1065001E3 Extra ID #0001 5455 'UT: Extended Timestamp'
1065001E5 Length 0005
1065001E7 Flags '03 mod access'
1065001E8 Mod Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
1065001EC CENTRAL HEADER #7 02014B50
1065001F0 Created Zip Spec 2D '4.5'
1065001F1 Created OS 00 'MS-DOS'
1065001F2 Extract Zip Spec 0A '1.0'
1065001F3 Extract OS 00 'MS-DOS'
1065001F4 General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
1065001F6 Compression Method 0000 'Stored'
1065001F8 Last Mod Time 56387526 'Tue Jan 24 20:11:12 2023'
1065001FC CRC CE3A7E78
106500200 Compressed Length E418D000
106500204 Uncompressed Length E418D000
106500208 Filename Length 002B
10650020A Extra Length 0009
10650020C Comment Length 0000
10650020E Disk Start 0000
106500210 Int File Attributes 0000
[Bit 0] 0 'Binary Data'
106500212 Ext File Attributes 081A4000
106500216 Local Header Offset 22372F48
10650021A Filename '4gb/Ubuntu/ubuntu-22.04.1-desktop-
amd64.iso'
106500245 Extra ID #0001 5455 'UT: Extended Timestamp'
106500247 Length 0005
106500249 Flags '03 mod access'
10650024A Mod Time 63CFEE09 'Tue Jan 24 20:11:13 2023'
10650024E ZIP64 END CENTRAL DIR 06064B50
RECORD
106500252 Size of record 000000000000002C
10650025A Created Zip Spec 2D '4.5'
10650025B Created OS 00 'MS-DOS'
10650025C Extract Zip Spec 2D '4.5'
10650025D Extract OS 00 'MS-DOS'
10650025E Number of this disk 00000000
106500262 Central Dir Disk no 00000000
106500266 Entries in this disk 0000000000000007
10650026E Total Entries 0000000000000007
106500276 Size of Central Dir 00000000000002B0
10650027E Offset to Central dir 00000001064FFF9E
106500286 ZIP64 END CENTRAL DIR 07064B50
LOCATOR
10650028A Central Dir Disk no 00000000
10650028E Offset to Central dir 000000010650024E
106500296 Total no of Disks 00000001
10650029A END CENTRAL HEADER 06054B50
10650029E Number of this disk 0000
1065002A0 Central Dir Disk no 0000
1065002A2 Entries in this disk 0007
1065002A4 Total Entries 0007
1065002A6 Size of Central Dir 000002B0
1065002AA Offset to Central Dir FFFFFFFF
1065002AE Comment Length 0000
Done
I've done another test.
1) Created an archive on my mac with two 4.7Gb files, so the file size and the offset exceed 32 bit range. This file has no problem on Xiaomi and everything opens fine. It seems that the Xiaomi util supports zip64 (maybe still not in a streaming fashion?)
2) Created a similar archive with mod_zip
and Xiaomi cannot handle it.
The fact that Xiaomi can handle mac's archive makes me think that it supports zip64. Wdyt?
Interesting, could you share the zipdetails -v
of the first file?
▶ zipdetails -v ~/Desktop/Linux_mod_zip.zip
000000000 000000004 50 4B 03 04 LOCAL HEADER #1 04034B50
000000004 000000001 2D Extract Zip Spec 2D '4.5'
000000005 000000001 00 Extract OS 00 'MS-DOS'
000000006 000000002 00 08 General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
000000008 000000002 00 00 Compression Method 0000 'Stored'
00000000A 000000004 D4 51 55 56 Last Mod Time 565551D4 'Tue Feb 21 10:14:40 2023'
00000000E 000000004 63 5E 34 7E CRC 7E345E63
000000012 000000004 FF FF FF FF Compressed Length FFFFFFFF
000000016 000000004 FF FF FF FF Uncompressed Length FFFFFFFF
00000001A 000000002 36 00 Filename Length 0036
00000001C 000000002 21 00 Extra Length 0021
00000001E 000000036 4C 69 6E 75 Filename 'Linux/Photos/OracleLinux-R7-U7-
78 2F 50 68 Server-x86_64-dvd_2.iso'
6F 74 6F 73
2F 4F 72 61
63 6C 65 4C
69 6E 75 78
2D 52 37 2D
55 37 2D 53
65 72 76 65
72 2D 78 38
36 5F 36 34
2D 64 76 64
5F 32 2E 69
73 6F
000000054 000000002 55 54 Extra ID #0001 5455 'UT: Extended Timestamp'
000000056 000000002 09 00 Length 0009
000000058 000000001 03 Flags '03 mod access'
000000059 000000004 91 99 F4 63 Mod Time 63F49991 'Tue Feb 21 13:14:41 2023'
00000005D 000000004 91 99 F4 63 Access Time 63F49991 'Tue Feb 21 13:14:41 2023'
000000061 000000002 01 00 Extra ID #0002 0001 'ZIP64'
000000063 000000002 10 00 Length 0010
000000065 000000008 00 00 20 1A Uncompressed Size 000000011A200000
01 00 00 00
00000006D 000000008 00 00 20 1A Compressed Size 000000011A200000
01 00 00 00
000000075 11A200000 ... PAYLOAD
11A200075 000000004 50 4B 03 04 LOCAL HEADER #2 04034B50
11A200079 000000001 2D Extract Zip Spec 2D '4.5'
11A20007A 000000001 00 Extract OS 00 'MS-DOS'
11A20007B 000000002 00 08 General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
11A20007D 000000002 00 00 Compression Method 0000 'Stored'
11A20007F 000000004 D4 51 55 56 Last Mod Time 565551D4 'Tue Feb 21 10:14:40 2023'
11A200083 000000004 63 5E 34 7E CRC 7E345E63
11A200087 000000004 FF FF FF FF Compressed Length FFFFFFFF
11A20008B 000000004 FF FF FF FF Uncompressed Length FFFFFFFF
11A20008F 000000002 34 00 Filename Length 0034
11A200091 000000002 21 00 Extra Length 0021
11A200093 000000034 4C 69 6E 75 Filename 'Linux/Photos/OracleLinux-R7-U7-
78 2F 50 68 Server-x86_64-dvd.iso'
6F 74 6F 73
2F 4F 72 61
63 6C 65 4C
69 6E 75 78
2D 52 37 2D
55 37 2D 53
65 72 76 65
72 2D 78 38
36 5F 36 34
2D 64 76 64
2E 69 73 6F
11A2000C7 000000002 55 54 Extra ID #0001 5455 'UT: Extended Timestamp'
11A2000C9 000000002 09 00 Length 0009
11A2000CB 000000001 03 Flags '03 mod access'
11A2000CC 000000004 91 99 F4 63 Mod Time 63F49991 'Tue Feb 21 13:14:41 2023'
11A2000D0 000000004 91 99 F4 63 Access Time 63F49991 'Tue Feb 21 13:14:41 2023'
11A2000D4 000000002 01 00 Extra ID #0002 0001 'ZIP64'
11A2000D6 000000002 10 00 Length 0010
11A2000D8 000000008 00 00 20 1A Uncompressed Size 000000011A200000
01 00 00 00
11A2000E0 000000008 00 00 20 1A Compressed Size 000000011A200000
01 00 00 00
11A2000E8 11A200000 ... PAYLOAD
2344000E8 000000004 50 4B 01 02 CENTRAL HEADER #1 02014B50
2344000EC 000000001 2D Created Zip Spec 2D '4.5'
2344000ED 000000001 00 Created OS 00 'MS-DOS'
2344000EE 000000001 2D Extract Zip Spec 2D '4.5'
2344000EF 000000001 00 Extract OS 00 'MS-DOS'
2344000F0 000000002 00 08 General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
2344000F2 000000002 00 00 Compression Method 0000 'Stored'
2344000F4 000000004 D4 51 55 56 Last Mod Time 565551D4 'Tue Feb 21 10:14:40 2023'
2344000F8 000000004 63 5E 34 7E CRC 7E345E63
2344000FC 000000004 FF FF FF FF Compressed Length FFFFFFFF
234400100 000000004 FF FF FF FF Uncompressed Length FFFFFFFF
234400104 000000002 36 00 Filename Length 0036
234400106 000000002 1D 00 Extra Length 001D
234400108 000000002 00 00 Comment Length 0000
23440010A 000000002 00 00 Disk Start 0000
23440010C 000000002 00 00 Int File Attributes 0000
[Bit 0] 0 'Binary Data'
23440010E 000000004 00 40 1A 08 Ext File Attributes 081A4000
234400112 000000004 00 00 00 00 Local Header Offset 00000000
234400116 000000036 4C 69 6E 75 Filename 'Linux/Photos/OracleLinux-R7-U7-
78 2F 50 68 Server-x86_64-dvd_2.iso'
6F 74 6F 73
2F 4F 72 61
63 6C 65 4C
69 6E 75 78
2D 52 37 2D
55 37 2D 53
65 72 76 65
72 2D 78 38
36 5F 36 34
2D 64 76 64
5F 32 2E 69
73 6F
23440014C 000000002 55 54 Extra ID #0001 5455 'UT: Extended Timestamp'
23440014E 000000002 05 00 Length 0005
234400150 000000001 03 Flags '03 mod access'
234400151 000000004 91 99 F4 63 Mod Time 63F49991 'Tue Feb 21 13:14:41 2023'
234400155 000000002 01 00 Extra ID #0002 0001 'ZIP64'
234400157 000000002 10 00 Length 0010
234400159 000000008 00 00 20 1A Uncompressed Size 000000011A200000
01 00 00 00
234400161 000000008 00 00 20 1A Compressed Size 000000011A200000
01 00 00 00
234400169 000000004 50 4B 01 02 CENTRAL HEADER #2 02014B50
23440016D 000000001 2D Created Zip Spec 2D '4.5'
23440016E 000000001 00 Created OS 00 'MS-DOS'
23440016F 000000001 2D Extract Zip Spec 2D '4.5'
234400170 000000001 00 Extract OS 00 'MS-DOS'
234400171 000000002 00 08 General Purpose Flag 0800
[Bit 11] 1 'Language Encoding'
234400173 000000002 00 00 Compression Method 0000 'Stored'
234400175 000000004 D4 51 55 56 Last Mod Time 565551D4 'Tue Feb 21 10:14:40 2023'
234400179 000000004 63 5E 34 7E CRC 7E345E63
23440017D 000000004 FF FF FF FF Compressed Length FFFFFFFF
234400181 000000004 FF FF FF FF Uncompressed Length FFFFFFFF
234400185 000000002 34 00 Filename Length 0034
234400187 000000002 25 00 Extra Length 0025
234400189 000000002 00 00 Comment Length 0000
23440018B 000000002 00 00 Disk Start 0000
23440018D 000000002 00 00 Int File Attributes 0000
[Bit 0] 0 'Binary Data'
23440018F 000000004 00 40 1A 08 Ext File Attributes 081A4000
234400193 000000004 FF FF FF FF Local Header Offset FFFFFFFF
234400197 000000034 4C 69 6E 75 Filename 'Linux/Photos/OracleLinux-R7-U7-
78 2F 50 68 Server-x86_64-dvd.iso'
6F 74 6F 73
2F 4F 72 61
63 6C 65 4C
69 6E 75 78
2D 52 37 2D
55 37 2D 53
65 72 76 65
72 2D 78 38
36 5F 36 34
2D 64 76 64
2E 69 73 6F
2344001CB 000000002 55 54 Extra ID #0001 5455 'UT: Extended Timestamp'
2344001CD 000000002 05 00 Length 0005
2344001CF 000000001 03 Flags '03 mod access'
2344001D0 000000004 91 99 F4 63 Mod Time 63F49991 'Tue Feb 21 13:14:41 2023'
2344001D4 000000002 01 00 Extra ID #0002 0001 'ZIP64'
2344001D6 000000002 18 00 Length 0018
2344001D8 000000008 00 00 20 1A Uncompressed Size 000000011A200000
01 00 00 00
2344001E0 000000008 00 00 20 1A Compressed Size 000000011A200000
01 00 00 00
2344001E8 000000008 75 00 20 1A Offset to Central 000000011A200075
01 00 00 00 Dir
2344001F0 000000004 50 4B 06 06 ZIP64 END CENTRAL DIR 06064B50
RECORD
2344001F4 000000008 2C 00 00 00 Size of record 000000000000002C
00 00 00 00
2344001FC 000000001 2D Created Zip Spec 2D '4.5'
2344001FD 000000001 00 Created OS 00 'MS-DOS'
2344001FE 000000001 2D Extract Zip Spec 2D '4.5'
2344001FF 000000001 00 Extract OS 00 'MS-DOS'
234400200 000000004 00 00 00 00 Number of this disk 00000000
234400204 000000004 00 00 00 00 Central Dir Disk no 00000000
234400208 000000008 02 00 00 00 Entries in this disk 0000000000000002
00 00 00 00
234400210 000000008 02 00 00 00 Total Entries 0000000000000002
00 00 00 00
234400218 000000008 08 01 00 00 Size of Central Dir 0000000000000108
00 00 00 00
234400220 000000008 E8 00 40 34 Offset to Central dir 00000002344000E8
02 00 00 00
234400228 000000004 50 4B 06 07 ZIP64 END CENTRAL DIR 07064B50
LOCATOR
23440022C 000000004 00 00 00 00 Central Dir Disk no 00000000
234400230 000000008 F0 01 40 34 Offset to Central dir 00000002344001F0
02 00 00 00
234400238 000000004 01 00 00 00 Total no of Disks 00000001
23440023C 000000004 50 4B 05 06 END CENTRAL HEADER 06054B50
234400240 000000002 00 00 Number of this disk 0000
234400242 000000002 00 00 Central Dir Disk no 0000
234400244 000000002 02 00 Entries in this disk 0002
234400246 000000002 02 00 Total Entries 0002
234400248 000000004 08 01 00 00 Size of Central Dir 00000108
23440024C 000000004 FF FF FF FF Offset to Central Dir FFFFFFFF
234400250 000000002 00 00 Comment Length 0000
Done
▶ zipdetails -v ~/Desktop/Linux_mac.zip
000000000 000000004 50 4B 03 04 LOCAL HEADER #1 04034B50
000000004 000000001 14 Extract Zip Spec 14 '2.0'
000000005 000000001 00 Extract OS 00 'MS-DOS'
000000006 000000002 00 00 General Purpose Flag 0000
000000008 000000002 00 00 Compression Method 0000 'Stored'
00000000A 000000004 38 91 55 56 Last Mod Time 56559138 'Tue Feb 21 18:09:48 2023'
00000000E 000000004 00 00 00 00 CRC 00000000
000000012 000000004 00 00 00 00 Compressed Length 00000000
000000016 000000004 00 00 00 00 Uncompressed Length 00000000
00000001A 000000002 05 00 Filename Length 0005
00000001C 000000002 20 00 Extra Length 0020
00000001E 000000005 74 65 73 74 Filename 'test/'
2F
000000023 000000002 55 54 Extra ID #0001 5455 'UT: Extended Timestamp'
000000025 000000002 0D 00 Length 000D
000000027 000000001 07 Flags '07 mod access change'
000000028 000000004 BC DE F4 63 Mod Time 63F4DEBC 'Tue Feb 21 18:09:48 2023'
00000002C 000000004 FF DF F4 63 Access Time 63F4DFFF 'Tue Feb 21 18:15:11 2023'
000000030 000000004 C6 DE F4 63 Change Time 63F4DEC6 'Tue Feb 21 18:09:58 2023'
000000034 000000002 75 78 Extra ID #0002 7875 'ux: Unix Extra Type 3'
000000036 000000002 0B 00 Length 000B
000000038 000000001 01 Version 01
000000039 000000001 04 UID Size 04
00000003A 000000004 F5 01 00 00 UID 000001F5
00000003E 000000001 04 GID Size 04
00000003F 000000004 14 00 00 00 GID 00000014
000000043 000000004 50 4B 03 04 LOCAL HEADER #2 04034B50
000000047 000000001 2D Extract Zip Spec 2D '4.5'
000000048 000000001 00 Extract OS 00 'MS-DOS'
000000049 000000002 08 00 General Purpose Flag 0008
[Bits 1-2] 0 'Normal Compression'
[Bit 3] 1 'Streamed'
00000004B 000000002 08 00 Compression Method 0008 'Deflated'
00000004D 000000004 44 5F 55 56 Last Mod Time 56555F44 'Tue Feb 21 11:58:08 2023'
000000051 000000004 00 00 00 00 CRC 00000000
000000055 000000004 FF FF FF FF Compressed Length FFFFFFFF
000000059 000000004 FF FF FF FF Uncompressed Length FFFFFFFF
00000005D 000000002 2E 00 Filename Length 002E
00000005F 000000002 34 00 Extra Length 0034
000000061 00000002E 74 65 73 74 Filename 'test/OracleLinux-R7-U7-Server-x86_64-
2F 4F 72 61 dvd_2.iso'
63 6C 65 4C
69 6E 75 78
2D 52 37 2D
55 37 2D 53
65 72 76 65
72 2D 78 38
36 5F 36 34
2D 64 76 64
5F 32 2E 69
73 6F
00000008F 000000002 55 54 Extra ID #0001 5455 'UT: Extended Timestamp'
000000091 000000002 0D 00 Length 000D
000000093 000000001 07 Flags '07 mod access change'
000000094 000000004 A0 87 F4 63 Mod Time 63F487A0 'Tue Feb 21 11:58:08 2023'
000000098 000000004 BA DE F4 63 Access Time 63F4DEBA 'Tue Feb 21 18:09:46 2023'
00000009C 000000004 C6 DE F4 63 Change Time 63F4DEC6 'Tue Feb 21 18:09:58 2023'
0000000A0 000000002 75 78 Extra ID #0002 7875 'ux: Unix Extra Type 3'
0000000A2 000000002 0B 00 Length 000B
0000000A4 000000001 01 Version 01
0000000A5 000000001 04 UID Size 04
0000000A6 000000004 F5 01 00 00 UID 000001F5
0000000AA 000000001 04 GID Size 04
0000000AB 000000004 14 00 00 00 GID 00000014
0000000AF 000000002 01 00 Extra ID #0003 0001 'ZIP64'
0000000B1 000000002 10 00 Length 0010
0000000B3 000000008 00 00 20 1A Uncompressed Size 000000011A200000
01 00 00 00
0000000BB 000000008 00 00 00 00 Compressed Size 0000000000000000
00 00 00 00
0000000C3 10B4A4F56 ... PAYLOAD
10B4A5019 000000004 50 4B 07 08 STREAMING DATA HEADER 08074B50
10B4A501D 000000004 63 5E 34 7E CRC 7E345E63
10B4A5021 000000008 56 4F 4A 0B Compressed Length 000000010B4A4F56
01 00 00 00
10B4A5029 000000008 00 00 20 1A Uncompressed Length 000000011A200000
01 00 00 00
10B4A5031 000000004 50 4B 03 04 LOCAL HEADER #3 04034B50
10B4A5035 000000001 14 Extract Zip Spec 14 '2.0'
10B4A5036 000000001 00 Extract OS 00 'MS-DOS'
10B4A5037 000000002 08 00 General Purpose Flag 0008
[Bits 1-2] 0 'Normal Compression'
[Bit 3] 1 'Streamed'
10B4A5039 000000002 08 00 Compression Method 0008 'Deflated'
10B4A503B 000000004 44 5F 55 56 Last Mod Time 56555F44 'Tue Feb 21 11:58:08 2023'
10B4A503F 000000004 00 00 00 00 CRC 00000000
10B4A5043 000000004 00 00 00 00 Compressed Length 00000000
10B4A5047 000000004 2D 01 00 00 Uncompressed Length 0000012D
10B4A504B 000000002 39 00 Filename Length 0039
10B4A504D 000000002 20 00 Extra Length 0020
10B4A504F 000000039 5F 5F 4D 41 Filename '__MACOSX/test/._OracleLinux-R7-U7-
43 4F 53 58 Server-x86_64-dvd_2.iso'
2F 74 65 73
74 2F 2E 5F
4F 72 61 63
6C 65 4C 69
6E 75 78 2D
52 37 2D 55
37 2D 53 65
72 76 65 72
2D 78 38 36
5F 36 34 2D
64 76 64 5F
32 2E 69 73
6F
10B4A5088 000000002 55 54 Extra ID #0001 5455 'UT: Extended Timestamp'
10B4A508A 000000002 0D 00 Length 000D
10B4A508C 000000001 07 Flags '07 mod access change'
10B4A508D 000000004 A0 87 F4 63 Mod Time 63F487A0 'Tue Feb 21 11:58:08 2023'
10B4A5091 000000004 BA DE F4 63 Access Time 63F4DEBA 'Tue Feb 21 18:09:46 2023'
10B4A5095 000000004 2A DF F4 63 Change Time 63F4DF2A 'Tue Feb 21 18:11:38 2023'
10B4A5099 000000002 75 78 Extra ID #0002 7875 'ux: Unix Extra Type 3'
10B4A509B 000000002 0B 00 Length 000B
10B4A509D 000000001 01 Version 01
10B4A509E 000000001 04 UID Size 04
10B4A509F 000000004 F5 01 00 00 UID 000001F5
10B4A50A3 000000001 04 GID Size 04
10B4A50A4 000000004 14 00 00 00 GID 00000014
10B4A50A8 0000000C1 63 60 15 63 PAYLOAD c`.cg`b`.MLV..V.P.....'....o
67 60 62 60 ...u....!!A..X..
F0 4D 4C 56 NES....b`PI...K,(.I..M-
F0 0F 56 88 ILI,I....u.,I..-N-
50 80 02 90 .IL/..............E.y%.y..I.9..%...8.
18 03 27 10 63BmbD...P.......8...<....(.,........
1B 01 F1 6F .H....I....L....L...............
20 06 F2 19
75 19 88 02
8E 21 21 41
10 16 58 C7
09 20 4E 45
53 C2 04 15
D7 62 60 50
49 CE CF D5
4B 2C 28 C8
49 D5 CB 4D
2D 49 4C 49
2C 49 B4 8A
CF F6 75 F1
2C 49 CD 0D
2D 4E 2D 0A
49 4C 2F 06
EB F9 04 C4
D6 0C 0C A2
08 F5 85 A5
89 45 89 79
25 99 79 A9
0C 49 05 39
99 C5 25 06
06 0B 38 A0
36 33 42 6D
62 44 B3 99
B3 50 DF C0
C0 C2 D0 DA
CC 38 CD C4
C2 3C D1 D0
DA A9 28 B1
2C D5 DA D1
D9 DC C2 CC
C2 D2 48 D7
D1 D1 CD 49
D7 C4 C4 C0
4C D7 C2 DC
D1 4C D7 C4
C8 C2 D5 CD
CC C2 D8 CC
C2 C2 82 01
00
10B4A5169 000000004 50 4B 07 08 STREAMING DATA HEADER 08074B50
10B4A516D 000000004 68 AB BB 1F CRC 1FBBAB68
10B4A5171 000000004 C1 00 00 00 Compressed Length 000000C1
10B4A5175 000000004 2D 01 00 00 Uncompressed Length 0000012D
10B4A5179 000000004 50 4B 03 04 LOCAL HEADER #4 04034B50
10B4A517D 000000001 2D Extract Zip Spec 2D '4.5'
10B4A517E 000000001 00 Extract OS 00 'MS-DOS'
10B4A517F 000000002 08 00 General Purpose Flag 0008
[Bits 1-2] 0 'Normal Compression'
[Bit 3] 1 'Streamed'
10B4A5181 000000002 08 00 Compression Method 0008 'Deflated'
10B4A5183 000000004 44 5F 55 56 Last Mod Time 56555F44 'Tue Feb 21 11:58:08 2023'
10B4A5187 000000004 00 00 00 00 CRC 00000000
10B4A518B 000000004 FF FF FF FF Compressed Length FFFFFFFF
10B4A518F 000000004 FF FF FF FF Uncompressed Length FFFFFFFF
10B4A5193 000000002 2C 00 Filename Length 002C
10B4A5195 000000002 34 00 Extra Length 0034
10B4A5197 00000002C 74 65 73 74 Filename 'test/OracleLinux-R7-U7-Server-x86_64-
2F 4F 72 61 dvd.iso'
63 6C 65 4C
69 6E 75 78
2D 52 37 2D
55 37 2D 53
65 72 76 65
72 2D 78 38
36 5F 36 34
2D 64 76 64
2E 69 73 6F
10B4A51C3 000000002 55 54 Extra ID #0001 5455 'UT: Extended Timestamp'
10B4A51C5 000000002 0D 00 Length 000D
10B4A51C7 000000001 07 Flags '07 mod access change'
10B4A51C8 000000004 A0 87 F4 63 Mod Time 63F487A0 'Tue Feb 21 11:58:08 2023'
10B4A51CC 000000004 B8 DE F4 63 Access Time 63F4DEB8 'Tue Feb 21 18:09:44 2023'
10B4A51D0 000000004 C6 DE F4 63 Change Time 63F4DEC6 'Tue Feb 21 18:09:58 2023'
10B4A51D4 000000002 75 78 Extra ID #0002 7875 'ux: Unix Extra Type 3'
10B4A51D6 000000002 0B 00 Length 000B
10B4A51D8 000000001 01 Version 01
10B4A51D9 000000001 04 UID Size 04
10B4A51DA 000000004 F5 01 00 00 UID 000001F5
10B4A51DE 000000001 04 GID Size 04
10B4A51DF 000000004 14 00 00 00 GID 00000014
10B4A51E3 000000002 01 00 Extra ID #0003 0001 'ZIP64'
10B4A51E5 000000002 10 00 Length 0010
10B4A51E7 000000008 00 00 20 1A Uncompressed Size 000000011A200000
01 00 00 00
10B4A51EF 000000008 00 00 00 00 Compressed Size 0000000000000000
00 00 00 00
10B4A51F7 10B4A4F56 ... PAYLOAD
21694A14D 000000004 50 4B 07 08 STREAMING DATA HEADER 08074B50
21694A151 000000004 63 5E 34 7E CRC 7E345E63
21694A155 000000008 56 4F 4A 0B Compressed Length 000000010B4A4F56
01 00 00 00
21694A15D 000000008 00 00 20 1A Uncompressed Length 000000011A200000
01 00 00 00
21694A165 000000004 50 4B 03 04 LOCAL HEADER #5 04034B50
21694A169 000000001 14 Extract Zip Spec 14 '2.0'
21694A16A 000000001 00 Extract OS 00 'MS-DOS'
21694A16B 000000002 08 00 General Purpose Flag 0008
[Bits 1-2] 0 'Normal Compression'
[Bit 3] 1 'Streamed'
21694A16D 000000002 08 00 Compression Method 0008 'Deflated'
21694A16F 000000004 44 5F 55 56 Last Mod Time 56555F44 'Tue Feb 21 11:58:08 2023'
21694A173 000000004 00 00 00 00 CRC 00000000
21694A177 000000004 00 00 00 00 Compressed Length 00000000
21694A17B 000000004 8C 01 00 00 Uncompressed Length 0000018C
21694A17F 000000002 37 00 Filename Length 0037
21694A181 000000002 20 00 Extra Length 0020
21694A183 000000037 5F 5F 4D 41 Filename '__MACOSX/test/._OracleLinux-R7-U7-
43 4F 53 58 Server-x86_64-dvd.iso'
2F 74 65 73
74 2F 2E 5F
4F 72 61 63
6C 65 4C 69
6E 75 78 2D
52 37 2D 55
37 2D 53 65
72 76 65 72
2D 78 38 36
5F 36 34 2D
64 76 64 2E
69 73 6F
21694A1BA 000000002 55 54 Extra ID #0001 5455 'UT: Extended Timestamp'
21694A1BC 000000002 0D 00 Length 000D
21694A1BE 000000001 07 Flags '07 mod access change'
21694A1BF 000000004 A0 87 F4 63 Mod Time 63F487A0 'Tue Feb 21 11:58:08 2023'
21694A1C3 000000004 B8 DE F4 63 Access Time 63F4DEB8 'Tue Feb 21 18:09:44 2023'
21694A1C7 000000004 89 DF F4 63 Change Time 63F4DF89 'Tue Feb 21 18:13:13 2023'
21694A1CB 000000002 75 78 Extra ID #0002 7875 'ux: Unix Extra Type 3'
21694A1CD 000000002 0B 00 Length 000B
21694A1CF 000000001 01 Version 01
21694A1D0 000000001 04 UID Size 04
21694A1D1 000000004 F5 01 00 00 UID 000001F5
21694A1D5 000000001 04 GID Size 04
21694A1D6 000000004 14 00 00 00 GID 00000014
21694A1DA 000000107 ... PAYLOAD
21694A2E1 000000004 50 4B 07 08 STREAMING DATA HEADER 08074B50
21694A2E5 000000004 62 3C 11 77 CRC 77113C62
21694A2E9 000000004 07 01 00 00 Compressed Length 00000107
21694A2ED 000000004 8C 01 00 00 Uncompressed Length 0000018C
21694A2F1 000000004 50 4B 01 02 CENTRAL HEADER #1 02014B50
21694A2F5 000000001 14 Created Zip Spec 14 '2.0'
21694A2F6 000000001 03 Created OS 03 'Unix'
21694A2F7 000000001 14 Extract Zip Spec 14 '2.0'
21694A2F8 000000001 00 Extract OS 00 'MS-DOS'
21694A2F9 000000002 00 00 General Purpose Flag 0000
21694A2FB 000000002 00 00 Compression Method 0000 'Stored'
21694A2FD 000000004 38 91 55 56 Last Mod Time 56559138 'Tue Feb 21 18:09:48 2023'
21694A301 000000004 00 00 00 00 CRC 00000000
21694A305 000000004 00 00 00 00 Compressed Length 00000000
21694A309 000000004 00 00 00 00 Uncompressed Length 00000000
21694A30D 000000002 05 00 Filename Length 0005
21694A30F 000000002 20 00 Extra Length 0020
21694A311 000000002 00 00 Comment Length 0000
21694A313 000000002 00 00 Disk Start 0000
21694A315 000000002 00 00 Int File Attributes 0000
[Bit 0] 0 'Binary Data'
21694A317 000000004 00 00 ED 41 Ext File Attributes 41ED0000
21694A31B 000000004 00 00 00 00 Local Header Offset 00000000
21694A31F 000000005 74 65 73 74 Filename 'test/'
2F
21694A324 000000002 55 54 Extra ID #0001 5455 'UT: Extended Timestamp'
21694A326 000000002 0D 00 Length 000D
21694A328 000000001 07 Flags '07 mod access change'
21694A329 000000004 BC DE F4 63 Mod Time 63F4DEBC 'Tue Feb 21 18:09:48 2023'
21694A32D 000000004 FF DF F4 63 Access Time 63F4DFFF 'Tue Feb 21 18:15:11 2023'
21694A331 000000004 C6 DE F4 63 Change Time 63F4DEC6 'Tue Feb 21 18:09:58 2023'
21694A335 000000002 75 78 Extra ID #0002 7875 'ux: Unix Extra Type 3'
21694A337 000000002 0B 00 Length 000B
21694A339 000000001 01 Version 01
21694A33A 000000001 04 UID Size 04
21694A33B 000000004 F5 01 00 00 UID 000001F5
21694A33F 000000001 04 GID Size 04
21694A340 000000004 14 00 00 00 GID 00000014
21694A344 000000004 50 4B 01 02 CENTRAL HEADER #2 02014B50
21694A348 000000001 2D Created Zip Spec 2D '4.5'
21694A349 000000001 03 Created OS 03 'Unix'
21694A34A 000000001 2D Extract Zip Spec 2D '4.5'
21694A34B 000000001 00 Extract OS 00 'MS-DOS'
21694A34C 000000002 08 00 General Purpose Flag 0008
[Bits 1-2] 0 'Normal Compression'
[Bit 3] 1 'Streamed'
21694A34E 000000002 08 00 Compression Method 0008 'Deflated'
21694A350 000000004 44 5F 55 56 Last Mod Time 56555F44 'Tue Feb 21 11:58:08 2023'
21694A354 000000004 63 5E 34 7E CRC 7E345E63
21694A358 000000004 FF FF FF FF Compressed Length FFFFFFFF
21694A35C 000000004 FF FF FF FF Uncompressed Length FFFFFFFF
21694A360 000000002 2E 00 Filename Length 002E
21694A362 000000002 34 00 Extra Length 0034
21694A364 000000002 00 00 Comment Length 0000
21694A366 000000002 00 00 Disk Start 0000
21694A368 000000002 00 00 Int File Attributes 0000
[Bit 0] 0 'Binary Data'
21694A36A 000000004 00 00 A4 81 Ext File Attributes 81A40000
21694A36E 000000004 43 00 00 00 Local Header Offset 00000043
21694A372 00000002E 74 65 73 74 Filename 'test/OracleLinux-R7-U7-Server-x86_64-
2F 4F 72 61 dvd_2.iso'
63 6C 65 4C
69 6E 75 78
2D 52 37 2D
55 37 2D 53
65 72 76 65
72 2D 78 38
36 5F 36 34
2D 64 76 64
5F 32 2E 69
73 6F
21694A3A0 000000002 55 54 Extra ID #0001 5455 'UT: Extended Timestamp'
21694A3A2 000000002 0D 00 Length 000D
21694A3A4 000000001 07 Flags '07 mod access change'
21694A3A5 000000004 A0 87 F4 63 Mod Time 63F487A0 'Tue Feb 21 11:58:08 2023'
21694A3A9 000000004 BA DE F4 63 Access Time 63F4DEBA 'Tue Feb 21 18:09:46 2023'
21694A3AD 000000004 C6 DE F4 63 Change Time 63F4DEC6 'Tue Feb 21 18:09:58 2023'
21694A3B1 000000002 75 78 Extra ID #0002 7875 'ux: Unix Extra Type 3'
21694A3B3 000000002 0B 00 Length 000B
21694A3B5 000000001 01 Version 01
21694A3B6 000000001 04 UID Size 04
21694A3B7 000000004 F5 01 00 00 UID 000001F5
21694A3BB 000000001 04 GID Size 04
21694A3BC 000000004 14 00 00 00 GID 00000014
21694A3C0 000000002 01 00 Extra ID #0003 0001 'ZIP64'
21694A3C2 000000002 10 00 Length 0010
21694A3C4 000000008 00 00 20 1A Uncompressed Size 000000011A200000
01 00 00 00
21694A3CC 000000008 56 4F 4A 0B Compressed Size 000000010B4A4F56
01 00 00 00
21694A3D4 000000004 50 4B 01 02 CENTRAL HEADER #3 02014B50
21694A3D8 000000001 14 Created Zip Spec 14 '2.0'
21694A3D9 000000001 03 Created OS 03 'Unix'
21694A3DA 000000001 2D Extract Zip Spec 2D '4.5'
21694A3DB 000000001 00 Extract OS 00 'MS-DOS'
21694A3DC 000000002 08 00 General Purpose Flag 0008
[Bits 1-2] 0 'Normal Compression'
[Bit 3] 1 'Streamed'
21694A3DE 000000002 08 00 Compression Method 0008 'Deflated'
21694A3E0 000000004 44 5F 55 56 Last Mod Time 56555F44 'Tue Feb 21 11:58:08 2023'
21694A3E4 000000004 68 AB BB 1F CRC 1FBBAB68
21694A3E8 000000004 C1 00 00 00 Compressed Length 000000C1
21694A3EC 000000004 2D 01 00 00 Uncompressed Length 0000012D
21694A3F0 000000002 39 00 Filename Length 0039
21694A3F2 000000002 2C 00 Extra Length 002C
21694A3F4 000000002 00 00 Comment Length 0000
21694A3F6 000000002 00 00 Disk Start 0000
21694A3F8 000000002 00 00 Int File Attributes 0000
[Bit 0] 0 'Binary Data'
21694A3FA 000000004 00 00 A4 81 Ext File Attributes 81A40000
21694A3FE 000000004 FF FF FF FF Local Header Offset FFFFFFFF
21694A402 000000039 5F 5F 4D 41 Filename '__MACOSX/test/._OracleLinux-R7-U7-
43 4F 53 58 Server-x86_64-dvd_2.iso'
2F 74 65 73
74 2F 2E 5F
4F 72 61 63
6C 65 4C 69
6E 75 78 2D
52 37 2D 55
37 2D 53 65
72 76 65 72
2D 78 38 36
5F 36 34 2D
64 76 64 5F
32 2E 69 73
6F
21694A43B 000000002 55 54 Extra ID #0001 5455 'UT: Extended Timestamp'
21694A43D 000000002 0D 00 Length 000D
21694A43F 000000001 07 Flags '07 mod access change'
21694A440 000000004 A0 87 F4 63 Mod Time 63F487A0 'Tue Feb 21 11:58:08 2023'
21694A444 000000004 BA DE F4 63 Access Time 63F4DEBA 'Tue Feb 21 18:09:46 2023'
21694A448 000000004 2A DF F4 63 Change Time 63F4DF2A 'Tue Feb 21 18:11:38 2023'
21694A44C 000000002 75 78 Extra ID #0002 7875 'ux: Unix Extra Type 3'
21694A44E 000000002 0B 00 Length 000B
21694A450 000000001 01 Version 01
21694A451 000000001 04 UID Size 04
21694A452 000000004 F5 01 00 00 UID 000001F5
21694A456 000000001 04 GID Size 04
21694A457 000000004 14 00 00 00 GID 00000014
21694A45B 000000002 01 00 Extra ID #0003 0001 'ZIP64'
21694A45D 000000002 08 00 Length 0008
21694A45F 000000008 31 50 4A 0B Offset to Central 000000010B4A5031
01 00 00 00 Dir
21694A467 000000004 50 4B 01 02 CENTRAL HEADER #4 02014B50
21694A46B 000000001 2D Created Zip Spec 2D '4.5'
21694A46C 000000001 03 Created OS 03 'Unix'
21694A46D 000000001 2D Extract Zip Spec 2D '4.5'
21694A46E 000000001 00 Extract OS 00 'MS-DOS'
21694A46F 000000002 08 00 General Purpose Flag 0008
[Bits 1-2] 0 'Normal Compression'
[Bit 3] 1 'Streamed'
21694A471 000000002 08 00 Compression Method 0008 'Deflated'
21694A473 000000004 44 5F 55 56 Last Mod Time 56555F44 'Tue Feb 21 11:58:08 2023'
21694A477 000000004 63 5E 34 7E CRC 7E345E63
21694A47B 000000004 FF FF FF FF Compressed Length FFFFFFFF
21694A47F 000000004 FF FF FF FF Uncompressed Length FFFFFFFF
21694A483 000000002 2C 00 Filename Length 002C
21694A485 000000002 3C 00 Extra Length 003C
21694A487 000000002 00 00 Comment Length 0000
21694A489 000000002 00 00 Disk Start 0000
21694A48B 000000002 00 00 Int File Attributes 0000
[Bit 0] 0 'Binary Data'
21694A48D 000000004 00 00 A4 81 Ext File Attributes 81A40000
21694A491 000000004 FF FF FF FF Local Header Offset FFFFFFFF
21694A495 00000002C 74 65 73 74 Filename 'test/OracleLinux-R7-U7-Server-x86_64-
2F 4F 72 61 dvd.iso'
63 6C 65 4C
69 6E 75 78
2D 52 37 2D
55 37 2D 53
65 72 76 65
72 2D 78 38
36 5F 36 34
2D 64 76 64
2E 69 73 6F
21694A4C1 000000002 55 54 Extra ID #0001 5455 'UT: Extended Timestamp'
21694A4C3 000000002 0D 00 Length 000D
21694A4C5 000000001 07 Flags '07 mod access change'
21694A4C6 000000004 A0 87 F4 63 Mod Time 63F487A0 'Tue Feb 21 11:58:08 2023'
21694A4CA 000000004 B8 DE F4 63 Access Time 63F4DEB8 'Tue Feb 21 18:09:44 2023'
21694A4CE 000000004 C6 DE F4 63 Change Time 63F4DEC6 'Tue Feb 21 18:09:58 2023'
21694A4D2 000000002 75 78 Extra ID #0002 7875 'ux: Unix Extra Type 3'
21694A4D4 000000002 0B 00 Length 000B
21694A4D6 000000001 01 Version 01
21694A4D7 000000001 04 UID Size 04
21694A4D8 000000004 F5 01 00 00 UID 000001F5
21694A4DC 000000001 04 GID Size 04
21694A4DD 000000004 14 00 00 00 GID 00000014
21694A4E1 000000002 01 00 Extra ID #0003 0001 'ZIP64'
21694A4E3 000000002 18 00 Length 0018
21694A4E5 000000008 00 00 20 1A Uncompressed Size 000000011A200000
01 00 00 00
21694A4ED 000000008 56 4F 4A 0B Compressed Size 000000010B4A4F56
01 00 00 00
21694A4F5 000000008 79 51 4A 0B Offset to Central 000000010B4A5179
01 00 00 00 Dir
21694A4FD 000000004 50 4B 01 02 CENTRAL HEADER #5 02014B50
21694A501 000000001 14 Created Zip Spec 14 '2.0'
21694A502 000000001 03 Created OS 03 'Unix'
21694A503 000000001 2D Extract Zip Spec 2D '4.5'
21694A504 000000001 00 Extract OS 00 'MS-DOS'
21694A505 000000002 08 00 General Purpose Flag 0008
[Bits 1-2] 0 'Normal Compression'
[Bit 3] 1 'Streamed'
21694A507 000000002 08 00 Compression Method 0008 'Deflated'
21694A509 000000004 44 5F 55 56 Last Mod Time 56555F44 'Tue Feb 21 11:58:08 2023'
21694A50D 000000004 62 3C 11 77 CRC 77113C62
21694A511 000000004 07 01 00 00 Compressed Length 00000107
21694A515 000000004 8C 01 00 00 Uncompressed Length 0000018C
21694A519 000000002 37 00 Filename Length 0037
21694A51B 000000002 2C 00 Extra Length 002C
21694A51D 000000002 00 00 Comment Length 0000
21694A51F 000000002 00 00 Disk Start 0000
21694A521 000000002 00 00 Int File Attributes 0000
[Bit 0] 0 'Binary Data'
21694A523 000000004 00 00 A4 81 Ext File Attributes 81A40000
21694A527 000000004 FF FF FF FF Local Header Offset FFFFFFFF
21694A52B 000000037 5F 5F 4D 41 Filename '__MACOSX/test/._OracleLinux-R7-U7-
43 4F 53 58 Server-x86_64-dvd.iso'
2F 74 65 73
74 2F 2E 5F
4F 72 61 63
6C 65 4C 69
6E 75 78 2D
52 37 2D 55
37 2D 53 65
72 76 65 72
2D 78 38 36
5F 36 34 2D
64 76 64 2E
69 73 6F
21694A562 000000002 55 54 Extra ID #0001 5455 'UT: Extended Timestamp'
21694A564 000000002 0D 00 Length 000D
21694A566 000000001 07 Flags '07 mod access change'
21694A567 000000004 A0 87 F4 63 Mod Time 63F487A0 'Tue Feb 21 11:58:08 2023'
21694A56B 000000004 B8 DE F4 63 Access Time 63F4DEB8 'Tue Feb 21 18:09:44 2023'
21694A56F 000000004 89 DF F4 63 Change Time 63F4DF89 'Tue Feb 21 18:13:13 2023'
21694A573 000000002 75 78 Extra ID #0002 7875 'ux: Unix Extra Type 3'
21694A575 000000002 0B 00 Length 000B
21694A577 000000001 01 Version 01
21694A578 000000001 04 UID Size 04
21694A579 000000004 F5 01 00 00 UID 000001F5
21694A57D 000000001 04 GID Size 04
21694A57E 000000004 14 00 00 00 GID 00000014
21694A582 000000002 01 00 Extra ID #0003 0001 'ZIP64'
21694A584 000000002 08 00 Length 0008
21694A586 000000008 65 A1 94 16 Offset to Central 000000021694A165
02 00 00 00 Dir
21694A58E 000000004 50 4B 06 06 ZIP64 END CENTRAL DIR 06064B50
RECORD
21694A592 000000008 2C 00 00 00 Size of record 000000000000002C
00 00 00 00
21694A59A 000000001 2D Created Zip Spec 2D '4.5'
21694A59B 000000001 00 Created OS 00 'MS-DOS'
21694A59C 000000001 2D Extract Zip Spec 2D '4.5'
21694A59D 000000001 00 Extract OS 00 'MS-DOS'
21694A59E 000000004 00 00 00 00 Number of this disk 00000000
21694A5A2 000000004 00 00 00 00 Central Dir Disk no 00000000
21694A5A6 000000008 05 00 00 00 Entries in this disk 0000000000000005
00 00 00 00
21694A5AE 000000008 05 00 00 00 Total Entries 0000000000000005
00 00 00 00
21694A5B6 000000008 9D 02 00 00 Size of Central Dir 000000000000029D
00 00 00 00
21694A5BE 000000008 F1 A2 94 16 Offset to Central dir 000000021694A2F1
02 00 00 00
21694A5C6 000000004 50 4B 06 07 ZIP64 END CENTRAL DIR 07064B50
LOCATOR
21694A5CA 000000004 00 00 00 00 Central Dir Disk no 00000000
21694A5CE 000000008 8E A5 94 16 Offset to Central dir 000000021694A58E
02 00 00 00
21694A5D6 000000004 01 00 00 00 Total no of Disks 00000001
21694A5DA 000000004 50 4B 05 06 END CENTRAL HEADER 06054B50
21694A5DE 000000002 00 00 Number of this disk 0000
21694A5E0 000000002 00 00 Central Dir Disk no 0000
21694A5E2 000000002 05 00 Entries in this disk 0005
21694A5E4 000000002 05 00 Total Entries 0005
21694A5E6 000000004 9D 02 00 00 Size of Central Dir 0000029D
21694A5EA 000000004 FF FF FF FF Offset to Central Dir FFFFFFFF
21694A5EE 000000002 00 00 Comment Length 0000
Done
Hi Anantha, do you have any further ideas on this topic?
I haven't looked at the issue since my last comment. I have been working on a few other things. The main issue is, I don't know how much time would be needed to figure out the root cause. I also don't have a way to reproduce it locally (and verify the fix), which makes it very time-consuming.
We are streaming lots of archives with
zstream
. It works very well except the native Xiaomi archiver utility, that fails to unzip azip64
archive. The first idea was that this is a bug in that utility, but it handleszip64
archives from another streaming solution mod_zip with no issues.Another hint that something might be wrong with
zip64
format is thatzipdetails
mac/linux util fails to displayzstream
s zip64 details. Here is an example script and files.10.txt test.zip test_zip64.zip