hoene / libmysofa

Reader for AES SOFA files to get better HRTFs
Other
131 stars 70 forks source link

Large file load failure, error code:10000 due to "gunzip error -3 incorrect header check" #178

Closed not-availabIe closed 2 years ago

not-availabIe commented 2 years ago

I compiled with VDEBUG when loading a file containing HRIRs with dimension 12722-by-2-by-4410 and got the errors below. Following other raised issues, I have commented out all file size limits that I found in the c codes. (https://github.com/hoene/libmysofa/issues/155). The file size is 750MB. The file is able to load without error when I reduced the HRIR dimension to 12722-by-2-by-2500. The threshold seems to be somewhere between 2500 and 2600 in my case. Reducing the 1st dimension also helps. The file can be loaded and saved without problem with the latest MATLAB sofa API, so unlikely to be a corrupted file.

error log below: ..\src\hdf\btree.c:247: 00008D39 TREE ..\src\hdf\btree.c:271: elements 1558935 size 8 ..\src\hdf\btree.c:295: start 0 0 ..\src\hdf\btree.c:295: start 1 0 ..\src\hdf\btree.c:295: start 2 0 ..\src\hdf\btree.c:303: data at 299C1392 len 10914249 ..\src\hdf\gunzip.c:30: gunzip error -3 incorrect header check ..\src\hdf\btree.c:326: gunzip -3 0 12471480

The problem seems to be related to the gunzip used to decompress the SOFA file. Hopefully I can find later versions of gunzip to replace the one used in libmysofa for some testing.

edit: gunzip lib included is already the latest version.

hoene commented 2 years ago

@not-availabIe May you share the file with me? This would help significantly.

not-availabIe commented 2 years ago

@hoene Of course, thanks. Please find the download link here: https://wetransfer.com/downloads/3355b223c285f9b2c31511978fc532ac20220218172413/67b271de8949600193ce0925197df91f20220218172426/96a444

The file is adapted from "BKwHA.sofa" downloaded from here https://zenodo.org/record/2582553. It contains IRs and Delays for 8 channels, so I removed the extra channels, changed "R" to 2 and created the file above.

not-availabIe commented 2 years ago

@hoene I can reupload the SOFA file if the link expires.

hoene commented 2 years ago

please provide the file again.