Parse problem

[beefstew]

Henny,

Hello! I think that this may be the same issue as #11, but am reporting it separately to not cross the streams.

The project I'm scanning is curl, revision eb8138405a3f747f2c236464932f72e918946f68 (i.e. release: 7.61.0).

The problem file in the curl:

(parallels) ubuntu:~/csources/curl
$ /home/parallels/ktadvance/advance/bin/binaries/parseFile_linux -projectpath /home/parallels/csources/curl -targetdirectory /home/parallels/csources/curl lib/curl_ntlm_core.i
Parsing lib/curl_ntlm_core.i
/usr/include/openssl/crypto.h[327:0-0] : syntax error
Parsing errorError when parsing (CIL) lib/curl_ntlm_core.i

I can't tell from the error if the problem is with curl_ntlm_core.i or the openSSL crypto.h, so I've attached both in the .zip

files.zip

Cheers, Chris

[beefstew]

I haven't been able to find a single project that will make it through a parse/analyze process. There always seems to be at least one file that won't parse. Projects attempted:

Projects attempted: https://github.com/neovim/neovim https://github.com/vim/vim https://github.com/curl/curl https://github.com/jedisct1/libsodium https://github.com/tj/luna https://github.com/nginx/nginx https://github.com/ruby/ruby

In libsodium:

================================================================================
***** crypto_aead/aes256gcm/aesni/aead_aes256gcm_aesni.c *****
================================================================================
arguments: ['cc', '-c', '-DPACKAGE_NAME="libsodium"', '-DPACKAGE_TARNAME="libsodium"', '-DPACKAGE_VERSION="1.0.16"', '-DPACKAGE_STRING="libsodium 1.0.16"', '-DPACKAGE_BUGREPORT="https://github.com/jedisct1/libsodium/issues"', '-DPACKAGE_URL="https://github.com/jedisct1/libsodium"', '-DPACKAGE="libsodium"', '-DVERSION="1.0.16"', '-DHAVE_PTHREAD_PRIO_INHERIT=1', '-DHAVE_PTHREAD=1', '-DSTDC_HEADERS=1', '-DHAVE_SYS_TYPES_H=1', '-DHAVE_SYS_STAT_H=1', '-DHAVE_STDLIB_H=1', '-DHAVE_STRING_H=1', '-DHAVE_MEMORY_H=1', '-DHAVE_STRINGS_H=1', '-DHAVE_INTTYPES_H=1', '-DHAVE_STDINT_H=1', '-DHAVE_UNISTD_H=1', '-D__EXTENSIONS__=1', '-D_ALL_SOURCE=1', '-D_GNU_SOURCE=1', '-D_POSIX_PTHREAD_SEMANTICS=1', '-D_TANDEM_SOURCE=1', '-DHAVE_C_VARARRAYS=1', '-DHAVE_CATCHABLE_SEGV=1', '-DHAVE_CATCHABLE_ABRT=1', '-DTLS=_Thread_local', '-DHAVE_DLFCN_H=1', '-DLT_OBJDIR=".libs/"', '-DHAVE_MMINTRIN_H=1', '-DHAVE_EMMINTRIN_H=1', '-DHAVE_PMMINTRIN_H=1', '-DHAVE_TMMINTRIN_H=1', '-DHAVE_SMMINTRIN_H=1', '-DHAVE_AVXINTRIN_H=1', '-DHAVE_AVX2INTRIN_H=1', '-DHAVE_AVX512FINTRIN_H=1', '-DHAVE_WMMINTRIN_H=1', '-DHAVE_RDRAND=1', '-DHAVE_SYS_MMAN_H=1', '-DNATIVE_LITTLE_ENDIAN=1', '-DHAVE_INLINE_ASM=1', '-DHAVE_AMD64_ASM=1', '-DHAVE_AVX_ASM=1', '-DHAVE_TI_MODE=1', '-DHAVE_CPUID=1', '-DASM_HIDE_SYMBOL=.hidden', '-DHAVE_WEAK_SYMBOLS=1', '-DCPU_UNALIGNED_ACCESS=1', '-DHAVE_ATOMIC_OPS=1', '-DHAVE_ALLOCA_H=1', '-DHAVE_ALLOCA=1', '-DHAVE_MMAP=1', '-DHAVE_MLOCK=1', '-DHAVE_MADVISE=1', '-DHAVE_MPROTECT=1', '-DHAVE_EXPLICIT_BZERO=1', '-DHAVE_NANOSLEEP=1', '-DHAVE_POSIX_MEMALIGN=1', '-DHAVE_GETPID=1', '-DCONFIGURED=1', '-I.', '-I./include/sodium', '-I./include/sodium', '-msse2', '-mssse3', '-maes', '-mpclmul', '-g', '-O2', '-pthread', '-mindirect-branch=thunk', '-fvisibility=hidden', '-fPIC', '-fno-strict-aliasing', '-fno-strict-overflow', '-fstack-protector', '-fPIC', '-DPIC', '-o', 'crypto_aead/aes256gcm/aesni/.libs/libaesni_la-aead_aes256gcm_aesni.o', 'crypto_aead/aes256gcm/aesni/aead_aes256gcm_aesni.c']
directory: /home/parallels/csources/libsodium/src/libsodium
file: crypto_aead/aes256gcm/aesni/aead_aes256gcm_aesni.c

Issue command: ['cc', '-c', '-DPACKAGE_NAME="libsodium"', '-DPACKAGE_TARNAME="libsodium"', '-DPACKAGE_VERSION="1.0.16"', '-DPACKAGE_STRING="libsodium 1.0.16"', '-DPACKAGE_BUGREPORT="https://github.com/jedisct1/libsodium/issues"', '-DPACKAGE_URL="https://github.com/jedisct1/libsodium"', '-DPACKAGE="libsodium"', '-DVERSION="1.0.16"', '-DHAVE_PTHREAD_PRIO_INHERIT=1', '-DHAVE_PTHREAD=1', '-DSTDC_HEADERS=1', '-DHAVE_SYS_TYPES_H=1', '-DHAVE_SYS_STAT_H=1', '-DHAVE_STDLIB_H=1', '-DHAVE_STRING_H=1', '-DHAVE_MEMORY_H=1', '-DHAVE_STRINGS_H=1', '-DHAVE_INTTYPES_H=1', '-DHAVE_STDINT_H=1', '-DHAVE_UNISTD_H=1', '-D__EXTENSIONS__=1', '-D_ALL_SOURCE=1', '-D_GNU_SOURCE=1', '-D_POSIX_PTHREAD_SEMANTICS=1', '-D_TANDEM_SOURCE=1', '-DHAVE_C_VARARRAYS=1', '-DHAVE_CATCHABLE_SEGV=1', '-DHAVE_CATCHABLE_ABRT=1', '-DTLS=_Thread_local', '-DHAVE_DLFCN_H=1', '-DLT_OBJDIR=".libs/"', '-DHAVE_MMINTRIN_H=1', '-DHAVE_EMMINTRIN_H=1', '-DHAVE_PMMINTRIN_H=1', '-DHAVE_TMMINTRIN_H=1', '-DHAVE_SMMINTRIN_H=1', '-DHAVE_AVXINTRIN_H=1', '-DHAVE_AVX2INTRIN_H=1', '-DHAVE_AVX512FINTRIN_H=1', '-DHAVE_WMMINTRIN_H=1', '-DHAVE_RDRAND=1', '-DHAVE_SYS_MMAN_H=1', '-DNATIVE_LITTLE_ENDIAN=1', '-DHAVE_INLINE_ASM=1', '-DHAVE_AMD64_ASM=1', '-DHAVE_AVX_ASM=1', '-DHAVE_TI_MODE=1', '-DHAVE_CPUID=1', '-DASM_HIDE_SYMBOL=.hidden', '-DHAVE_WEAK_SYMBOLS=1', '-DCPU_UNALIGNED_ACCESS=1', '-DHAVE_ATOMIC_OPS=1', '-DHAVE_ALLOCA_H=1', '-DHAVE_ALLOCA=1', '-DHAVE_MMAP=1', '-DHAVE_MLOCK=1', '-DHAVE_MADVISE=1', '-DHAVE_MPROTECT=1', '-DHAVE_EXPLICIT_BZERO=1', '-DHAVE_NANOSLEEP=1', '-DHAVE_POSIX_MEMALIGN=1', '-DHAVE_GETPID=1', '-DCONFIGURED=1', '-I.', '-I./include/sodium', '-I./include/sodium', '-msse2', '-mssse3', '-maes', '-mpclmul', '-g', '-pthread', '-mindirect-branch=thunk', '-fvisibility=hidden', '-fPIC', '-fno-strict-aliasing', '-fno-strict-overflow', '-fstack-protector', '-fPIC', '-DPIC', '-o', '/home/parallels/csources/libsodium/src/libsodium/crypto_aead/aes256gcm/aesni/aead_aes256gcm_aesni.i', 'crypto_aead/aes256gcm/aesni/aead_aes256gcm_aesni.c', '-g', '-E', '-fno-stack-protector', '-fno-inline', '-fno-builtin', '-fno-asm', '-m64']

result: 0

Issue original command: ['cc', '-c', '-DPACKAGE_NAME="libsodium"', '-DPACKAGE_TARNAME="libsodium"', '-DPACKAGE_VERSION="1.0.16"', '-DPACKAGE_STRING="libsodium 1.0.16"', '-DPACKAGE_BUGREPORT="https://github.com/jedisct1/libsodium/issues"', '-DPACKAGE_URL="https://github.com/jedisct1/libsodium"', '-DPACKAGE="libsodium"', '-DVERSION="1.0.16"', '-DHAVE_PTHREAD_PRIO_INHERIT=1', '-DHAVE_PTHREAD=1', '-DSTDC_HEADERS=1', '-DHAVE_SYS_TYPES_H=1', '-DHAVE_SYS_STAT_H=1', '-DHAVE_STDLIB_H=1', '-DHAVE_STRING_H=1', '-DHAVE_MEMORY_H=1', '-DHAVE_STRINGS_H=1', '-DHAVE_INTTYPES_H=1', '-DHAVE_STDINT_H=1', '-DHAVE_UNISTD_H=1', '-D__EXTENSIONS__=1', '-D_ALL_SOURCE=1', '-D_GNU_SOURCE=1', '-D_POSIX_PTHREAD_SEMANTICS=1', '-D_TANDEM_SOURCE=1', '-DHAVE_C_VARARRAYS=1', '-DHAVE_CATCHABLE_SEGV=1', '-DHAVE_CATCHABLE_ABRT=1', '-DTLS=_Thread_local', '-DHAVE_DLFCN_H=1', '-DLT_OBJDIR=".libs/"', '-DHAVE_MMINTRIN_H=1', '-DHAVE_EMMINTRIN_H=1', '-DHAVE_PMMINTRIN_H=1', '-DHAVE_TMMINTRIN_H=1', '-DHAVE_SMMINTRIN_H=1', '-DHAVE_AVXINTRIN_H=1', '-DHAVE_AVX2INTRIN_H=1', '-DHAVE_AVX512FINTRIN_H=1', '-DHAVE_WMMINTRIN_H=1', '-DHAVE_RDRAND=1', '-DHAVE_SYS_MMAN_H=1', '-DNATIVE_LITTLE_ENDIAN=1', '-DHAVE_INLINE_ASM=1', '-DHAVE_AMD64_ASM=1', '-DHAVE_AVX_ASM=1', '-DHAVE_TI_MODE=1', '-DHAVE_CPUID=1', '-DASM_HIDE_SYMBOL=.hidden', '-DHAVE_WEAK_SYMBOLS=1', '-DCPU_UNALIGNED_ACCESS=1', '-DHAVE_ATOMIC_OPS=1', '-DHAVE_ALLOCA_H=1', '-DHAVE_ALLOCA=1', '-DHAVE_MMAP=1', '-DHAVE_MLOCK=1', '-DHAVE_MADVISE=1', '-DHAVE_MPROTECT=1', '-DHAVE_EXPLICIT_BZERO=1', '-DHAVE_NANOSLEEP=1', '-DHAVE_POSIX_MEMALIGN=1', '-DHAVE_GETPID=1', '-DCONFIGURED=1', '-I.', '-I./include/sodium', '-I./include/sodium', '-msse2', '-mssse3', '-maes', '-mpclmul', '-g', '-O2', '-pthread', '-mindirect-branch=thunk', '-fvisibility=hidden', '-fPIC', '-fno-strict-aliasing', '-fno-strict-overflow', '-fstack-protector', '-fPIC', '-DPIC', '-o', 'crypto_aead/aes256gcm/aesni/.libs/libaesni_la-aead_aes256gcm_aesni.o', 'crypto_aead/aes256gcm/aesni/aead_aes256gcm_aesni.c']

result: 0

Run the parser: ['/home/parallels/ktadvance/advance/bin/binaries/parseFile_linux', '-projectpath', '/home/parallels/csources/libsodium', '-targetdirectory', '/home/parallels/csources/libsodium/semantics/ktadvance', '-nofilter', '/home/parallels/csources/libsodium/src/libsodium/crypto_aead/aes256gcm/aesni/aead_aes256gcm_aesni.i']

Parsing /home/parallels/csources/libsodium/src/libsodium/crypto_aead/aes256gcm/aesni/aead_aes256gcm_aesni.i
/usr/include/stdlib.h[140:8-16] : syntax error
Parsing errorError when parsing (CIL) /home/parallels/csources/libsodium/src/libsodium/crypto_aead/aes256gcm/aesni/aead_aes256gcm_aesni.i