search

lz4 / lz4-java

LZ4 compression for Java
Apache License 2.0
1.1k stars 253 forks source link

How to decompress data that is compressed by other lz4 clients. #167

Closed sahilpaudel-pe closed 3 years ago

sahilpaudel-pe commented 3 years ago

I have a requirement where some data that may be encoded using go lz4 clients or ruby lz4 clients. How can I decode that using lz4-java.

I tried using 

LZ4FastDecompressor decompressor = factory.fastDecompressor();
LZ4DecompressorWithLength decompressorWithLength = new LZ4DecompressorWithLength(decompressor);
byte[] restored = decompressorWithLength.decompress(decoded);
System.out.println(new String(restored));

But I got strange error

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGBUS (0xa) at pc=0x000000010cc02114, pid=87029, tid=0x0000000000000c03
#
# JRE version: OpenJDK Runtime Environment (8.0_232-b09) (build 1.8.0_232-b09)
# Java VM: OpenJDK 64-Bit Server VM (25.232-b09 mixed mode bsd-amd64 compressed oops)
# Problematic frame:
# C  [liblz4-java-5063632643145635159.dylib+0xc114]  LZ4_decompress_fast+0xe4
#
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#
# If you would like to submit a bug report, please visit:
#   http://bugreport.java.com/bugreport/crash.jsp
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

---------------  T H R E A D  ---------------

Current thread (0x00007fc58780b000):  JavaThread "main" [_thread_in_native, id=3075, stack(0x0000700002ab5000,0x0000700002bb5000)]

siginfo: si_signo: 10 (SIGBUS), si_code: 2 (BUS_ADRERR), si_addr: 0x0000000798000000

Registers:
RAX=0x0000000000000000, RBX=0x0000000797fffffa, RCX=0x0000000797fffffb, RDX=0x0000000000000000
RSP=0x0000700002bb4340, RBP=0x0000700002bb4380, RSI=0x00000007402bf4c8, RDI=0x000000074492ab81
R8 =0x000000074aa6fcb9, R9 =0x000000000a7b07f1, R10=0x000000074aa6fc79, R11=0x0000000000000000
R12=0x000000074aa6fcb1, R13=0x0000000000000000, R14=0x000000074492ab8d, R15=0xffffffffffff0044
RIP=0x000000010cc02114, EFLAGS=0x0000000000010293, ERR=0x0000000000000004
  TRAPNO=0x000000000000000e

Top of Stack: (sp=0x0000700002bb4340)
0x0000700002bb4340:   0000000795a1954c 59ca59ca59ca59ca
0x0000700002bb4350:   9e3afcb9b15e00af 00007fc58780b1e0
0x0000700002bb4360:   00000007402bf4c8 0000000795a19548
0x0000700002bb4370:   0000700002bb4498 0000700002bb44b0
0x0000700002bb4380:   0000700002bb43d0 000000010cbf6e72
0x0000700002bb4390:   00007fc58750d390 0000700002bb4498
0x0000700002bb43a0:   00000004000003d8 000000010cbb3da0
0x0000700002bb43b0:   0000000000000000 000000010cbb3da0
0x0000700002bb43c0:   0000700002bb44b0 00007fc58780b000
0x0000700002bb43d0:   0000700002bb4460 000000011053f407
0x0000700002bb43e0:   0000000000000000 0000000000000000
0x0000700002bb43f0:   000070000a7b07f1 000000010cbb28b0
0x0000700002bb4400:   0000700002bb4448 000000010cbb34b0
0x0000700002bb4410:   0000000000000000 000000010cbb28e8
0x0000700002bb4420:   0000700002bb4420 0000000000000000
0x0000700002bb4430:   0000700002bb44b0 000000010cbb3fd8
0x0000700002bb4440:   0000000000000000 000000010cbb3da0
0x0000700002bb4450:   0000000000000000 0000700002bb4480
0x0000700002bb4460:   0000700002bb44f8 000000011052ea40
0x0000700002bb4470:   00000007959ee758 0000000110538a56
0x0000700002bb4480:   000000000a7b07f1 0000000000000000
0x0000700002bb4490:   0000000000000000 00000007402bf4b8
0x0000700002bb44a0:   0000000000000004 0000000000000000
0x0000700002bb44b0:   0000000795a19538 0000700002bb44b8
0x0000700002bb44c0:   000000010cbae4de 0000700002bb4538
0x0000700002bb44d0:   000000010cbaf5a0 0000000000000000
0x0000700002bb44e0:   000000010cbae570 0000700002bb4480
0x0000700002bb44f0:   0000700002bb4510 0000700002bb4580
0x0000700002bb4500:   000000011052ea40 0000000000000000
0x0000700002bb4510:   000000000a7b07f1 0000000000000000
0x0000700002bb4520:   00000007402bf4b8 0000000000000004
0x0000700002bb4530:   0000000795a19538 00000007959c6ca0 

Instructions: (pc=0x000000010cc02114)
0x000000010cc020f4:   89 17 48 83 c7 08 48 83 c0 08 4c 39 f7 72 ed 4c
0x000000010cc02104:   01 fb eb 2c 0f 1f 84 00 00 00 00 00 48 8d 4b 01
0x000000010cc02114:   48 8b 11 48 89 17 41 80 fb 90 72 08 48 8b 53 09
0x000000010cc02124:   48 89 57 08 48 01 c7 48 01 c1 48 89 cb 49 89 fe 

Register to memory mapping:

RAX=0x0000000000000000 is an unknown value
RBX=0x0000000797fffffa is an unknown value
RCX=0x0000000797fffffb is an unknown value
RDX=0x0000000000000000 is an unknown value
RSP=0x0000700002bb4340 is pointing into the stack for thread: 0x00007fc58780b000
RBP=0x0000700002bb4380 is pointing into the stack for thread: 0x00007fc58780b000
RSI=0x00000007402bf4c8 is pointing into object: 0x00000007402bf4b8
[B 
 - klass: {type array byte}
 - length: 175835121
RDI=0x000000074492ab81 is pointing into object: 0x00000007402bf4b8
[B 
 - klass: {type array byte}
 - length: 175835121
R8 =0x000000074aa6fcb9 is pointing into object: 0x00000007402bf4b8
[B 
 - klass: {type array byte}
 - length: 175835121
R9 =0x000000000a7b07f1 is an unknown value
R10=0x000000074aa6fc79 is pointing into object: 0x00000007402bf4b8
[B 
 - klass: {type array byte}
 - length: 175835121
R11=0x0000000000000000 is an unknown value
R12=0x000000074aa6fcb1 is pointing into object: 0x00000007402bf4b8
[B 
 - klass: {type array byte}
 - length: 175835121
R13=0x0000000000000000 is an unknown value
R14=0x000000074492ab8d is pointing into object: 0x00000007402bf4b8
[B 
 - klass: {type array byte}
 - length: 175835121
R15=0xffffffffffff0044 is an unknown value

Stack: [0x0000700002ab5000,0x0000700002bb5000],  sp=0x0000700002bb4340,  free space=1020k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C  [liblz4-java-5063632643145635159.dylib+0xc114]  LZ4_decompress_fast+0xe4
C  [liblz4-java-5063632643145635159.dylib+0xe72]  Java_net_jpountz_lz4_LZ4JNI_LZ4_1decompress_1fast+0xa2
j  net.jpountz.lz4.LZ4JNI.LZ4_decompress_fast([BLjava/nio/ByteBuffer;I[BLjava/nio/ByteBuffer;II)I+0
j  net.jpountz.lz4.LZ4JNIFastDecompressor.decompress([BI[BII)I+22
j  net.jpountz.lz4.LZ4FastDecompressor.decompress([BII)[B+12
j  net.jpountz.lz4.LZ4DecompressorWithLength.decompress([BI)[B+15
j  net.jpountz.lz4.LZ4DecompressorWithLength.decompress([B)[B+3
j  com.example.demo.DemoApplication.run([Ljava/lang/String;)V+195
j  org.springframework.boot.SpringApplication.callRunner(Lorg/springframework/boot/CommandLineRunner;Lorg/springframework/boot/ApplicationArguments;)V+7
j  org.springframework.boot.SpringApplication.callRunners(Lorg/springframework/context/ApplicationContext;Lorg/springframework/boot/ApplicationArguments;)V+119
j  org.springframework.boot.SpringApplication.run([Ljava/lang/String;)Lorg/springframework/context/ConfigurableApplicationContext;+168
j  org.springframework.boot.SpringApplication.run([Ljava/lang/Class;[Ljava/lang/String;)Lorg/springframework/context/ConfigurableApplicationContext;+9
j  org.springframework.boot.SpringApplication.run(Ljava/lang/Class;[Ljava/lang/String;)Lorg/springframework/context/ConfigurableApplicationContext;+9
j  com.example.demo.DemoApplication.main([Ljava/lang/String;)V+3
v  ~StubRoutines::call_stub
V  [libjvm.dylib+0x2e388b]
V  [libjvm.dylib+0x2fe674]
V  [libjvm.dylib+0x2f704f]
C  [java+0x38c6]  JavaMain+0x9c4
C  [libsystem_pthread.dylib+0x6109]  _pthread_start+0x94
C  [libsystem_pthread.dylib+0x1b8b]  thread_start+0xf
C  0x0000000000000000

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j  net.jpountz.lz4.LZ4JNI.LZ4_decompress_fast([BLjava/nio/ByteBuffer;I[BLjava/nio/ByteBuffer;II)I+0
j  net.jpountz.lz4.LZ4JNIFastDecompressor.decompress([BI[BII)I+22
j  net.jpountz.lz4.LZ4FastDecompressor.decompress([BII)[B+12
j  net.jpountz.lz4.LZ4DecompressorWithLength.decompress([BI)[B+15
j  net.jpountz.lz4.LZ4DecompressorWithLength.decompress([B)[B+3
j  com.example.demo.DemoApplication.run([Ljava/lang/String;)V+195
j  org.springframework.boot.SpringApplication.callRunner(Lorg/springframework/boot/CommandLineRunner;Lorg/springframework/boot/ApplicationArguments;)V+7
j  org.springframework.boot.SpringApplication.callRunners(Lorg/springframework/context/ApplicationContext;Lorg/springframework/boot/ApplicationArguments;)V+119
j  org.springframework.boot.SpringApplication.run([Ljava/lang/String;)Lorg/springframework/context/ConfigurableApplicationContext;+168
j  org.springframework.boot.SpringApplication.run([Ljava/lang/Class;[Ljava/lang/String;)Lorg/springframework/context/ConfigurableApplicationContext;+9
j  org.springframework.boot.SpringApplication.run(Ljava/lang/Class;[Ljava/lang/String;)Lorg/springframework/context/ConfigurableApplicationContext;+9
j  com.example.demo.DemoApplication.main([Ljava/lang/String;)V+3
v  ~StubRoutines::call_stub

---------------  P R O C E S S  ---------------

Java Threads: ( => current thread )
  0x00007fc5880d8800 JavaThread "RMI Scheduler(0)" daemon [_thread_blocked, id=42243, stack(0x0000700004300000,0x0000700004400000)]
  0x00007fc5880b5000 JavaThread "RMI TCP Connection(1)-192.168.1.6" daemon [_thread_in_native, id=42755, stack(0x00007000041fd000,0x00007000042fd000)]
  0x00007fc589a32800 JavaThread "Attach Listener" daemon [_thread_blocked, id=22275, stack(0x00007000040fa000,0x00007000041fa000)]
  0x00007fc589a20000 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=21763, stack(0x0000700003ef4000,0x0000700003ff4000)]
  0x00007fc589954000 JavaThread "Service Thread" daemon [_thread_blocked, id=17155, stack(0x0000700003df1000,0x0000700003ef1000)]
  0x00007fc58994b800 JavaThread "C1 CompilerThread3" daemon [_thread_blocked, id=16387, stack(0x0000700003cee000,0x0000700003dee000)]
  0x00007fc58802f800 JavaThread "C2 CompilerThread2" daemon [_thread_blocked, id=15875, stack(0x0000700003beb000,0x0000700003ceb000)]
  0x00007fc58800f000 JavaThread "C2 CompilerThread1" daemon [_thread_blocked, id=15363, stack(0x0000700003ae8000,0x0000700003be8000)]
  0x00007fc589942800 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=17667, stack(0x00007000039e5000,0x0000700003ae5000)]
  0x00007fc58993d800 JavaThread "Monitor Ctrl-Break" daemon [_thread_in_native, id=18179, stack(0x00007000038e2000,0x00007000039e2000)]
  0x00007fc588020000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=14851, stack(0x00007000037df000,0x00007000038df000)]
  0x00007fc58980f800 JavaThread "Finalizer" daemon [_thread_blocked, id=20227, stack(0x00007000035d6000,0x00007000036d6000)]
  0x00007fc58980f000 JavaThread "Reference Handler" daemon [_thread_blocked, id=20739, stack(0x00007000034d3000,0x00007000035d3000)]
=>0x00007fc58780b000 JavaThread "main" [_thread_in_native, id=3075, stack(0x0000700002ab5000,0x0000700002bb5000)]

Other Threads:
  0x00007fc58780d800 VMThread [stack: 0x00007000033d0000,0x00007000034d0000] [id=12803]
  0x00007fc588871000 WatcherThread [stack: 0x0000700003ff7000,0x00007000040f7000] [id=43267]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

heap address: 0x0000000740000000, size: 2048 MB, Compressed Oops mode: Zero based, Oop shift amount: 3
Narrow klass base: 0x0000000000000000, Narrow klass shift: 3
Compressed class space size: 1073741824 Address: 0x00000007c0000000

Heap:
 PSYoungGen      total 38400K, used 10108K [0x0000000795580000, 0x0000000798000000, 0x00000007c0000000)
  eden space 33280K, 15% used [0x0000000795580000,0x0000000795a629f8,0x0000000797600000)
  from space 5120K, 99% used [0x0000000797600000,0x0000000797afc798,0x0000000797b00000)
  to   space 5120K, 0% used [0x0000000797b00000,0x0000000797b00000,0x0000000798000000)
 ParOldGen       total 259584K, used 174527K [0x0000000740000000, 0x000000074fd80000, 0x0000000795580000)
  object space 259584K, 67% used [0x0000000740000000,0x000000074aa6fcc0,0x000000074fd80000)
 Metaspace       used 17792K, capacity 18800K, committed 19072K, reserved 1064960K
  class space    used 2351K, capacity 2586K, committed 2688K, reserved 1048576K

Card table byte_map: [0x00000001052f4000,0x00000001056f5000] byte_map_base: 0x00000001018f4000

Marking Bits: (ParMarkBitMap*) 0x0000000104c9d4d0
 Begin Bits: [0x00000001059a0000, 0x00000001079a0000)
 End Bits:   [0x00000001079a0000, 0x00000001099a0000)

Polling page: 0x0000000103264000

CodeCache: size=245760Kb used=3968Kb max_used=3968Kb free=241791Kb
 bounds [0x0000000110527000, 0x0000000110917000, 0x000000011f527000]
 total_blobs=2279 nmethods=1891 adapters=302
 compilation: enabled

Compilation events (10 events):
Event: 20.900 Thread 0x00007fc58994b800 1886       1       org.springframework.core.ResolvableType::isArray (58 bytes)
Event: 20.900 Thread 0x00007fc58994b800 nmethod 1886 0x0000000110905310 code [0x00000001109054a0, 0x0000000110905748]
Event: 20.900 Thread 0x00007fc58994b800 1889       1       java.util.Objects::hashCode (13 bytes)
Event: 20.900 Thread 0x00007fc58994b800 nmethod 1889 0x0000000110905850 code [0x00000001109059c0, 0x0000000110905ae8]
Event: 20.900 Thread 0x00007fc58994b800 1892       1       java.lang.String::<init> (38 bytes)
Event: 20.900 Thread 0x00007fc58994b800 nmethod 1892 0x0000000110905b50 code [0x0000000110905ce0, 0x0000000110905f28]
Event: 20.900 Thread 0x00007fc58994b800 1891       1       java.util.jar.Attributes::putValue (17 bytes)
Event: 20.900 Thread 0x00007fc58994b800 nmethod 1891 0x0000000110906050 code [0x00000001109061c0, 0x00000001109063b8]
Event: 20.900 Thread 0x00007fc58994b800 1888       1       org.springframework.core.ResolvableType::forType (17 bytes)
Event: 20.900 Thread 0x00007fc58994b800 nmethod 1888 0x00000001109064d0 code [0x0000000110906640, 0x0000000110906808]

GC Heap History (6 events):
Event: 5.461 GC heap before
{Heap before GC invocations=1 (full 0):
 PSYoungGen      total 38400K, used 33280K [0x0000000795580000, 0x0000000798000000, 0x00000007c0000000)
  eden space 33280K, 100% used [0x0000000795580000,0x0000000797600000,0x0000000797600000)
  from space 5120K, 0% used [0x0000000797b00000,0x0000000797b00000,0x0000000798000000)
  to   space 5120K, 0% used [0x0000000797600000,0x0000000797600000,0x0000000797b00000)
 ParOldGen       total 87552K, used 0K [0x0000000740000000, 0x0000000745580000, 0x0000000795580000)
  object space 87552K, 0% used [0x0000000740000000,0x0000000740000000,0x0000000745580000)
 Metaspace       used 11716K, capacity 12032K, committed 12288K, reserved 1060864K
  class space    used 1416K, capacity 1514K, committed 1536K, reserved 1048576K
Event: 5.465 GC heap after
Heap after GC invocations=1 (full 0):
 PSYoungGen      total 38400K, used 4745K [0x0000000795580000, 0x0000000798000000, 0x00000007c0000000)
  eden space 33280K, 0% used [0x0000000795580000,0x0000000795580000,0x0000000797600000)
  from space 5120K, 92% used [0x0000000797600000,0x0000000797aa2580,0x0000000797b00000)
  to   space 5120K, 0% used [0x0000000797b00000,0x0000000797b00000,0x0000000798000000)
 ParOldGen       total 87552K, used 16K [0x0000000740000000, 0x0000000745580000, 0x0000000795580000)
  object space 87552K, 0% used [0x0000000740000000,0x0000000740004000,0x0000000745580000)
 Metaspace       used 11716K, capacity 12032K, committed 12288K, reserved 1060864K
  class space    used 1416K, capacity 1514K, committed 1536K, reserved 1048576K
}
Event: 20.688 GC heap before
{Heap before GC invocations=2 (full 0):
 PSYoungGen      total 38400K, used 38025K [0x0000000795580000, 0x0000000798000000, 0x00000007c0000000)
  eden space 33280K, 100% used [0x0000000795580000,0x0000000797600000,0x0000000797600000)
  from space 5120K, 92% used [0x0000000797600000,0x0000000797aa2580,0x0000000797b00000)
  to   space 5120K, 0% used [0x0000000797b00000,0x0000000797b00000,0x0000000798000000)
 ParOldGen       total 87552K, used 16K [0x0000000740000000, 0x0000000745580000, 0x0000000795580000)
  object space 87552K, 0% used [0x0000000740000000,0x0000000740004000,0x0000000745580000)
 Metaspace       used 15319K, capacity 15970K, committed 16256K, reserved 1062912K
  class space    used 1958K, capacity 2143K, committed 2176K, reserved 1048576K
Event: 20.693 GC heap after
Heap after GC invocations=2 (full 0):
 PSYoungGen      total 38400K, used 5112K [0x0000000795580000, 0x0000000798000000, 0x00000007c0000000)
  eden space 33280K, 0% used [0x0000000795580000,0x0000000795580000,0x0000000797600000)
  from space 5120K, 99% used [0x0000000797b00000,0x0000000797ffe1e8,0x0000000798000000)
  to   space 5120K, 0% used [0x0000000797600000,0x0000000797600000,0x0000000797b00000)
 ParOldGen       total 87552K, used 1368K [0x0000000740000000, 0x0000000745580000, 0x0000000795580000)
  object space 87552K, 1% used [0x0000000740000000,0x0000000740156100,0x0000000745580000)
 Metaspace       used 15319K, capacity 15970K, committed 16256K, reserved 1062912K
  class space    used 1958K, capacity 2143K, committed 2176K, reserved 1048576K
}
Event: 20.857 GC heap before
{Heap before GC invocations=3 (full 0):
 PSYoungGen      total 38400K, used 38392K [0x0000000795580000, 0x0000000798000000, 0x00000007c0000000)
  eden space 33280K, 100% used [0x0000000795580000,0x0000000797600000,0x0000000797600000)
  from space 5120K, 99% used [0x0000000797b00000,0x0000000797ffe1e8,0x0000000798000000)
  to   space 5120K, 0% used [0x0000000797600000,0x0000000797600000,0x0000000797b00000)
 ParOldGen       total 87552K, used 1368K [0x0000000740000000, 0x0000000745580000, 0x0000000795580000)
  object space 87552K, 1% used [0x0000000740000000,0x0000000740156100,0x0000000745580000)
 Metaspace       used 17360K, capacity 18266K, committed 18432K, reserved 1064960K
  class space    used 2263K, capacity 2479K, committed 2560K, reserved 1048576K
Event: 20.861 GC heap after
Heap after GC invocations=3 (full 0):
 PSYoungGen      total 38400K, used 5105K [0x0000000795580000, 0x0000000798000000, 0x00000007c0000000)
  eden space 33280K, 0% used [0x0000000795580000,0x0000000795580000,0x0000000797600000)
  from space 5120K, 99% used [0x0000000797600000,0x0000000797afc798,0x0000000797b00000)
  to   space 5120K, 0% used [0x0000000797b00000,0x0000000797b00000,0x0000000798000000)
 ParOldGen       total 87552K, used 2813K [0x0000000740000000, 0x0000000745580000, 0x0000000795580000)
  object space 87552K, 3% used [0x0000000740000000,0x00000007402bf4b8,0x0000000745580000)
 Metaspace       used 17360K, capacity 18266K, committed 18432K, reserved 1064960K
  class space    used 2263K, capacity 2479K, committed 2560K, reserved 1048576K
}

Deoptimization events (0 events):
No events

Classes redefined (0 events):
No events

Internal exceptions (10 events):
Event: 20.720 Thread 0x00007fc58780b000 Exception <a 'java/lang/IncompatibleClassChangeError': Found class java.lang.Object, but interface was expected> (0x0000000795bc3980) thrown at [/Users/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-mac-x64-hotspot/workspace/build/src/hotspot/src/share/
Event: 20.736 Thread 0x00007fc58780b000 Exception <a 'java/lang/NoSuchMethodError': java.lang.Object.lambda$getAllAnnotationAttributes$0(Lorg/springframework/util/MultiValueMap;)Lorg/springframework/util/MultiValueMap;> (0x0000000795dde298) thrown at [/Users/jenkins/workspace/build-scripts/jobs
Event: 20.736 Thread 0x00007fc58780b000 Exception <a 'java/lang/NoSuchMethodError': java.lang.Object.lambda$identity$2(Ljava/lang/Object;)Ljava/lang/Object;> (0x0000000795e451f8) thrown at [/Users/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-mac-x64-hotspot/workspace/build/src/hotspot/src/s
Event: 20.781 Thread 0x00007fc58780b000 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0x0000000796b81770) thrown at [/Users/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-mac-x64-hotspot/workspace/build/src/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 605]
Event: 20.791 Thread 0x00007fc58780b000 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0x0000000796cc5e90) thrown at [/Users/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-mac-x64-hotspot/workspace/build/src/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 605]
Event: 20.795 Thread 0x00007fc58780b000 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0x0000000796d3b310) thrown at [/Users/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-mac-x64-hotspot/workspace/build/src/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 605]
Event: 20.863 Thread 0x00007fc58780b000 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0x00000007955a2740) thrown at [/Users/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-mac-x64-hotspot/workspace/build/src/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 605]
Event: 20.893 Thread 0x00007fc58780b000 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0x00000007958f74f0) thrown at [/Users/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-mac-x64-hotspot/workspace/build/src/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 605]
Event: 20.893 Thread 0x00007fc58780b000 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0x00000007959001d0) thrown at [/Users/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-mac-x64-hotspot/workspace/build/src/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 605]
Event: 20.893 Thread 0x00007fc58780b000 Exception <a 'java/lang/ArrayIndexOutOfBoundsException'> (0x0000000795901700) thrown at [/Users/jenkins/workspace/build-scripts/jobs/jdk8u/jdk8u-mac-x64-hotspot/workspace/build/src/hotspot/src/share/vm/runtime/sharedRuntime.cpp, line 605]

Events (10 events):
Event: 21.002 loading class java/io/DeleteOnExitHook$1
Event: 21.002 loading class java/io/DeleteOnExitHook$1 done
Event: 21.003 loading class java/util/Base64
Event: 21.003 loading class java/util/Base64 done
Event: 21.003 loading class java/util/Base64$Encoder
Event: 21.003 loading class java/util/Base64$Encoder done
Event: 21.003 loading class java/util/Base64$Decoder
Event: 21.003 loading class java/util/Base64$Decoder done
Event: 21.003 loading class net/jpountz/lz4/LZ4DecompressorWithLength
Event: 21.003 loading class net/jpountz/lz4/LZ4DecompressorWithLength done

Dynamic libraries:
0x00007fff2f939000  /System/Library/Frameworks/Cocoa.framework/Versions/A/Cocoa
0x00007fff3d12e000  /System/Library/Frameworks/Security.framework/Versions/A/Security
0x00007fff2e89e000  /System/Library/Frameworks/ApplicationServices.framework/Versions/A/ApplicationServices
0x00007fff69c51000  /usr/lib/libz.1.dylib
0x00007fff67715000  /usr/lib/libSystem.B.dylib
0x00007fff69575000  /usr/lib/libobjc.A.dylib
0x00007fff32e98000  /System/Library/Frameworks/Foundation.framework/Versions/C/Foundation
0x00007fff307db000  /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
0x00007fff2da8e000  /System/Library/Frameworks/AppKit.framework/Versions/C/AppKit
0x00007fff302bd000  /System/Library/Frameworks/CoreData.framework/Versions/A/CoreData
0x00007fff6172b000  /System/Library/PrivateFrameworks/UIFoundation.framework/Versions/A/UIFoundation
0x00007fff5c7bf000  /System/Library/PrivateFrameworks/RemoteViewServices.framework/Versions/A/RemoteViewServices
0x00007fff64285000  /System/Library/PrivateFrameworks/XCTTargetBootstrap.framework/Versions/A/XCTTargetBootstrap
0x00007fff306a8000  /System/Library/Frameworks/CoreDisplay.framework/Versions/A/CoreDisplay
0x00007fff35d52000  /System/Library/Frameworks/Metal.framework/Versions/A/Metal
0x00007fff4a7c2000  /System/Library/PrivateFrameworks/DesktopServicesPriv.framework/Versions/A/DesktopServicesPriv
0x00007fff68850000  /usr/lib/liblangid.dylib
0x00007fff49a57000  /System/Library/PrivateFrameworks/CoreSVG.framework/Versions/A/CoreSVG
0x00007fff5f91b000  /System/Library/PrivateFrameworks/SkyLight.framework/Versions/A/SkyLight
0x00007fff30c5c000  /System/Library/Frameworks/CoreGraphics.framework/Versions/A/CoreGraphics
0x00007fff2c462000  /System/Library/Frameworks/Accelerate.framework/Versions/A/Accelerate
0x00007fff69b42000  /usr/lib/libxml2.2.dylib
0x00007fff5574a000  /System/Library/PrivateFrameworks/IconServices.framework/Versions/A/IconServices
0x00007fff33677000  /System/Library/Frameworks/IOSurface.framework/Versions/A/IOSurface
0x00007fff6723f000  /usr/lib/libDiagnosticMessagesClient.dylib
0x00007fff4a61c000  /System/Library/PrivateFrameworks/DFRFoundation.framework/Versions/A/DFRFoundation
0x00007fff685df000  /usr/lib/libicucore.A.dylib
0x00007fff2ebd0000  /System/Library/Frameworks/AudioToolbox.framework/Versions/A/AudioToolbox
0x00007fff2ecb3000  /System/Library/Frameworks/AudioUnit.framework/Versions/A/AudioUnit
0x00007fff67917000  /usr/lib/libauto.dylib
0x00007fff4a6be000  /System/Library/PrivateFrameworks/DataDetectorsCore.framework/Versions/A/DataDetectorsCore
0x00007fff2f45a000  /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/HIToolbox.framework/Versions/A/HIToolbox
0x00007fff3c32a000  /System/Library/Frameworks/QuartzCore.framework/Versions/A/QuartzCore
0x00007fff2f799000  /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/SpeechRecognition.framework/Versions/A/SpeechRecognition
0x00007fff4a130000  /System/Library/PrivateFrameworks/CoreUI.framework/Versions/A/CoreUI
0x00007fff2fd28000  /System/Library/Frameworks/CoreAudio.framework/Versions/A/CoreAudio
0x00007fff32b57000  /System/Library/Frameworks/DiskArbitration.framework/Versions/A/DiskArbitration
0x00007fff5779a000  /System/Library/PrivateFrameworks/MultitouchSupport.framework/Versions/A/MultitouchSupport
0x00007fff684a6000  /usr/lib/libenergytrace.dylib
0x00007fff335d1000  /System/Library/Frameworks/IOKit.framework/Versions/A/IOKit
0x00007fff31bc3000  /System/Library/Frameworks/CoreServices.framework/Versions/A/CoreServices
0x00007fff59952000  /System/Library/PrivateFrameworks/PerformanceAnalysis.framework/Versions/A/PerformanceAnalysis
0x00007fff3b35d000  /System/Library/Frameworks/OpenGL.framework/Versions/A/OpenGL
0x00007fff2f947000  /System/Library/Frameworks/ColorSync.framework/Versions/A/ColorSync
0x00007fff312df000  /System/Library/Frameworks/CoreImage.framework/Versions/A/CoreImage
0x00007fff32636000  /System/Library/Frameworks/CoreText.framework/Versions/A/CoreText
0x00007fff33707000  /System/Library/Frameworks/ImageIO.framework/Versions/A/ImageIO
0x00007fff679fb000  /usr/lib/libc++.1.dylib
0x00007fff67a77000  /usr/lib/libcompression.dylib
0x00007fff67583000  /usr/lib/libMobileGestalt.dylib
0x00007fff61495000  /System/Library/PrivateFrameworks/TextureIO.framework/Versions/A/TextureIO
0x00007fff6787a000  /usr/lib/libate.dylib
0x00007fff55953000  /System/Library/PrivateFrameworks/InternationalSupport.framework/Versions/A/InternationalSupport
0x00007fff6a512000  /usr/lib/system/libcache.dylib
0x00007fff6a518000  /usr/lib/system/libcommonCrypto.dylib
0x00007fff6a524000  /usr/lib/system/libcompiler_rt.dylib
0x00007fff6a52c000  /usr/lib/system/libcopyfile.dylib
0x00007fff6a536000  /usr/lib/system/libcorecrypto.dylib
0x00007fff6a6d5000  /usr/lib/system/libdispatch.dylib
0x00007fff6a716000  /usr/lib/system/libdyld.dylib
0x00007fff6a74d000  /usr/lib/system/libkeymgr.dylib
0x00007fff6a75b000  /usr/lib/system/liblaunch.dylib
0x00007fff6a75c000  /usr/lib/system/libmacho.dylib
0x00007fff6a762000  /usr/lib/system/libquarantine.dylib
0x00007fff6a765000  /usr/lib/system/libremovefile.dylib
0x00007fff6a767000  /usr/lib/system/libsystem_asl.dylib
0x00007fff6a77f000  /usr/lib/system/libsystem_blocks.dylib
0x00007fff6a780000  /usr/lib/system/libsystem_c.dylib
0x00007fff6a808000  /usr/lib/system/libsystem_configuration.dylib
0x00007fff6a80c000  /usr/lib/system/libsystem_coreservices.dylib
0x00007fff6a810000  /usr/lib/system/libsystem_darwin.dylib
0x00007fff6a819000  /usr/lib/system/libsystem_dnssd.dylib
0x00007fff6a821000  /usr/lib/system/libsystem_featureflags.dylib
0x00007fff6a823000  /usr/lib/system/libsystem_info.dylib
0x00007fff6a89e000  /usr/lib/system/libsystem_m.dylib
0x00007fff6a8e6000  /usr/lib/system/libsystem_malloc.dylib
0x00007fff6a90e000  /usr/lib/system/libsystem_networkextension.dylib
0x00007fff6a91c000  /usr/lib/system/libsystem_notify.dylib
0x00007fff6a93a000  /usr/lib/system/libsystem_sandbox.dylib
0x00007fff6a93f000  /usr/lib/system/libsystem_secinit.dylib
0x00007fff6a871000  /usr/lib/system/libsystem_kernel.dylib
0x00007fff6a926000  /usr/lib/system/libsystem_platform.dylib
0x00007fff6a92f000  /usr/lib/system/libsystem_pthread.dylib
0x00007fff6a942000  /usr/lib/system/libsystem_symptoms.dylib
0x00007fff6a94a000  /usr/lib/system/libsystem_trace.dylib
0x00007fff6a962000  /usr/lib/system/libunwind.dylib
0x00007fff6a968000  /usr/lib/system/libxpc.dylib
0x00007fff67a4e000  /usr/lib/libc++abi.dylib
0x00007fff68852000  /usr/lib/liblzma.5.dylib
0x00007fff684cd000  /usr/lib/libfakelink.dylib
0x00007fff67807000  /usr/lib/libarchive.2.dylib
0x00007fff3e1df000  /System/Library/Frameworks/SystemConfiguration.framework/Versions/A/SystemConfiguration
0x00007fff67172000  /usr/lib/libCRFSuite.dylib
0x00007fff2f04a000  /System/Library/Frameworks/CFNetwork.framework/Versions/A/CFNetwork
0x00007fff679dd000  /usr/lib/libbsm.0.dylib
0x00007fff6a74e000  /usr/lib/system/libkxld.dylib
0x00007fff43f99000  /System/Library/PrivateFrameworks/AppleFSCompression.framework/Versions/A/AppleFSCompression
0x00007fff67d68000  /usr/lib/libcoretls.dylib
0x00007fff67d7f000  /usr/lib/libcoretls_cfhelpers.dylib
0x00007fff695bb000  /usr/lib/libpam.2.dylib
0x00007fff696f0000  /usr/lib/libsqlite3.dylib
0x00007fff69b2f000  /usr/lib/libxar.1.dylib
0x00007fff679ee000  /usr/lib/libbz2.1.0.dylib
0x00007fff684ee000  /usr/lib/libiconv.2.dylib
0x00007fff67a64000  /usr/lib/libcharset.1.dylib
0x00007fff69058000  /usr/lib/libnetwork.dylib
0x00007fff695c2000  /usr/lib/libpcap.A.dylib
0x00007fff677bc000  /usr/lib/libapple_nghttp2.dylib
0x00007fff31f7a000  /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/FSEvents.framework/Versions/A/FSEvents
0x00007fff31c4a000  /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/CarbonCore.framework/Versions/A/CarbonCore
0x00007fff321be000  /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/Metadata.framework/Versions/A/Metadata
0x00007fff32257000  /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/OSServices.framework/Versions/A/OSServices
0x00007fff32285000  /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/SearchKit.framework/Versions/A/SearchKit
0x00007fff31bc4000  /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/AE.framework/Versions/A/AE
0x00007fff31f83000  /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/LaunchServices.framework/Versions/A/LaunchServices
0x00007fff31f2c000  /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/DictionaryServices.framework/Versions/A/DictionaryServices
0x00007fff322ed000  /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/SharedFileList.framework/Versions/A/SharedFileList
0x00007fff3717c000  /System/Library/Frameworks/NetFS.framework/Versions/A/NetFS
0x00007fff57cca000  /System/Library/PrivateFrameworks/NetAuth.framework/Versions/A/NetAuth
0x00007fff64652000  /System/Library/PrivateFrameworks/login.framework/Versions/A/Frameworks/loginsupport.framework/Versions/A/loginsupport
0x00007fff60f60000  /System/Library/PrivateFrameworks/TCC.framework/Versions/A/TCC
0x00007fff48bca000  /System/Library/PrivateFrameworks/CoreNLP.framework/Versions/A/CoreNLP
0x00007fff571c7000  /System/Library/PrivateFrameworks/MetadataUtilities.framework/Versions/A/MetadataUtilities
0x00007fff6892a000  /usr/lib/libmecabra.dylib
0x00007fff68882000  /usr/lib/libmecab.dylib
0x00007fff684de000  /usr/lib/libgermantok.dylib
0x00007fff677a3000  /usr/lib/libThaiTokenizer.dylib
0x00007fff671a9000  /usr/lib/libChineseTokenizer.dylib
0x00007fff2c47a000  /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vImage.framework/Versions/A/vImage
0x00007fff2d8e4000  /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/vecLib
0x00007fff2d821000  /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libvMisc.dylib
0x00007fff2d649000  /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libvDSP.dylib
0x00007fff2cad1000  /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBLAS.dylib
0x00007fff2d20d000  /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libLAPACK.dylib
0x00007fff2d5a9000  /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libLinearAlgebra.dylib
0x00007fff2d636000  /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libSparseBLAS.dylib
0x00007fff2d5bf000  /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libQuadrature.dylib
0x00007fff2cd39000  /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBNNS.dylib
0x00007fff2d5c5000  /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libSparse.dylib
0x00007fff55d3b000  /System/Library/PrivateFrameworks/LanguageModeling.framework/Versions/A/LanguageModeling
0x00007fff4857a000  /System/Library/PrivateFrameworks/CoreEmoji.framework/Versions/A/CoreEmoji
0x00007fff55e59000  /System/Library/PrivateFrameworks/LinguisticData.framework/Versions/A/LinguisticData
0x00007fff55e0a000  /System/Library/PrivateFrameworks/Lexicon.framework/Versions/A/Lexicon
0x00007fff67a65000  /usr/lib/libcmph.dylib
0x00007fff39d6b000  /System/Library/Frameworks/OpenDirectory.framework/Versions/A/Frameworks/CFOpenDirectory.framework/Versions/A/CFOpenDirectory
0x00007fff39d88000  /System/Library/Frameworks/OpenDirectory.framework/Versions/A/OpenDirectory
0x00007fff421c9000  /System/Library/PrivateFrameworks/APFS.framework/Versions/A/APFS
0x00007fff3d478000  /System/Library/Frameworks/SecurityFoundation.framework/Versions/A/SecurityFoundation
0x00007fff69b2b000  /usr/lib/libutil.dylib
0x00007fff49aaf000  /System/Library/PrivateFrameworks/CoreServicesStore.framework/Versions/A/CoreServicesStore
0x00007fff3d52f000  /System/Library/Frameworks/ServiceManagement.framework/Versions/A/ServiceManagement
0x00007fff45769000  /System/Library/PrivateFrameworks/BackgroundTaskManagement.framework/Versions/A/BackgroundTaskManagement
0x00007fff69c28000  /usr/lib/libxslt.1.dylib
0x00007fff4460c000  /System/Library/PrivateFrameworks/AppleSystemInfo.framework/Versions/A/AppleSystemInfo
0x00007fff33922000  /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libJPEG.dylib
0x00007fff33be0000  /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libTIFF.dylib
0x00007fff33bc3000  /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libPng.dylib
0x00007fff33864000  /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libGIF.dylib
0x00007fff33868000  /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libJP2.dylib
0x00007fff33bde000  /System/Library/Frameworks/ImageIO.framework/Versions/A/Resources/libRadiance.dylib
0x00007fff684a7000  /usr/lib/libexpat.1.dylib
0x00007fff440f4000  /System/Library/PrivateFrameworks/AppleJPEG.framework/Versions/A/AppleJPEG
0x00007fff4cdaf000  /System/Library/PrivateFrameworks/FontServices.framework/libFontParser.dylib
0x00007fff63654000  /System/Library/PrivateFrameworks/WatchdogClient.framework/Versions/A/WatchdogClient
0x00007fff55396000  /System/Library/PrivateFrameworks/IOAccelerator.framework/Versions/A/IOAccelerator
0x00007fff360ed000  /System/Library/Frameworks/MetalPerformanceShaders.framework/Versions/A/MetalPerformanceShaders
0x00007fff51b2c000  /System/Library/PrivateFrameworks/GPUWrangler.framework/Versions/A/GPUWrangler
0x00007fff553ab000  /System/Library/PrivateFrameworks/IOPresentment.framework/Versions/A/IOPresentment
0x00007fff4a62f000  /System/Library/PrivateFrameworks/DSExternalDisplay.framework/Versions/A/DSExternalDisplay
0x00007fff3a6fc000  /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libCoreFSCache.dylib
0x00007fff35e39000  /System/Library/Frameworks/MetalPerformanceShaders.framework/Frameworks/MPSCore.framework/Versions/A/MPSCore
0x00007fff35e77000  /System/Library/Frameworks/MetalPerformanceShaders.framework/Frameworks/MPSImage.framework/Versions/A/MPSImage
0x00007fff35f3e000  /System/Library/Frameworks/MetalPerformanceShaders.framework/Frameworks/MPSNeuralNetwork.framework/Versions/A/MPSNeuralNetwork
0x00007fff35f02000  /System/Library/Frameworks/MetalPerformanceShaders.framework/Frameworks/MPSMatrix.framework/Versions/A/MPSMatrix
0x00007fff3609d000  /System/Library/Frameworks/MetalPerformanceShaders.framework/Frameworks/MPSRayIntersector.framework/Versions/A/MPSRayIntersector
0x00007fff35f28000  /System/Library/Frameworks/MetalPerformanceShaders.framework/Frameworks/MPSNDArray.framework/Versions/A/MPSNDArray
0x00007fff57214000  /System/Library/PrivateFrameworks/MetalTools.framework/Versions/A/MetalTools
0x00007fff433a3000  /System/Library/PrivateFrameworks/AggregateDictionary.framework/Versions/A/AggregateDictionary
0x00007fff47fc2000  /System/Library/PrivateFrameworks/CoreAnalytics.framework/Versions/A/CoreAnalytics
0x00007fff4452b000  /System/Library/PrivateFrameworks/AppleSauce.framework/Versions/A/AppleSauce
0x00007fff67465000  /usr/lib/libIOReport.dylib
0x00007fff327ee000  /System/Library/Frameworks/CoreVideo.framework/Versions/A/CoreVideo
0x00007fff52fa5000  /System/Library/PrivateFrameworks/GraphVisualizer.framework/Versions/A/GraphVisualizer
0x00007fff4c2f5000  /System/Library/PrivateFrameworks/FaceCore.framework/Versions/A/FaceCore
0x00007fff39d12000  /System/Library/Frameworks/OpenCL.framework/Versions/A/OpenCL
0x00007fff67287000  /usr/lib/libFosl_dynamic.dylib
0x00007fff586ea000  /System/Library/PrivateFrameworks/OTSVG.framework/Versions/A/OTSVG
0x00007fff2e9a3000  /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ATS.framework/Versions/A/Resources/libFontRegistry.dylib
0x00007fff4cf80000  /System/Library/PrivateFrameworks/FontServices.framework/libhvf.dylib
0x00007fff3a707000  /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGFXShared.dylib
0x00007fff3a8e5000  /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGLU.dylib
0x00007fff3a710000  /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGL.dylib
0x00007fff3a71b000  /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGLImage.dylib
0x00007fff3a6f9000  /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libCVMSPluginSupport.dylib
0x00007fff3a702000  /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libCoreVMClient.dylib
0x00007fff68ef9000  /usr/lib/libncurses.5.4.dylib
0x00007fff2e89f000  /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ATS.framework/Versions/A/ATS
0x00007fff2ea6c000  /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ColorSyncLegacy.framework/Versions/A/ColorSyncLegacy
0x00007fff2eb0a000  /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/HIServices.framework/Versions/A/HIServices
0x00007fff2eb62000  /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/LangAnalysis.framework/Versions/A/LangAnalysis
0x00007fff2eb71000  /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/PrintCore.framework/Versions/A/PrintCore
0x00007fff2ebb7000  /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/QD.framework/Versions/A/QD
0x00007fff2ebc2000  /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/SpeechSynthesis.framework/Versions/A/SpeechSynthesis
0x00007fff2ea3c000  /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ATSUI.framework/Versions/A/ATSUI
0x00007fff6833d000  /usr/lib/libcups.2.dylib
0x00007fff35188000  /System/Library/Frameworks/Kerberos.framework/Versions/A/Kerberos
0x00007fff332ca000  /System/Library/Frameworks/GSS.framework/Versions/A/GSS
0x00007fff6967c000  /usr/lib/libresolv.9.dylib
0x00007fff53152000  /System/Library/PrivateFrameworks/Heimdal.framework/Versions/A/Heimdal
0x00007fff3519b000  /System/Library/Frameworks/Kerberos.framework/Versions/A/Libraries/libHeimdalProxy.dylib
0x00007fff684e4000  /usr/lib/libheimdal-asn1.dylib
0x00007fff4745a000  /System/Library/PrivateFrameworks/CommonAuth.framework/Versions/A/CommonAuth
0x00007fff446a9000  /System/Library/PrivateFrameworks/AssertionServices.framework/Versions/A/AssertionServices
0x00007fff4524c000  /System/Library/PrivateFrameworks/AudioToolboxCore.framework/Versions/A/AudioToolboxCore
0x00007fff64302000  /System/Library/PrivateFrameworks/caulk.framework/Versions/A/caulk
0x00007fff45815000  /System/Library/PrivateFrameworks/BaseBoard.framework/Versions/A/BaseBoard
0x00007fff5c94d000  /System/Library/PrivateFrameworks/RunningBoardServices.framework/Versions/A/RunningBoardServices
0x00007fff5995e000  /System/Library/PrivateFrameworks/PersistentConnection.framework/Versions/A/PersistentConnection
0x00007fff5c346000  /System/Library/PrivateFrameworks/ProtocolBuffer.framework/Versions/A/ProtocolBuffer
0x00007fff4747e000  /System/Library/PrivateFrameworks/CommonUtilities.framework/Versions/A/CommonUtilities
0x00007fff459a3000  /System/Library/PrivateFrameworks/Bom.framework/Versions/A/Bom
0x00007fff67138000  /usr/lib/libAudioToolboxUtility.dylib
0x00007fff45773000  /System/Library/PrivateFrameworks/Backup.framework/Versions/A/Backup
0x00007fff4a550000  /System/Library/PrivateFrameworks/CrashReporterSupport.framework/Versions/A/CrashReporterSupport
0x00007fff5e3df000  /System/Library/PrivateFrameworks/Sharing.framework/Versions/A/Sharing
0x00007fff43cb7000  /System/Library/PrivateFrameworks/Apple80211.framework/Versions/A/Apple80211
0x00007fff45490000  /System/Library/PrivateFrameworks/AuthKit.framework/Versions/A/AuthKit
0x00007fff4a25d000  /System/Library/PrivateFrameworks/CoreUtils.framework/Versions/A/CoreUtils
0x00007fff32833000  /System/Library/Frameworks/CoreWLAN.framework/Versions/A/CoreWLAN
0x00007fff33457000  /System/Library/Frameworks/IOBluetooth.framework/Versions/A/IOBluetooth
0x00007fff57519000  /System/Library/PrivateFrameworks/MobileKeyBag.framework/Versions/A/MobileKeyBag
0x00007fff49062000  /System/Library/PrivateFrameworks/CorePhoneNumbers.framework/Versions/A/CorePhoneNumbers
0x00007fff440a7000  /System/Library/PrivateFrameworks/AppleIDAuthSupport.framework/Versions/A/AppleIDAuthSupport
0x00007fff37189000  /System/Library/Frameworks/Network.framework/Versions/A/Network
0x00007fff55be7000  /System/Library/PrivateFrameworks/KeychainCircle.framework/Versions/A/KeychainCircle
0x00007fff30284000  /System/Library/Frameworks/CoreBluetooth.framework/Versions/A/CoreBluetooth
0x00007fff6045e000  /System/Library/PrivateFrameworks/SpeechRecognitionCore.framework/Versions/A/SpeechRecognitionCore
0x0000000104400000  /Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/server/libjvm.dylib
0x00007fff699fe000  /usr/lib/libstdc++.6.dylib
0x0000000103218000  /Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/libverify.dylib
0x0000000103229000  /Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/libjava.dylib
0x0000000103265000  /Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/libinstrument.dylib
0x00000001032d3000  /Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/libzip.dylib
0x000000010c38e000  /Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/libnio.dylib
0x000000010c3a2000  /Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/libnet.dylib
0x000000010c3bd000  /Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/libmanagement.dylib
0x000000010cbf6000  /private/var/folders/f5/05mfv5g95y508lk7l2nt1htc0000gn/T/liblz4-java-5063632643145635159.dylib

VM Arguments:
jvm_args: -XX:TieredStopAtLevel=1 -Xverify:none -Dspring.output.ansi.enabled=always -Dcom.sun.management.jmxremote -Dspring.jmx.enabled=true -Dspring.liveBeansView.mbeanDomain -Dspring.application.admin.enabled=true -javaagent:/Applications/IntelliJ IDEA.app/Contents/lib/idea_rt.jar=56412:/Applications/IntelliJ IDEA.app/Contents/bin -Dfile.encoding=UTF-8 
java_command: com.example.demo.DemoApplication
java_class_path (initial): /Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/charsets.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/cldrdata.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/dnsns.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/jaccess.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/localedata.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/nashorn.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/sunec.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/sunjce_provider.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/sunpkcs11.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/ext/zipfs.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/jce.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/jsse.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/management-agent.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/resources.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/jre/lib/rt.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/lib/dt.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/lib/jconsole.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/lib/sa-jdi.jar:/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home/lib/tools.jar:/Users/sahilpaudel/Documents/Java/demo/target/classes:/Users/sahilpaudel/.m2/repository/org/springframework/boot/spring-boot-starter/2.3.0.RELEASE/spring-boot-starter-2.3.0.RELEASE.jar:/Users/sahilpaudel/.m2/repository/org/springframework/boot/spring-boot/2.3.0.RELEASE/spring-boot-2.3.0.RELEASE.j
Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home
PATH=/Users/sahilpaudel/.pyenv/versions/3.6.5/bin:/usr/local/Cellar/pyenv/1.2.20/libexec:/Users/sahilpaudel/.rvm/gems/ruby-2.4.0/bin:/Users/sahilpaudel/.rvm/gems/ruby-2.4.0@global/bin:/Users/sahilpaudel/.rvm/rubies/ruby-2.4.0/bin:/Users/sahilpaudel/.gvm/bin:/Users/sahilpaudel/.yarn/bin:/Users/sahilpaudel/.config/yarn/global/node_modules/.bin:/Users/sahilpaudel/Documents/kerl/bin:/Users/sahilpaudel/.kiex/elixirs/elixir-1.8.2/bin:/Users/sahilpaudel/.kiex/bin:/usr/local/opt/sqlite/bin:/usr/local/opt/mozjpeg/bin:/Users/sahilpaudel/Documents/Go:/usr/local/go/bin:/Users/sahilpaudel/.pyenv/shims:/Users/sahilpaudel/.cargo/bin:/Library/Frameworks/Python.framework/Versions/3.8/bin:/usr/local/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/go/bin:/Users/sahilpaudel/Documents/flutter/bin:/Users/sahilpaudel/Documents/flutter-dev/flutter/bin:/Users/sahilpaudel/.rvm/bin
SHELL=/bin/zsh

Signal Handlers:
SIGSEGV: [libjvm.dylib+0x5867db], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_ONSTACK|SA_RESTART|SA_SIGINFO
SIGBUS: [libjvm.dylib+0x5867db], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGFPE: [libjvm.dylib+0x461e20], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGPIPE: [libjvm.dylib+0x461e20], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGXFSZ: [libjvm.dylib+0x461e20], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGILL: [libjvm.dylib+0x461e20], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGUSR1: SIG_DFL, sa_mask[0]=00000000000000000000000000000000, sa_flags=none
SIGUSR2: [libjvm.dylib+0x46193e], sa_mask[0]=00100000000000000000000000000000, sa_flags=SA_RESTART|SA_SIGINFO
SIGHUP: [libjvm.dylib+0x45fec9], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGINT: [libjvm.dylib+0x45fec9], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGTERM: [libjvm.dylib+0x45fec9], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO
SIGQUIT: [libjvm.dylib+0x45fec9], sa_mask[0]=11111111011111110111111111111111, sa_flags=SA_RESTART|SA_SIGINFO

---------------  S Y S T E M  ---------------

OS:Bsduname:Darwin 19.6.0 Darwin Kernel Version 19.6.0: Sun Jul  5 00:43:10 PDT 2020; root:xnu-6153.141.1~9/RELEASE_X86_64 x86_64
rlimit: STACK 8192k, CORE 0k, NPROC 1392, NOFILE 10240, AS infinity
load average:2.09 2.49 2.52

CPU:total 8 (initial active 8) (4 cores per cpu, 2 threads per core) family 6 model 142 stepping 10, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref, lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx

Memory: 4k page, physical 8388608k(33700k free)

/proc/meminfo:

vm_info: OpenJDK 64-Bit Server VM (25.232-b09) for bsd-amd64 JRE (1.8.0_232-b09), built on Oct 19 2019 07:00:21 by "jenkins" with gcc 4.2.1 (Based on Apple Inc. build 5658) (LLVM build 2336.11.00)

time: Thu Oct  1 13:16:14 2020
timezone: IST
elapsed time: 21 seconds (0d 0h 0m 21s)

Normal java to java decoding is processed as expected.

Thanks.

odaira commented 3 years ago

Thanks for reporting. I think there are two issue here.

  1. Decompressing data that was compressed by go or ruby clients: LZ4DecompressorWithLength is not meant for this purpose. It is used for decompressing data compressed by LZ4CompressorWithLength, as stated in the document. Depending on how you compressed data using go or ruby, you may want to use either LZ4*Decompressor or LZ4InputStream. If you could give me a sample of compressed data or sample go/ruby code for compression, I can figure it out.

  2. SIGBUS error: No matter how you use the lz4-java API, a SIGBUS error should not happen. Could you give me a sample compressed data that caused this error? Also, could you tell me the following information?

sahilpaudel-pe commented 3 years ago

Sample Compressed Data (Go):

8xV7CiAgICJzdGF0dXMiOjEsCiAgICJkYXRhIjpbCiAgICAgIHsIAPcZICAgIm5hbWUiOiJhdXRvbWF0aW9uXzExMDQ0NzIyMTEzNzI2OTgiLC8A+RBkZXNjcmlwdGlvbiI6ImNyZWF0ZSBleHBlcmltZW50LAD5DGdvYWwiOiJUZXN0IHdpdGggdmFsaWQgZGF0YSgARnRhZ3OdAAICAKgiaG9tZV9wYWdlfwCSICAgImxvZ2luGgAGRAAYXVAArWlkZW50aWZpZXJXAAEdAQgCAMcic2VnbWVudCI6OTVEAAICAP4BInBsYXRmb3JtIjoiaW9zIiEA/gRkZXZpY2VfdmVyc2lvbiI6NS42JQBiZXhwcmVzIQAEcABZPT05NSIqABZ9DgAJzgBKbWV0Yb8BAgIA/AMiQVVUT01BVElPTl9URVNUXzEqAQwhAB8yIQANFzOSAAmEAAXgAA9OAQ3JQ3JlYXRlZEJ5Ijp7KwACAgAiIk5uAmx0ZXN0IHDbAQICAPsNIkVtYWlsIjoidGVzdHBlQHBoYXJtZWFzeS5pbsEAAgIA9xYiRXZlbnRUaW1lIjoiMjAyMC0wNS0yMVQwMjo1MjoyMy44NTZa2gACAgAdfUsAvyJTd2l0Y2hlZE9uwAB8LzkxwAASn1R1cm5lZE9mZr8ADQ9HAQQDeAEPHgAEB2UB/wQwMDAxLTAxLTAxVDAwOjAwOjAwYQESb0NvbXBsZSACEA+DAAQPoQBOb0FyY2hpdsACDw+gAGXdZXhwb3N1cmUiOjEwMIQAjyJzdGFydF90CgMGHlq4AP8HInNjaGVkdWxlcl9jaGVjayI6dHJ1ZVsAAo90dXMiOiJvbkUAAP8Ad2lubmluZ192YXJpYW50IgECB5cFDEgEAgIADZwFAgIABKIGCDkFDYIAAgIAfyJzcGxpdF8uBQEIAgAPaQAEAgIAfyJpZCI6IkFjAAUCAgACaQBPIjo0MCcAC89yZXR1cm5fdmFsdWVSBAMIAgAP0gUATjoiNTBwAQsCAA04AF8yIjoiMzgAIG0zIjoiMjDKAwgCAAemBgsCAA5RBQUCAA9xARAfQq4ACwRxAR429gIIAgAPcQExDzkBIV8yIjoiM5cCBgUCAA2pARIzOAAPHwEJD3EBCA8aAAMfXRcAAA1FAAolAAcfAAAZANAgICAgfQogICBdCn0K

Lz4-java: 1.7.1 OS: MacOS (10.15.6) Processor: 1.4 GHz Quad-Core Intel Core i5

odaira commented 3 years ago

Thanks for the sample data. It's in the LZ4 block format. Please use LZ4FastDecompressor or LZ4SafeDecompressor, not LZ4DecompressorWithLength, to decompress it.

I'll work on how to handle the runtime error....

wsargent commented 3 years ago

I have the same question about how you decompress data without access to the size of the decompressed data -- the docs mention that the buffer should be "oversize" but doesn't specify by how much.

sahilpaudel-pe commented 3 years ago

@wsargent

I got it working with below code

LZ4Factory safeFactory = LZ4Factory.safeInstance();
LZ4SafeDecompressor decompressor = safeFactory.safeDecompressor();

byte[] decoded = Base64.getDecoder().decode(data);
byte[] decomp = new byte[decoded.length * 5];
decompressor.decompress(decoded, decomp);
 System.out.println(new String(decomp));

Hope this helps.

Although sometimes I get `net.jpountz.lz4.LZ4Exception: Error decoding offset 733 of input buffer` exception and all time when using LZ4FastDecompressor.
wsargent commented 3 years ago

@sahilpaudel-pe according to https://github.com/lz4/lz4-java/pull/168#issuecomment-705940814 it can be up to 256x the compressed size so it looks like using the frame oriented outputstream/inputstream is the way to go, although I don't know how you'd know at first glance whether the other client was using a block or frame format -- presumably you look at the header for magic numbers...

https://github.com/lz4/lz4/blob/master/doc/lz4_Frame_format.md

odaira commented 3 years ago

@sahilpaudel-pe It is not possible to completely avoid SIGBUS/SIGSEGV when using LZ4FastDecompressor with unknown input. By e4780ab9789fe3a8e4a144d1d26e2815311ed502, I have supported using LZ4SafeDecompressor in LZ4DecompressorWithLength, so that a Java exception will be thrown instead of SIGBUS or SIGSEGV when it is used with a malformed input. Thanks for the heads-up!