kherud / java-llama.cpp

Java Bindings for llama.cpp - A Port of Facebook's LLaMA model in C/C++
MIT License
279 stars 28 forks source link

SIGILL (0x4) at pc=0x00007fe92acb5142, pid=3952, tid=4017 #30

Closed siddhsql closed 5 months ago

siddhsql commented 9 months ago
<dependency>
    <groupId>de.kherud</groupId>
    <artifactId>llama</artifactId>
    <version>2.2.1</version>
</dependency>

Extracted 'libllama.so' to '/tmp/libllama.so' Extracted 'libjllama.so' to '/tmp/libjllama.so' #

A fatal error has been detected by the Java Runtime Environment:

#

SIGILL (0x4) at pc=0x00007fe92acb5142, pid=3952, tid=4017

#

JRE version: Java(TM) SE Runtime Environment (21.0.1+12) (build 21.0.1+12-LTS-29)

Java VM: Java HotSpot(TM) 64-Bit Server VM (21.0.1+12-LTS-29, mixed mode, sharing, tiered, compressed oops, compressed class ptrs, g1 gc, linux-amd64)

Problematic frame:

C [libjllama.so+0x23142] gpt_params::gpt_params()+0x3e2

details of my CPU:

$ lscpu
Architecture:            x86_64
  CPU op-mode(s):        32-bit, 64-bit
  Address sizes:         46 bits physical, 48 bits virtual
  Byte Order:            Little Endian
CPU(s):                  2
  On-line CPU(s) list:   0,1
Vendor ID:               GenuineIntel
  Model name:            Intel(R) Xeon(R) CPU E5-2686 v4 @ 2.30GHz
    CPU family:          6
    Model:               79
    Thread(s) per core:  1
    Core(s) per socket:  2
    Socket(s):           1
    Stepping:            1
    BogoMIPS:            4600.00
    Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov
                         pat pse36 clflush mmx fxsr sse sse2 ht syscall nx rdtscp lm co
                         nstant_tsc rep_good nopl xtopology cpuid tsc_known_freq pni pc
                         lmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt
                         tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_l
                         m abm cpuid_fault invpcid_single pti fsgsbase bmi1 avx2 smep b
                         mi2 erms invpcid xsaveopt
Virtualization features:
  Hypervisor vendor:     Xen
  Virtualization type:   full
Caches (sum of all):
  L1d:                   64 KiB (2 instances)
  L1i:                   64 KiB (2 instances)
  L2:                    512 KiB (2 instances)
  L3:                    45 MiB (1 instance)
NUMA:
  NUMA node(s):          1
  NUMA node0 CPU(s):     0,1
kherud commented 5 months ago

Related to #31 I just released version 3.0 and this should be fixed. Note, that the option InferenceParameters#antiPrompt(String[]) changed to InferenceParameters#setStopStrings(String[]).