Closed siddhsql closed 5 months ago
<dependency> <groupId>de.kherud</groupId> <artifactId>llama</artifactId> <version>2.2.1</version> </dependency>
Extracted 'libllama.so' to '/tmp/libllama.so' Extracted 'libjllama.so' to '/tmp/libjllama.so' #
#
details of my CPU:
$ lscpu Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 46 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 2 On-line CPU(s) list: 0,1 Vendor ID: GenuineIntel Model name: Intel(R) Xeon(R) CPU E5-2686 v4 @ 2.30GHz CPU family: 6 Model: 79 Thread(s) per core: 1 Core(s) per socket: 2 Socket(s): 1 Stepping: 1 BogoMIPS: 4600.00 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx rdtscp lm co nstant_tsc rep_good nopl xtopology cpuid tsc_known_freq pni pc lmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_l m abm cpuid_fault invpcid_single pti fsgsbase bmi1 avx2 smep b mi2 erms invpcid xsaveopt Virtualization features: Hypervisor vendor: Xen Virtualization type: full Caches (sum of all): L1d: 64 KiB (2 instances) L1i: 64 KiB (2 instances) L2: 512 KiB (2 instances) L3: 45 MiB (1 instance) NUMA: NUMA node(s): 1 NUMA node0 CPU(s): 0,1
Related to #31 I just released version 3.0 and this should be fixed. Note, that the option InferenceParameters#antiPrompt(String[]) changed to InferenceParameters#setStopStrings(String[]).
InferenceParameters#antiPrompt(String[])
InferenceParameters#setStopStrings(String[])
Extracted 'libllama.so' to '/tmp/libllama.so' Extracted 'libjllama.so' to '/tmp/libjllama.so' #
A fatal error has been detected by the Java Runtime Environment:
#
SIGILL (0x4) at pc=0x00007fe92acb5142, pid=3952, tid=4017
#
JRE version: Java(TM) SE Runtime Environment (21.0.1+12) (build 21.0.1+12-LTS-29)
Java VM: Java HotSpot(TM) 64-Bit Server VM (21.0.1+12-LTS-29, mixed mode, sharing, tiered, compressed oops, compressed class ptrs, g1 gc, linux-amd64)
Problematic frame:
C [libjllama.so+0x23142] gpt_params::gpt_params()+0x3e2
details of my CPU: