azhuvath
commented
9 months ago Changed the installation step from CMAKE_ARGS="-DLLAMA_SYCL=on -DCMAKE_CXX_COMPILER=icpx" pip install llama-cpp-python to CMAKE_ARGS="-DLLAMA_SYCL=on -DCMAKE_C_COMPILER=icx -DCMAKE_CXX_COMPILER=icpx" pip install llama-cpp-python
The above error is gone. Now getting core dump with my custom code. It works with the sample given in the website.
Starting program: /home/sdp/lcpp/llama_cpp_env/bin/python llama2_public.py [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". warning: File "/opt/intel/oneapi/compiler/2024.0/lib/libsycl.so.7.0.0-gdb.py" auto-loading has been declined by your `auto-load safe-path' set to "$debugdir:$datadir/auto-load". To enable execution of this file add add-auto-load-safe-path /opt/intel/oneapi/compiler/2024.0/lib/libsycl.so.7.0.0-gdb.py line to your configuration file "/home/sdp/.config/gdb/gdbinit". To completely disable this security protection add set auto-load safe-path / line to your configuration file "/home/sdp/.config/gdb/gdbinit". For more information about this security protection see the "Auto-loading safe path" section in the GDB manual. E.g., run from the shell: info "(gdb)Auto-loading safe path" [New Thread 0x7fffe43ff640 (LWP 271518)] [New Thread 0x7fffe1bfe640 (LWP 271519)] [New Thread 0x7fffdf3fd640 (LWP 271520)] [New Thread 0x7fffdebfc640 (LWP 271521)] [New Thread 0x7fffdc3fb640 (LWP 271522)] [New Thread 0x7fffd9bfa640 (LWP 271523)] [New Thread 0x7fffd53f9640 (LWP 271524)] [New Thread 0x7fffd2bf8640 (LWP 271525)] [New Thread 0x7fffd23f7640 (LWP 271526)] [New Thread 0x7fffcfbf6640 (LWP 271527)] [New Thread 0x7fffcd3f5640 (LWP 271528)] [New Thread 0x7fffcabf4640 (LWP 271529)] [New Thread 0x7fffc83f3640 (LWP 271530)] [New Thread 0x7fffc5bf2640 (LWP 271531)] [New Thread 0x7fffc33f1640 (LWP 271532)] [New Thread 0x7fffc0bf0640 (LWP 271533)] [New Thread 0x7fffbe3ef640 (LWP 271534)] [New Thread 0x7fffbbbee640 (LWP 271535)] [New Thread 0x7fffb93ed640 (LWP 271536)] [New Thread 0x7fffb6bec640 (LWP 271537)] [New Thread 0x7fffb43eb640 (LWP 271538)] [New Thread 0x7fffb3bea640 (LWP 271539)] [New Thread 0x7fffaf3e9640 (LWP 271540)] [New Thread 0x7fffacbe8640 (LWP 271541)] [New Thread 0x7fffaa3e7640 (LWP 271542)] [New Thread 0x7fffa7be6640 (LWP 271543)] [New Thread 0x7fffa53e5640 (LWP 271544)] [New Thread 0x7fffa4be4640 (LWP 271545)] [New Thread 0x7fffa03e3640 (LWP 271546)] [New Thread 0x7fff9bbe2640 (LWP 271547)] [New Thread 0x7fff9b3e1640 (LWP 271548)] [New Thread 0x7fff98be0640 (LWP 271549)] [New Thread 0x7fff963df640 (LWP 271550)] [New Thread 0x7fff93bde640 (LWP 271551)] [New Thread 0x7fff913dd640 (LWP 271552)] [New Thread 0x7fff8ebdc640 (LWP 271553)] [New Thread 0x7fff8c3db640 (LWP 271554)] [New Thread 0x7fff89bda640 (LWP 271555)] [New Thread 0x7fff873d9640 (LWP 271556)] [New Thread 0x7fff84bd8640 (LWP 271557)] [New Thread 0x7fff823d7640 (LWP 271558)] [New Thread 0x7fff7fbd6640 (LWP 271559)] [New Thread 0x7fff7d3d5640 (LWP 271560)] [New Thread 0x7fff7abd4640 (LWP 271561)] [New Thread 0x7fff783d3640 (LWP 271562)] [New Thread 0x7fff73bd2640 (LWP 271563)] [New Thread 0x7fff733d1640 (LWP 271564)] [New Thread 0x7fff70bd0640 (LWP 271565)] [New Thread 0x7fff6e3cf640 (LWP 271566)] [New Thread 0x7fff6bbce640 (LWP 271567)] [New Thread 0x7fff673cd640 (LWP 271568)] [New Thread 0x7fff66bcc640 (LWP 271569)] [New Thread 0x7fff643cb640 (LWP 271570)] [New Thread 0x7fff61bca640 (LWP 271571)] [New Thread 0x7fff5f3c9640 (LWP 271572)] [New Thread 0x7fff5cbc8640 (LWP 271573)] [New Thread 0x7fff5a3c7640 (LWP 271574)] [New Thread 0x7fff57bc6640 (LWP 271575)] [New Thread 0x7fff533c5640 (LWP 271576)] [New Thread 0x7fff50bc4640 (LWP 271577)] [New Thread 0x7fff503c3640 (LWP 271578)] [New Thread 0x7fff4dbc2640 (LWP 271579)] [New Thread 0x7fff493c1640 (LWP 271580)] [New Thread 0x7fff2c393640 (LWP 271581)] [New Thread 0x7fff2bf92640 (LWP 271583)] [New Thread 0x7fff2bb91640 (LWP 271582)] [New Thread 0x7fff2b38f640 (LWP 271584)] [New Thread 0x7fff2af8e640 (LWP 271586)] [New Thread 0x7fff2b790640 (LWP 271585)] [New Thread 0x7fff2a38b640 (LWP 271588)] [New Thread 0x7fff29f8a640 (LWP 271589)] [New Thread 0x7fff2ab8d640 (LWP 271587)] [New Thread 0x7fff2a78c640 (LWP 271590)] [New Thread 0x7fff29b89640 (LWP 271591)] [New Thread 0x7fff28f86640 (LWP 271593)] [New Thread 0x7fff07bfe640 (LWP 271598)] [New Thread 0x7fff29387640 (LWP 271592)] [New Thread 0x7fff077fd640 (LWP 271599)] [New Thread 0x7fff07fff640 (LWP 271597)] [New Thread 0x7fff28b85640 (LWP 271594)] [New Thread 0x7fff29788640 (LWP 271596)] [New Thread 0x7fff28784640 (LWP 271595)] [New Thread 0x7fff06ffb640 (LWP 271600)] [New Thread 0x7fff067f9640 (LWP 271601)] [New Thread 0x7fff04bf2640 (LWP 271609)] [New Thread 0x7fff04ff3640 (LWP 271608)] [New Thread 0x7fff053f4640 (LWP 271607)] [New Thread 0x7fff057f5640 (LWP 271606)] [New Thread 0x7ffed7fff640 (LWP 271611)] [New Thread 0x7fff05bf6640 (LWP 271605)] [New Thread 0x7fff047f1640 (LWP 271612)] [New Thread 0x7fff063f8640 (LWP 271603)] [New Thread 0x7fff073fc640 (LWP 271602)] [New Thread 0x7fff05ff7640 (LWP 271610)] [New Thread 0x7fff06bfa640 (LWP 271604)] [New Thread 0x7ffec6ffb640 (LWP 271613)] [New Thread 0x7ffed63f8640 (LWP 271630)] [New Thread 0x7ffed67f9640 (LWP 271629)] [New Thread 0x7ffed5ff7640 (LWP 271631)] [New Thread 0x7ffed5bf6640 (LWP 271632)] [New Thread 0x7ffed57f5640 (LWP 271633)] [New Thread 0x7ffed6ffb640 (LWP 271627)] [New Thread 0x7ffed6bfa640 (LWP 271628)] [New Thread 0x7ffecffff640 (LWP 271618)] [New Thread 0x7ffecf7fd640 (LWP 271614)] [New Thread 0x7ffecfbfe640 (LWP 271621)] [New Thread 0x7ffed7bfe640 (LWP 271622)] [New Thread 0x7ffed77fd640 (LWP 271625)] [New Thread 0x7ffed73fc640 (LWP 271626)] [New Thread 0x7ffec77fd640 (LWP 271617)] [New Thread 0x7ffebfbfe640 (LWP 271619)] [New Thread 0x7ffec7bfe640 (LWP 271623)] [New Thread 0x7ffecf3fc640 (LWP 271615)] [New Thread 0x7ffec7fff640 (LWP 271620)] [New Thread 0x7ffebffff640 (LWP 271616)] [New Thread 0x7ffec73fc640 (LWP 271624)] [New Thread 0x7ffed53f4640 (LWP 271634)] [New Thread 0x7ffebeffb640 (LWP 271650)] [New Thread 0x7ffeccbf2640 (LWP 271642)] [New Thread 0x7ffebdff7640 (LWP 271665)] [New Thread 0x7ffebd7f5640 (LWP 271666)] [New Thread 0x7ffec4bf2640 (LWP 271646)] [New Thread 0x7ffebf7fd640 (LWP 271648)] [New Thread 0x7ffebebfa640 (LWP 271651)] [New Thread 0x7ffebe7f9640 (LWP 271652)] [New Thread 0x7ffebf3fc640 (LWP 271649)] [New Thread 0x7ffec6bfa640 (LWP 271636)] [New Thread 0x7ffec57f5640 (LWP 271641)] [New Thread 0x7ffebdbf6640 (LWP 271667)] [New Thread 0x7ffec63f8640 (LWP 271638)] [New Thread 0x7ffec5ff7640 (LWP 271639)] [New Thread 0x7ffebe3f8640 (LWP 271661)] [New Thread 0x7ffec53f4640 (LWP 271662)] [New Thread 0x7ffec5bf6640 (LWP 271640)] [New Thread 0x7ffecc7f1640 (LWP 271635)] [New Thread 0x7ffec67f9640 (LWP 271637)] [New Thread 0x7ffec47f1640 (LWP 271647)] [New Thread 0x7ffec4ff3640 (LWP 271645)] [New Thread 0x7ffece3f8640 (LWP 271657)] [New Thread 0x7ffed47f1640 (LWP 271655)] [New Thread 0x7ffeceffb640 (LWP 271658)] [New Thread 0x7ffecebfa640 (LWP 271644)] [New Thread 0x7ffeccff3640 (LWP 271653)] [New Thread 0x7ffece7f9640 (LWP 271659)] [New Thread 0x7ffed4ff3640 (LWP 271660)] [New Thread 0x7ffed4bf2640 (LWP 271663)] [New Thread 0x7ffecdff7640 (LWP 271664)] [New Thread 0x7ffecdbf6640 (LWP 271656)] [New Thread 0x7ffecd7f5640 (LWP 271643)] [New Thread 0x7ffecd3f4640 (LWP 271654)] [New Thread 0x7ffebd3f4640 (LWP 271668)] [New Thread 0x7ffe3dbf6640 (LWP 271710)] [New Thread 0x7ffe3ebfa640 (LWP 271706)] [New Thread 0x7ffe3effb640 (LWP 271705)] [New Thread 0x7ffdb2ffb640 (LWP 271721)] [New Thread 0x7ffdb2bfa640 (LWP 271722)] [New Thread 0x7ffe3f3fc640 (LWP 271704)] [New Thread 0x7ffe3e3f8640 (LWP 271708)] [New Thread 0x7ffe84ff3640 (LWP 271698)] [New Thread 0x7ffebcff3640 (LWP 271671)] [New Thread 0x7ffe84bf2640 (LWP 271699)] [New Thread 0x7ffe87bfe640 (LWP 271672)] [New Thread 0x7ffe873fc640 (LWP 271673)] [New Thread 0x7ffe847f1640 (LWP 271700)] [New Thread 0x7ffe3fbfe640 (LWP 271702)] [New Thread 0x7ffe853f4640 (LWP 271697)] [New Thread 0x7ffdb3fff640 (LWP 271716)] [New Thread 0x7ffdb3bfe640 (LWP 271719)] [New Thread 0x7ffe3e7f9640 (LWP 271707)] [New Thread 0x7ffe3cff3640 (LWP 271713)] [New Thread 0x7ffdb33fc640 (LWP 271720)] [New Thread 0x7ffe3c7f1640 (LWP 271715)] [New Thread 0x7ffe3d7f5640 (LWP 271711)] [New Thread 0x7ffe3dff7640 (LWP 271709)] [New Thread 0x7ffe3ffff640 (LWP 271701)] [New Thread 0x7ffdb37fd640 (LWP 271718)] [New Thread 0x7ffe3f7fd640 (LWP 271703)] [New Thread 0x7ffe3cbf2640 (LWP 271714)] [New Thread 0x7ffe86ffb640 (LWP 271674)] [New Thread 0x7ffe3d3f4640 (LWP 271712)] [New Thread 0x7ffe857f5640 (LWP 271695)] [New Thread 0x7ffe86bfa640 (LWP 271675)] [New Thread 0x7ffe87fff640 (LWP 271670)] [New Thread 0x7ffe85bf6640 (LWP 271690)] [New Thread 0x7ffe863f8640 (LWP 271677)] [New Thread 0x7ffe8f3fc640 (LWP 271691)] [New Thread 0x7ffe85ff7640 (LWP 271678)] [New Thread 0x7ffe8cff3640 (LWP 271683)] [New Thread 0x7ffe8d7f5640 (LWP 271685)] [New Thread 0x7ffe8e7f9640 (LWP 271688)] [New Thread 0x7ffebcbf2640 (LWP 271696)] [New Thread 0x7ffe8d3f4640 (LWP 271687)] [New Thread 0x7ffe8dbf6640 (LWP 271692)] [New Thread 0x7ffe8f7fd640 (LWP 271693)] [New Thread 0x7ffe867f9640 (LWP 271676)] [New Thread 0x7ffe8e3f8640 (LWP 271694)] [New Thread 0x7ffe8ffff640 (LWP 271686)] [New Thread 0x7ffe8fbfe640 (LWP 271681)] [New Thread 0x7ffebc7f1640 (LWP 271684)] [New Thread 0x7ffe8dff7640 (LWP 271679)] [New Thread 0x7ffe8effb640 (LWP 271689)] [New Thread 0x7ffe8ebfa640 (LWP 271680)] [New Thread 0x7ffe877fd640 (LWP 271717)] [New Thread 0x7ffe8cbf2640 (LWP 271682)] [New Thread 0x7ffe8c7f1640 (LWP 271669)] [New Thread 0x7ffdb27f9640 (LWP 271723)] [New Thread 0x7ffd887f1640 (LWP 271742)] [New Thread 0x7ffd893f4640 (LWP 271740)] [New Thread 0x7ffdb23f8640 (LWP 271768)] [New Thread 0x7ffd88bf2640 (LWP 271770)] [New Thread 0x7ffd89ff7640 (LWP 271771)] [New Thread 0x7ffd73fff640 (LWP 271780)] [New Thread 0x7ffd833fc640 (LWP 271745)] [New Thread 0x7ffdb0ff3640 (LWP 271728)] [New Thread 0x7ffd73bfe640 (LWP 271776)] [New Thread 0x7ffdb07f1640 (LWP 271729)] [New Thread 0x7ffd737fd640 (LWP 271777)] [New Thread 0x7ffd8affb640 (LWP 271734)] [New Thread 0x7ffdb17f5640 (LWP 271726)] [New Thread 0x7ffd8bfff640 (LWP 271730)] [New Thread 0x7ffd8abfa640 (LWP 271735)] [New Thread 0x7ffd8bbfe640 (LWP 271731)] [New Thread 0x7ffd83fff640 (LWP 271743)] [New Thread 0x7ffd8b7fd640 (LWP 271732)] [New Thread 0x7ffd8a7f9640 (LWP 271736)] [New Thread 0x7ffd8b3fc640 (LWP 271733)] [New Thread 0x7ffd733fc640 (LWP 271779)] [New Thread 0x7ffd8a3f8640 (LWP 271737)] [New Thread 0x7ffd89bf6640 (LWP 271738)] [New Thread 0x7ffd78bf2640 (LWP 271767)] [New Thread 0x7ffd7b7fd640 (LWP 271759)] [New Thread 0x7ffd7b3fc640 (LWP 271760)] [New Thread 0x7ffd7a3f8640 (LWP 271772)] [New Thread 0x7ffd79ff7640 (LWP 271764)] [New Thread 0x7ffd787f1640 (LWP 271778)] [New Thread 0x7ffd827f9640 (LWP 271748)] [New Thread 0x7ffd7abfa640 (LWP 271762)] [New Thread 0x7ffd7affb640 (LWP 271761)] [New Thread 0x7ffd897f5640 (LWP 271739)] [New Thread 0x7ffd88ff3640 (LWP 271741)] [New Thread 0x7ffd797f5640 (LWP 271773)] [New Thread 0x7ffd793f4640 (LWP 271765)] [New Thread 0x7ffd79bf6640 (LWP 271774)] [New Thread 0x7ffdb0bf2640 (LWP 271775)] [New Thread 0x7ffd80bf2640 (LWP 271755)] [New Thread 0x7ffd807f1640 (LWP 271756)] [New Thread 0x7ffd78ff3640 (LWP 271766)] [New Thread 0x7ffd80ff3640 (LWP 271754)] [New Thread 0x7ffd7bfff640 (LWP 271757)] [New Thread 0x7ffd83bfe640 (LWP 271769)] [New Thread 0x7ffd7bbfe640 (LWP 271758)] [New Thread 0x7ffd82ffb640 (LWP 271746)] [New Thread 0x7ffd813f4640 (LWP 271753)] [New Thread 0x7ffd7a7f9640 (LWP 271763)] [New Thread 0x7ffdb1bf6640 (LWP 271724)] [New Thread 0x7ffd817f5640 (LWP 271752)] [New Thread 0x7ffd82bfa640 (LWP 271747)] [New Thread 0x7ffd81ff7640 (LWP 271750)] [New Thread 0x7ffd81bf6640 (LWP 271751)] [New Thread 0x7ffd823f8640 (LWP 271749)] [New Thread 0x7ffdb1ff7640 (LWP 271727)] [New Thread 0x7ffd837fd640 (LWP 271744)] [New Thread 0x7ffdb13f4640 (LWP 271725)] [New Thread 0x7ffcf13f4640 (LWP 271781)] [New Thread 0x7ffcf27f9640 (LWP 271800)] [New Thread 0x7ffcf2ffb640 (LWP 271791)] [New Thread 0x7ffcf1bf6640 (LWP 271799)] [New Thread 0x7ffcf17f5640 (LWP 271795)] [New Thread 0x7ffcf1ff7640 (LWP 271793)] [New Thread 0x7ffcf3fff640 (LWP 271785)] [New Thread 0x7ffd723f8640 (LWP 271789)] [New Thread 0x7ffd713f4640 (LWP 271792)] [New Thread 0x7ffd71bf6640 (LWP 271782)] [New Thread 0x7ffcf3bfe640 (LWP 271787)] [New Thread 0x7ffcf33fc640 (LWP 271784)] [New Thread 0x7ffd72ffb640 (LWP 271783)] [New Thread 0x7ffd70ff3640 (LWP 271790)] [New Thread 0x7ffd717f5640 (LWP 271788)] [New Thread 0x7ffd70bf2640 (LWP 271797)] [New Thread 0x7ffd727f9640 (LWP 271794)] [New Thread 0x7ffd707f1640 (LWP 271796)] [New Thread 0x7ffcf37fd640 (LWP 271798)] [New Thread 0x7ffd71ff7640 (LWP 271803)] [New Thread 0x7ffcf23f8640 (LWP 271801)] [New Thread 0x7ffcf2bfa640 (LWP 271786)] [New Thread 0x7ffd72bfa640 (LWP 271802)]
Thread 1 "python" received signal SIGSEGV, Segmentation fault. 0x00007ffff6f7b454 in ?? () from /home/sdp/lcpp/llama_cpp_env/lib/python3.10/site-packages/llama_cpp/libllama.so
Prerequisites
Please answer the following questions for yourself before submitting an issue.
Expected Behavior
After installing llama-cpp-python with SYCL support, the program should run without errors
Current Behavior
Created the environment using the following command and the packages got installed without errors. Used icpx compiler
python3 -m venv llama_cpp_env source llama_cpp_env/bin/activate CMAKE_ARGS="-DLLAMA_SYCL=on -DCMAKE_CXX_COMPILER=icpx" pip install llama-cpp-python
While running the program I am getting the below error. Using OneAPI 2024.0 version
Failed to build device program CompilerException Failed to lookup symbol _ZTSZZL13norm_f32_syclPKfPfiifPN4sycl3_V15queueEENKUlRNS3_7handlerEE_clES7_EUlNS3_7nditemILi3EEEE JIT session error: Symbols not found: [ _Z11fmax_commonDv32_fSS ]
Environment and Context
Please provide detailed information about your computer setup. This is important in case the issue is not reproducible except for under certain specific conditions.
Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 52 bits physical, 57 bits virtual Byte Order: Little Endian CPU(s): 224 On-line CPU(s) list: 0-223 Vendor ID: GenuineIntel Model name: Intel(R) Xeon(R) Platinum 8480+ CPU family: 6 Model: 143 Thread(s) per core: 2 Core(s) per socket: 56 Socket(s): 2 Stepping: 6 CPU max MHz: 3800.0000 CPU min MHz: 800.0000 BogoMIPS: 4000.00 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pd pe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmul qdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cat_l2 cdp_l3 invpcid_single intel_ppin cdp_l2 ssbd mba i brs ibpb stibp ibrs_enhanced tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid cqm rd t_a avx512f avx512dq rdseed adx smap avx512ifma clflushopt clwb intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xs aves cqm_llc cqm_occup_llc cqm_mbm_total cqm_mbm_local split_lock_detect avx_vnni avx512_bf16 wbnoinvd dtherm ida arat pln pts hwp hw p_act_window hwp_epp hwp_pkg_req avx512vbmi umip pku ospke waitpkg avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg tme av x512_vpopcntdq la57 rdpid bus_lock_detect cldemote movdiri movdir64b enqcmd fsrm md_clear serialize tsxldtrk pconfig arch_lbr amx_bf1 6 avx512_fp16 amx_tile amx_int8 flush_l1d arch_capabilities Virtualization features: Virtualization: VT-x Caches (sum of all): L1d: 5.3 MiB (112 instances) L1i: 3.5 MiB (112 instances) L2: 224 MiB (112 instances) L3: 210 MiB (2 instances) NUMA: NUMA node(s): 2 NUMA node0 CPU(s): 0-55,112-167 NUMA node1 CPU(s): 56-111,168-223 Vulnerabilities: Gather data sampling: Not affected Itlb multihit: Not affected L1tf: Not affected Mds: Not affected Meltdown: Not affected Mmio stale data: Not affected Retbleed: Not affected Spec rstack overflow: Not affected Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Spectre v2: Mitigation; Enhanced IBRS, IBPB conditional, RSB filling, PBRSB-eIBRS SW sequence Srbds: Not affected Tsx async abort: Not affected
Linux b5r11u33 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Python 3.10.12 GNU Make 4.3
Intel(R) oneAPI DPC++/C++ Compiler 2024.0.2 (2024.0.2.20231213) Target: x86_64-unknown-linux-gnu Thread model: posix InstalledDir: /opt/intel/oneapi/compiler/2024.0/bin/compiler Configuration file: /opt/intel/oneapi/compiler/2024.0/bin/compiler/../icpx.cfg
Failure Information (for bugs)
While running the program I am getting the below error
GGML_SYCL_DEBUG=0 ggml_init_sycl: GGML_SYCL_F16: no ggml_init_sycl: SYCL_USE_XMX: yes found 2 SYCL devices: Device 0: Intel(R) Xeon(R) Platinum 8480+, compute capability 3.0, max compute_units 224, max work group size 8192, max sub group size 64, global mem size 1081716088832 Device 1: Intel(R) FPGA Emulation Device, compute capability 1.2, max compute_units 224, max work group size 67108864, max sub group size 64, global mem size 1081716088832 Using device 0 (Intel(R) Xeon(R) Platinum 8480+) as main device The program was built for 1 devices Build program log for 'Intel(R) Xeon(R) Platinum 8480+': Compilation started Compilation done Linking started Linking done Device build started Options used by backend compiler: Failed to build device program CompilerException Failed to lookup symbol _ZTSZZL13norm_f32_syclPKfPfiifPN4sycl3_V15queueEENKUlRNS3_7handlerEE_clES7_EUlNS3_7nditemILi3EEEE JIT session error: Symbols not found: [ _Z11fmax_commonDv32_fSS ] Failed to materialize symbols: { (main, { _ZTSZZL17rms_norm_f32_syclPKfPfiifPN4sycl3_V15queueEENKUlRNS3_7handlerEE_clES7_EUlNS3_7nditemILi3EEEE, _ZTSZZL17rms_norm_f32_syclPKfPfiifPN4sycl3_V15queueEENKUlRNS3_7handlerEE0_clES7_EUlNS3_7nditemILi3EEEE, _ZTSZZL19group_norm_f32_syclPKfPfiiiPN4sycl3_V15queueEENKUlRNS3_7handlerEE0_clES7_EUlNS3_7nditemILi3EEEE, _ZGVeN32uuuuuuZTSZZL19group_norm_f32_syclPKfPfiiiPN4sycl3_V15queueEENKUlRNS3_7handlerEE0_clES7_EUlNS3_7nditemILi3EEEE, _ZGVeN32uuuuuuu__ZTSZZL17soft_max_f32_syclPKfS0_PfiiifPN4sycl3_V15queueEENKUlRNS3_7handlerEE_clES7_EUlNS3_7nditemILi3EEEE, _ZTSZZL19group_norm_f32_syclPKfPfiiiPN4sycl3_V15queueEENKUlRNS3_7handlerEE_clES7_EUlNS3_7nditemILi3EEEE, _ZGVeN32uuuuuuZTSZZL17rms_norm_f32_syclPKfPfiifPN4sycl3_V15queueEENKUlRNS3_7handlerEE0_clES7_EUlNS3_7nditemILi3EEEE, _ZGVeN32uuuuuu__ZTSZZL13norm_f32_syclPKfPfiifPN4sycl3_V15queueEENKUlRNS3_7handlerEE0_clES7_EUlNS3_7nditemILi3EEEE, _ZTSZZL13norm_f32_syclPKfPfiifPN4sycl3_V15queueEENKUlRNS3_7handlerEE_clES7_EUlNS3_7nditemILi3EEEE, _ZTSZZL13norm_f32_syclPKfPfiifPN4sycl3_V15queueEENKUlRNS3_7handlerEE0_clES7_EUlNS3_7nditemILi3EEEE, _ZTSZL17sum_rows_f32_syclPKfPfiiPN4sycl3_V15queueEEUlNS3_7nditemILi3EEEE, _ZTSZZL17soft_max_f32_syclPKfS0_PfiiifPN4sycl3_V15queueEENKUlRNS3_7handlerEE_clES7_EUlNS3_7nditemILi3EEEE }) }
-11 (PI_ERROR_BUILD_PROGRAM_FAILURE)Exception caught at file:/tmp/pip-install-67ylq05n/llama-cpp-python_3edfe1ab153b4fbcbbebb84348473226/vendor/llama.cpp/ggml-sycl.cpp, line:12706
Steps to Reproduce
Please provide detailed steps for reproducing the issue. We are not sitting in front of your screen, so the more detail the better.
Failure Logs
Refer Above
Example environment info:
diskcache==5.6.3 GPUtil==1.4.0 Jinja2==3.1.3 llama_cpp_python==0.2.39 MarkupSafe==2.1.5 numpy==1.26.4 psutil==5.9.8 typing_extensions==4.9.0