int3rrobang commented 11 months ago

Prerequisites

Please answer the following questions for yourself before submitting an issue.

[x] I am running the latest code. Development is very rapid so there are no tagged versions as of now.
[x] I carefully followed the README.md.
[x] I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
[x] I reviewed the Discussions, and have a new bug or useful enhancement to share.

Expected Behavior

The new UI opens when compiled with LLAMA_CLBLAST=1

Current Behavior

The UI fails to open if koboldcpp is compiled with LLAMA_CLBLAST=1 with a customtkinter error

Environment and Context

Physical (or virtual) hardware you are using:


   ~/koboldcpp_noblas    concedo  lscpu                                             ✔  3m 54s  
Architecture:            x86_64
CPU op-mode(s):        32-bit, 64-bit
Address sizes:         43 bits physical, 48 bits virtual
Byte Order:            Little Endian
CPU(s):                  8
On-line CPU(s) list:   0-7
Vendor ID:               AuthenticAMD
Model name:            AMD Ryzen 5 3550H with Radeon Vega Mobile Gfx
CPU family:          23
Model:               24
Thread(s) per core:  2
Core(s) per socket:  4
Socket(s):           1
Stepping:            1
Frequency boost:     enabled
CPU(s) scaling MHz:  82%
CPU max MHz:         2100,0000
CPU min MHz:         1400,0000
BogoMIPS:            4193,59
Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mm
                     x fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_g
                     ood nopl nonstop_tsc cpuid extd_apicid aperfmperf rapl pni pclmulqdq monitor ssse3
                      fma cx16 sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand lahf_lm cmp_legacy 
                     svm extapic cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw skinit wdt tce top
                     oext perfctr_core perfctr_nb bpext perfctr_llc mwaitx cpb hw_pstate ssbd ibpb vmmc
                     all fsgsbase bmi1 avx2 smep bmi2 rdseed adx smap clflushopt sha_ni xsaveopt xsavec
                      xgetbv1 clzero irperf xsaveerptr arat npt lbrv svm_lock nrip_save tsc_scale vmcb_
                     clean flushbyasid decodeassists pausefilter pfthreshold avic v_vmsave_vmload vgif 
                     overflow_recov succor smca sev sev_es
Virtualization features: 
Virtualization:        AMD-V
Caches (sum of all):     
L1d:                   128 KiB (4 instances)
L1i:                   256 KiB (4 instances)
L2:                    2 MiB (4 instances)
L3:                    4 MiB (1 instance)
NUMA:                    
NUMA node(s):          1
NUMA node0 CPU(s):     0-7
Vulnerabilities:         
Gather data sampling:  Not affected
Itlb multihit:         Not affected
L1tf:                  Not affected
Mds:                   Not affected
Meltdown:              Not affected
Mmio stale data:       Not affected
Retbleed:              Mitigation; untrained return thunk; SMT vulnerable
Spec rstack overflow:  Mitigation; safe RET
Spec store bypass:     Mitigation; Speculative Store Bypass disabled via prctl
Spectre v1:            Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Spectre v2:            Mitigation; Retpolines, IBPB conditional, STIBP disabled, RSB filling, PBRSB-eIBRS
                      Not affected
Srbds:                 Not affected
Tsx async abort:       Not affected

   ~/koboldcpp_noblas    concedo  glxinfo | grep "OpenGL renderer"                             ✔ 
OpenGL renderer string: AMD Radeon Vega 8 Graphics (raven, LLVM 16.0.6, DRM 3.54, 6.5.5-1-MANJARO)
   ~/koboldcpp_noblas    concedo  prime-run glxinfo | grep "OpenGL renderer"                   ✔ 
OpenGL renderer string: NVIDIA GeForce GTX 1650/PCIe/SSE2


* Operating System:

   ~/koboldcpp_noblas    concedo  neofetch  ✔ ██████████████████ ████████ kostsya@BALLBSMASHER692012 ██████████████████ ████████ -------------------------- ██████████████████ ████████ OS: Manjaro Linux x86_64 ██████████████████ ████████ Host: TUF Gaming FX505DT_FX505DT 1.0 ████████ ████████ Kernel: 6.5.5-1-MANJARO ████████ ████████ ████████ Uptime: 9 hours, 15 mins ████████ ████████ ████████ Packages: 1574 (pacman), 9 (flatpak) ████████ ████████ ████████ Shell: bash 5.1.16 ████████ ████████ ████████ Resolution: 1920x1080 ████████ ████████ ████████ DE: Plasma 5.27.8 ████████ ████████ ████████ WM: kwin ████████ ████████ ████████ Theme: [Plasma], Breeze [GTK2/3] ████████ ████████ ████████ Icons: [Plasma], candy-icons [GTK2/3] ████████ ████████ ████████ Terminal: konsole CPU: AMD Ryzen 5 3550H with Radeon Vega Mobile Gfx (8) @ 2.100GHz GPU: AMD ATI Radeon Vega Series / Radeon Vega Mobile Series GPU: NVIDIA GeForce GTX 1650 Mobile / Max-Q Memory: 9066MiB / 15422MiB


* SDK version:

   ~/koboldcpp_noblas    concedo  python3 --version  ✔ Python 3.11.5    ~/koboldcpp_noblas    concedo  make --version  ✔ GNU Make 4.4.1 Built for x86_64-pc-linux-gnu Copyright (C) 1988-2023 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later https://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law.    ~/koboldcpp_noblas    concedo  g++ --version  1 ✘ g++ (GCC) 13.2.1 20230801 Copyright (C) 2023 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.


# Failure Information (for bugs)

Compiling koboldcpp with no flag, LLAMA_CUBLAS=1 or LLAMA_OPENBLAS=1, the UI works as intended; when compiled with LLAMA_CLBLAST=1, it fails to run with a customtkinter error. I have customtkinter installed system-wide from the AUR. A blank tkinter window appears, as well as an error window.

![image](https://github.com/LostRuins/koboldcpp/assets/80174663/69ef37c3-c03e-45df-b3c7-a895d5dc0261)

# Steps to Reproduce

1. Clone the repository and compile it through make with the LLAMA_CLBLAST=1 flag
2. Run the koboldcpp.py file in the directory

# Failure Logs

   ~/koboldcpp    concedo  ./koboldcpp.py  ✔

Welcome to KoboldCpp - Version 1.48 For command line arguments, please refer to --help

Warning, GUI failed to start: Reason: list.remove(x): x not in list File selection GUI unsupported. customtkinter python module required! Please check command line: script.py --help

LostRuins commented 11 months ago

Pushed a fix, please try again

thecord commented 11 months ago

hi, there still the issue I tried today but still the bug in AUR after re-compiled Koboldcpp. `[TheCoRd@Yami-Arch ~]$ koboldcpp

Welcome to KoboldCpp - Version 1.48 For command line arguments, please refer to --help

Warning, GUI failed to start: Reason: list.remove(x): x not in list File selection GUI unsupported. customtkinter python module required! Please check command line: script.py --help `

thecord commented 11 months ago

it's fixed and worked perfectly thanks. ` $ koboldcpp

Welcome to KoboldCpp - Version 1.50 For command line arguments, please refer to --help

` using: Arch Linux

LostRuins / koboldcpp

[BUG] (1.48) The new UI fails to launch when compiled with LLAMA_CLBLAST=1 flag #513

Prerequisites

Expected Behavior

Current Behavior

Environment and Context