Vaibhavs10 / hf-llm.rs

MIT License
202 stars 22 forks source link

Problems executing in Termux on Android #8

Open b9Joker108 opened 4 days ago

b9Joker108 commented 4 days ago

Hi, I am having issues executing your project in my unrooted Termux host environment on Android:

❯ cargo run --release -- -m "EleutherAI/gpt-neo-2.7B" -c
    Finished `release` profile [optimized] target(s) in 0.12s
     Running `target/release/hf-llm -m EleutherAI/gpt-neo-2.7B -c`
Starting chat mode. Type 'exit' to end the conversation.
You: hi
Error: HTTP Error 422 Unprocessable Entity: {"error":"Template error: template not found","error_type":"template_error"}

This is information about my Termux environment:

❯ termux-info
Termux Variables:
TERMUX_API_VERSION=0.50.1
TERMUX_APK_RELEASE=F_DROID
TERMUX_APP_PACKAGE_MANAGER=apt
TERMUX_APP_PID=10104
TERMUX_IS_DEBUGGABLE_BUILD=0
TERMUX_MAIN_PACKAGE_FORMAT=debian
TERMUX_VERSION=0.118.1
TERMUX__USER_ID=0
Packages CPU architecture:
aarch64
Subscribed repositories:
# sources.list
deb https://mirrors.sdu.edu.cn/termux/termux-main stable main
# sources.list.d/pointless.list
deb https://its-pointless.github.io/files/21 termux extras
# sources.list.d/ivam3-termux-packages.list
deb [trusted=yes arch=all] https://ivam3.github.io/termux-packages stable extras
# x11-repo (sources.list.d/x11.list)
deb https://mirrors.sdu.edu.cn/termux/termux-x11 x11 main
# tur-repo (sources.list.d/tur.list)
deb https://tur.kcubeterm.com tur-packages tur tur-on-device tur-continuous
# root-repo (sources.list.d/root.list)
deb https://mirrors.sdu.edu.cn/termux/termux-root root stable
# sources.list.d/rendiix.list
deb https://rendiix.github.io android-tools termux
Updatable packages:
tigervnc/x11 1.14.1 aarch64 [upgradable from: 1.10.1-41]
termux-tools version:
1.44.2                                                                                                                             Android version:
14                                                                                                                                 Kernel build information:
Linux localhost 5.15.123-android13-8-28577532-abX910XXS4BXG5 #1 SMP PREEMPT Thu Jul 11 02:48:07 UTC 2024 aarch64 Android           Device manufacturer:
samsung
Device model:
SM-X910
LD Variables:
LD_LIBRARY_PATH=:/data/data/com.termux/files/home/.local/lib/ollama:/data/data/com.termux/files/usr/lib:/data/data/com.termux/files/home/install/lib
LD_PRELOAD=/data/data/com.termux/files/usr/lib/libtermux-exec.so
Installed termux plugins:
com.termux.widget versionCode:13
com.termux.x11 versionCode:14
com.termux.api versionCode:51
com.termux.window versionCode:15
com.termux.styling versionCode:1000

Thank you so much for your project!

Any assistance getting this working greatly appreciated.