Open a-ghorbani opened 10 hours ago
I used this T5 model, trying different modes and templates: https://huggingface.co/Felladrin/gguf-q5_k_m-madlad400-3b-mt
Either I had only crashes when run without any template and <2en>
prompt header for Spanish text, or unreadable <><>>><
sequences when the default
template was used. I think, the llama.cpp kernel should be updated
This issue serves as a repository for tracking Android devices and specific quantizations that lead to crashes.
Please share detailed reports including device model and CPU specs, Android versions, the specific GGUF and its quantization, and stack traces if available.
If you don't know the CPU and chipset of the phone, you can use GSMArena to get the information.