app crashes when attempting to load any q_4_0_4_8 model

a-ghorbani / pocketpal-ai

An app that brings language models directly to your phone.

MIT License

427 stars 23 forks source link

Open lilyanatia opened 1 week ago

lilyanatia commented 1 week ago

attempting to load any q4_0_4_8 model crashes PocketPal. q4_0_4_4 works, but q4_0_4_8 should be faster on devices that support i8mm. pocketpal.log

zchdoc commented 1 week ago

me too