OpenGVLab / OmniQuant

[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.
MIT License
663 stars 50 forks source link

MLC Android app is missing storage permission #7

Closed remixer-dec closed 12 months ago

remixer-dec commented 12 months ago

The app does not work for me (Operation not permitted)

There is no option to give it permission to access the whole storage, currently it only allows it to access media.

It is missing the MANAGE_EXTERNAL_STORAGE permission in the manifest and explicit permission request on app start.

remixer-dec commented 12 months ago

Not sure why it is even trying to access the Download folder if all the data is stored in Android/data/

After cloning the app with the required permissions, I'm getting

09-09 22:00:21.619  9445  9528 W Adreno-GSL: <gsl_ldd_control:553>: ioctl fd 76 code 0xc0300945 (IOCTL_KGSL_GPUOBJ_ALLOC) failed: errno 12 Out of memory
09-09 22:00:21.619  9445  9528 E Adreno-GSL: <gsl_memory_alloc_pure:2604>: GSL MEM ERROR: kgsl_sharedmem_alloc ioctl failed

with 7B model on an 8GB device

remixer-dec commented 12 months ago

Oh, I think I get it, when I renamed original mlc data directory to a different name, Android locked the name for the mlc folder inside Android/data/ and when the app was unable to write there, it tried to get the models in Download folder, which should not happen if there are no fs issues with renaming the data from the other version of the app. It's just sad that even with new methods of quantization, it still runs out of memory