search

pytorch / executorch

On-device AI across mobile, embedded and edge for PyTorch
https://pytorch.org/executorch/
Other
1.72k stars 293 forks source link

Error in Llama demo ios-app #4038

Open a-kush opened 3 months ago

a-kush commented 3 months ago

Following guide from here I managed to convert small 110B model into .pte format (model successfully answers prompts in command line) and run demo iOS app from tutorial. Yet it fails after passing any prompt with next error:

F 00:00:48.48627393202000000 executorch:base64.h:61] In function validate(), assert failed (v != 255): invalid char F 00:00:48.627393 executorch:base64.h:61] In function validate(), assert failed (v != 255): invalid char

I am running code on main branch. Using any other branches like release/0.2 lead to xCode errors: checksum of downloladed artifact doesn't match manifest

Found someone having same issue in https://github.com/pytorch/executorch/issues/3772#issuecomment-2143329656

ErisMik commented 2 months ago

Hi, I am seeing this issue as well. I ran into XCode issues trying to run any other branch, so I had to use main to build and run the app. In this instance however, I was trying to use the full Llama 2 7B model (following the same guide).

phamnhuvu-dev commented 3 days ago

I can run it on the main branch