Discover how phi3-mini, a new series of models from Microsoft, enables deployment of Large Language Models (LLMs) on edge devices and IoT devices. Learn how to use Semantic Kernel, Ollama/LlamaEdge, and ONNX Runtime to access and infer phi3-mini models, and explore the possibilities of generative AI in various application scenarios
MIT License
69
stars
16
forks
source link
Unable to run onnxruntime-genai on iOS (Xcode 15.3) #16
I'm unable to run onnxruntime-genai for iOS using Xcode 15.3. I followed the steps mentioned in the demo and this Microsoft link, but the repository you referenced is unavailable (git checkout yguo/ios-build-genai). I proceeded with the main branch from GitHub and set everything up the same, but the application crashes on launch. Even your demo fails to run successfully.
FYI, I also tried the branch (git checkout yguo/chat-app-genai) available on the repo, but in this branch, none of the mentioned commands work, and no code can be executed.
I've attached a screenshot and crash logs from the console for reference. Could you please help with troubleshooting or guide me to resolve this crash? If you need additional details, I’ll be happy to share.
First Crash:/private/var/containers/Bundle/Application/8AC1B341-3A75-4806-AA85-8F61A506F689/OnnxModelFinal.app
Second Crash:libc++abi: terminating due to uncaught exception of type std::runtime_error: Error opening /private/var/containers/Bundle/Application/8AC1B341-3A75-4806-AA85-8F61A506F689/OnnxModelFinal.app/genai_config.json
Screenshot from Xcode console:
I added all the files correctly and set the path properly. After that, I encountered another error. Please check the screenshot.
Hello Team and @kinfey, Hope you're doing well.
I'm unable to run onnxruntime-genai for iOS using Xcode 15.3. I followed the steps mentioned in the demo and this Microsoft link, but the repository you referenced is unavailable (git checkout yguo/ios-build-genai). I proceeded with the main branch from GitHub and set everything up the same, but the application crashes on launch. Even your demo fails to run successfully.
FYI, I also tried the branch
(git checkout yguo/chat-app-genai)available on the repo, but in this branch, none of the mentioned commands work, and no code can be executed.I've attached a screenshot and crash logs from the console for reference. Could you please help with troubleshooting or guide me to resolve this crash? If you need additional details, I’ll be happy to share.
First Crash:
/private/var/containers/Bundle/Application/8AC1B341-3A75-4806-AA85-8F61A506F689/OnnxModelFinal.appSecond Crash:
libc++abi: terminating due to uncaught exception of type std::runtime_error: Error opening /private/var/containers/Bundle/Application/8AC1B341-3A75-4806-AA85-8F61A506F689/OnnxModelFinal.app/genai_config.jsonScreenshot from Xcode console:
I added all the files correctly and set the path properly. After that, I encountered another error. Please check the screenshot.
Thank you!