search

microsoft / onnxruntime-inference-examples

Examples for using ONNX Runtime for machine learning inferencing.
MIT License
1.07k stars 312 forks source link

Add basic iOS phi-3 sample #433

Closed YUNQIUGUO closed 1 month ago

YUNQIUGUO commented 1 month ago

Added a basic iOS Phi-3 sample application, achieves the functionality of generating streaming output token by token in the app similarly as for the android Phi-3 app.

TODOs:

  1. Refine App UI (a. add input text box to accept user prompt question (manual hard coded in the ContentView.swift for now). b. Chatbox UI design.)
  2. Potential README.md doc updates.

Partially referenced from this project: https://github.com/Azure-Samples/Phi-3MiniSamples/tree/main/ios