search

microsoft / Phi-3CookBook

This is a Phi-3 book for getting started with Phi-3. Phi-3, a family of open AI models developed by Microsoft. Phi-3 models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks.
MIT License
2.24k stars 224 forks source link

ollama version #120

Closed elifbykrbc closed 1 month ago

elifbykrbc commented 1 month ago

due to llama.cpp not support phi3-vision i'm stuck into. That's very complicated than that personal developers can.

leestott commented 1 month ago

Hi @elifbykrbc have you tried the samples for ONNX and Phi-3 vision? https://onnxruntime.ai/docs/genai/tutorials/phi3-v.html

There are specific ONNX available models


huggingface-cli download microsoft/Phi-3-vision-128k-instruct-onnx-cpu --include cpu-int4-rtn-block-32-acc-level-4/* --local-dir ```