search

microsoft / Phi-3CookBook

This is a Phi-3 book for getting started with Phi-3. Phi-3, a family of open sourced AI models developed by Microsoft. Phi-3 models are the most capable and cost-effective small language models (SLMs) available, outperforming models of the same size and next size up across a variety of language, reasoning, coding, and math benchmarks.
MIT License
2.5k stars 259 forks source link

Phi-3.5 medium model and system message not being observed #180

Closed leestott closed 2 months ago

leestott commented 2 months ago

Please provide us with the following information: Phi-3.5 medium model and system message not being observed

This issue is for a: (mark with an x)

- [x] bug report -> please search issues before submitting
- [ ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Minimal steps to reproduce

Any log messages given by the failure

Expected/desired behavior

OS and Version?

Windows 7, 8 or 10. Linux (which distribution). macOS (Yosemite? El Capitan? Sierra?)

azd version?

run azd version and copy paste here.

Versions

Mention any other details that might be useful

Thanks! We'll be in touch soon.

leestott commented 2 months ago

System prompt support was introduced to Phi-3-mini in the June 2024 update; however, no update was made for Phi-3-medium. We suggest switching to Phi-3.5-MoE as an upgrade of Phi-3-medium as the MoE model is a much better and cost effective model.