search

basetenlabs / truss-examples

Examples of models deployable with Truss
https://trussml.com
MIT License
143 stars 37 forks source link

[BT-12061] Add phi 3.5 mini instruct example #347

Closed derrick-yyang closed 2 months ago

derrick-yyang commented 2 months ago

Used vLLM template to add Phi 3.5 mini-instruct model

Note: ignore the commit for using port 8080. The default port 8000 is used

linear[bot] commented 2 months ago

BT-12061 Trussify Phi 3.5 Mini Instruct model