search

basetenlabs / truss-examples

Examples of models deployable with Truss
https://trussml.com
MIT License
130 stars 37 forks source link

Llama 3 70B - TRT and change directory for TRT #300

Closed vshulman closed 3 months ago

vshulman commented 4 months ago
  1. Adding a second Llama 3 70B engine and re-organizing directories
  2. Adding example of HF's text-emmbeddings-inference