basetenlabs / truss-examples

Examples of models deployable with Truss

https://trussml.com

MIT License

130 stars 37 forks source link

llama3 8b instruct fp8 on h100 #270

Closed aspctu closed 5 months ago

joostinyi commented 5 months ago

271 has copy fixes