search

run-house / runhouse

Like PyTorch for building ML systems. Iterable, debuggable, multi-cloud, 100% reproducible across research and production.
https://run.house
Apache License 2.0
942 stars 37 forks source link

Llama 3 TGI Example #930

Closed mkandler closed 1 week ago

mkandler commented 1 week ago

Adds a new example of running Llama 3 with TGI on AWS based on the Llama 2 example

mkandler commented 1 week ago

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @mkandler and the rest of your teammates on Graphite Graphite