search

huggingface / huggingface-llama-recipes

531 stars 59 forks source link

Serve Llama models with `Text Generation Inference` recipe #45

Closed sergiopaniego closed 1 month ago

sergiopaniego commented 1 month ago

This issue comes from the open call for contributions #43.

In this case, this issue is intended for the generation of a recipe for serving Llama models using the Text Generation Inference

ariG23498 commented 1 month ago

Hi @sergiopaniego Thank you for taking this up!

Looking forward to what you build.

kritikaparmar-programmer commented 1 month ago

Hey @sergiopaniego , are you looking for collaborators? I would like to contribute to this project. Thankyou

sergiopaniego commented 1 month ago

Hi @kritikaparmar-programmer!

Thanks for your interest. I've created the PR with the recipe. You may take a look at it and see if anything may be improved 😄