search

awslabs / llm-hosting-container

Large Language Model Hosting Container
Apache License 2.0
75 stars 32 forks source link

adds huggingface tgi container tuning documentation #28

Closed sean-eich closed 1 year ago

sean-eich commented 1 year ago

Issue #, if available:

Description of changes: Adds documentation for huggingface TGI container tuning params.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.