Closed derrick-yyang closed 1 week ago
TRTLLM Engine Builder exampels for llama3.1 8b and 7b.
Targeted 3 use cases for each model:
BT-11715 Prepare a set of engine builder templates for common configurations
TRTLLM Engine Builder exampels for llama3.1 8b and 7b.
Targeted 3 use cases for each model: