search

basetenlabs / truss

The simplest way to serve AI/ML models in production
https://truss.baseten.co
MIT License
892 stars 64 forks source link

Adding Whisper key to TRT LLM config #994

Closed aspctu closed 3 months ago

aspctu commented 3 months ago

:rocket: What

Adds Whisper key to TRT LLM config

:computer: How

:microscope: Testing