I need to add prompt for whisper in triton during inferencing, but find no api to add it.
So anyone know how to add prompt for whisper in triton?
There's only a simple prompt as below with limited length, and nothing happen whatever i add extra prompt in it.
whisper_prompt = f"<|startoftranscript|><|{language}|><|transcribe|><|notimestamps|>"
I need to add prompt for whisper in triton during inferencing, but find no api to add it. So anyone know how to add prompt for whisper in triton?
There's only a simple prompt as below with limited length, and nothing happen whatever i add extra prompt in it. whisper_prompt = f"<|startoftranscript|><|{language}|><|transcribe|><|notimestamps|>"