Closed eabili0 closed 4 years ago
We shouldn't lock whisper onto any technology to deal with this issue. This is an issue for production and varies according to the user's needs and infrastructure reality.
We should just add a doc note recommending that using whisper in production should have a rate limiting service above Whisper to ensure the safety of our API's.
We need to be able to rate limit the requests to all Whisper's APIs.
We should not bring this logic to Whisper. An external rate limit service should be used instead.