api/generate: Implement rate limiting based on req logs

[victorges]

What does this pull request do? Explain your changes. (required)

This creates the capability of rate-limiting API calls to the /generate endpoints. It uses the request log built on #2273 to track the rate of requests and limits based on a CLI argument.

We can later build support for per billing plan limits depending on the user, but I left that for the future.

Specific updates (required)

• Create new rate limit logic on generate API through a middleware
• Add tests to the rate limiter logic

How did you test each of these updates (required) yarn test

Does this pull request close any open issues? Implements ENG-2180

Checklist

• [x] I have read the CONTRIBUTING document.
• [ ] My change requires a change to the documentation.
• [ ] I have updated the documentation accordingly.
• [x] I have added tests to cover my changes.

[vercel[bot]]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
livepeer-studio	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jul 29, 2024 9:12pm