Add parts that control traffic

[Rwatana]

Background

The server has a function to send logs to the database, and with a large number of API calls, a high volume of logs may be concentrated. This can put a load on the server when many logs are sent at once, so it is necessary to add a traffic control mechanism.

Goal

This issue will be closed when the server has an effective traffic control mechanism in place that successfully prevents overload during high volumes of log transmission to the database. All tests confirming that the server can handle peak log traffic without degradation of performance must be completed.

Approach

Overview

• What: Implement a traffic control mechanism on the server to manage log transmission loads, ensuring that the server is not overwhelmed during high log volume periods.
• How:
  • Analyze current log traffic patterns and identify peak load times.
  • Implement rate limiting or batching strategies to control the flow of logs to the database.
  • Introduce backpressure handling to delay or reduce the number of logs sent when the server is under high load.
  • Test the new mechanism under simulated peak conditions to ensure its effectiveness.

Todo

• [ ] Analyze current log traffic and identify peak load times.
• [ ] Implement rate limiting or batching for log transmission.
• [ ] Add testing that the log queueing works efficiently or not.

Deadline

8/18

References

None

[nayuta-ai]

@Rwatana I believe this issue is too large to complete within one week, so it should be treated as a parent issue. Please create some child issues related to this PR.