pzingg / cloud_hub

Elixir web server that implements both the WebSub and RssCloud APIs
https://websubhub.com
Other
0 stars 0 forks source link

Test server under loads #2

Open pzingg opened 1 year ago

pzingg commented 1 year ago

Not sure how this server would operate with high frequency of updates, large resource sizes, and large numbers of subscribers. Items to consider:

  1. Time, memory and CPU load required to send out every SubscriptionUpdate Oban job if there are 10s of thousands of subscribers on a large resource.
  2. Size of database. WebSub adds the full resource content in each Update record in the database. These records should be purged within a few hours (?) of the last SubscriptionUpdate sent out. Develop a cron system to purge old records, or older Update records for the same resource could be deflated by setting their body value to an empty string.