Set up workers

[gabrc52]

https://matrix-org.github.io/synapse/latest/workers.html

For reference, we have 6 cores and 12 threads:

$ inxi -C
CPU:
  Info: 2x 6-core model: Intel Xeon X5680

• [x] Install redis
• [ ] Enable [replication] in the main process
• [ ] Enable redis-based replication
• [ ] Generate and add shared secret
• [ ] Ensure all authentication, especially SAML and including our custom display name picker, all run in the same worker
• [ ] Make the directory and our custom endpoints run on a separate worker
• [ ] Choose what workers we want
• [ ] Sanity-check our choices or ask for help by going to the Synapse-Admins room
• [ ] Make configuration files for each worker
• [ ] Add instance_map with workers
• [ ] Change systemd units to use workers: https://matrix-org.github.io/synapse/latest/systemd-with-workers/
• [ ] Configure nginx to actually use the workers
• [ ] Monitor workers: https://matrix-org.github.io/synapse/latest/metrics-howto.html#monitoring-workers

[gabrc52]

https://matrix-org.github.io/synapse/latest/metrics-howto.html#monitoring-workers

Keep in mind workers need additional setup with metrics

[gabrc52]

I feel like we can also do this incrementally or gradually. We can start by adding a new worker to send push notifications, a new worker to deal with federation, one to deal with media, and other things which are pretty standalone.