search

lsst-uk / lasair-lsst

Apache License 2.0
0 stars 0 forks source link

Replace Mirrormaker with MM2 #28

Open gpfrancis opened 1 year ago

gpfrancis commented 1 year ago

Mirrormaker 1 is deprecated and should be replaced with MM2.

See https://cwiki.apache.org/confluence/display/KAFKA/KIP-720%3A+Deprecate+MirrorMaker+v1 and https://cwiki.apache.org/confluence/display/KAFKA/KIP-382%3A+MirrorMaker+2.0

gpfrancis commented 11 months ago

Preliminary answer: MM2 (in non-legacy mode) may have some advantages in terms of performance and robustness, but also requires (or at least benefits from) the cooperation of the upstream broker. We should therefore continue using MM1 with ZTF and switch to MM2 in legacy mode if necessary. For LSST we should probably coordinate with the USDF and other brokers to agree on which we are going to use.