Closed ppanero closed 1 year ago
For running kcat
on the current infrastructure:
# TDLR: there's an alias for the QA environment named `kcat_qa`
# consume the first 10 messages from the "zenodo-migration.public" topic
kcat_qa -C -t "zenodo-migration.public" -c 10
# Which does the following
KAFKA_BROKERS="kafka-broker-host1:9093,kafka-broker-host2:9093"
KRB_PRINCIPAL="<service-account-user>@CERN.CH"
KRB_KEYTAB="/path/to/<username>.keytab"
kcat \
-b ${KAFKA_BROKERS} \
-X security.protocol=SASL_SSL -X sasl.mechanism=GSSAPI -X sasl.kerberos.principal=${KRB_PRINCIPAL} -X sasl.kerberos.keytab=${KRB_KEYTAB} \
Note that this sometimes fails, so you'll have to retry the command until it works. I suspect that I'm missing some retry parameter because the Python client never had any problems.
From @slint (thanks!):
kcat_qa -C -t "zenodo-migration.public" -o end
Both PRs are ready to review. Note that zenodo-rdm tests are passing in local (requires the invenio-rdm-migration PR to be released).
[ ] GHConsidered as OAuth client connect action[ ] ORCIDConsidered as OAuth client connect actionAAI (Not implemented in Zenodo legacy)[ ] Update user profiletackled in https://github.com/inveniosoftware/invenio-rdm-migrator/issues/126kcat
(if not there yet). @slint was working on this, check status.Note: user deletion will be frozen during migration. Therefore, is not a use case to take into account.