zenodo / zenodo-rdm

Zenodo, powered by InvenioRDM
https://zenodo.org
GNU General Public License v2.0
51 stars 26 forks source link

migration-actions: User #424

Closed ppanero closed 1 year ago

ppanero commented 1 year ago

Note: user deletion will be frozen during migration. Therefore, is not a use case to take into account.

slint commented 1 year ago

For running kcat on the current infrastructure:

# TDLR: there's an alias for the QA environment named `kcat_qa`
# consume the first 10 messages from the "zenodo-migration.public" topic
kcat_qa -C -t "zenodo-migration.public" -c 10  

# Which does the following
KAFKA_BROKERS="kafka-broker-host1:9093,kafka-broker-host2:9093"
KRB_PRINCIPAL="<service-account-user>@CERN.CH"
KRB_KEYTAB="/path/to/<username>.keytab"

kcat \
    -b ${KAFKA_BROKERS} \
    -X security.protocol=SASL_SSL -X sasl.mechanism=GSSAPI -X sasl.kerberos.principal=${KRB_PRINCIPAL} -X sasl.kerberos.keytab=${KRB_KEYTAB} \

Note that this sometimes fails, so you'll have to retry the command until it works. I suspect that I'm missing some retry parameter because the Python client never had any problems.

ppanero commented 1 year ago

From @slint (thanks!):

kcat_qa -C -t "zenodo-migration.public" -o end

ppanero commented 1 year ago

Both PRs are ready to review. Note that zenodo-rdm tests are passing in local (requires the invenio-rdm-migration PR to be released).