Assist N2T migration - Githubissues

jsjiang commented 7 months ago

The production implementation of the EZID/N2T Resolver Refactoring is planned on Mar 12 and 13. The EZID ARKs will be resolved by EZID with this migration. So there is no need to send ARKs to N2T anymore. However we still need to keep the EZID updating N2T workflow to support rollback of N2T migration. Modify EZID to support N2T migration.

[x] Perform load tests with minter + resolver combined
[x] Modify EZID to talk to the alias to the old N2T server
[x] 3 or 4 days before Prod go-live date ask IAS to do DNS name cutover
[x] Verify N2T functionalities after go-live
[x] Monitor load and network traffic on EZID introduced by resolving ARKs
[x] Stop proc-binder job once the new N2T system is stable
[ ] Stop creating the shoulder-list.txt file
[ ] Stop forwarding the ok: cron hitrnt ids-n2t2-dev.n2t.net email to the Slack n2t channel
[ ] Stop forwarding the NAAN registry updated email to the Slack n2t channel
[ ] Stop running the pfxsync_update script on the legacy n2t-stage instance

jsjiang commented 7 months ago

Related tickets: Update EZID to use N2T alias #581 Stop proc-binder job #563

jsjiang commented 7 months ago

Load tests findings:

Minter and resolver combined load tests (1:1 ratio) showed 20% increased load comparing to running the minter only.

Request statistics (10 users, top: minter only, bottom: minter + resolver, RPS decreased from 8.6 to 6.5)

Response time (10 users, top: minter only, bottom: minter + resolver, 50%ile (ms) increased from 780 to 960)

jsjiang commented 5 months ago

@ashleygould Can you provide detailed information on DNS name change. Thank you!

jsjiang commented 5 months ago

Tickets for DNS cutover:

3 or 4 days before go-live, create an IAS ticket based on info in the DNS cutover for n2t.net
Add subject alternative names to cert for ALB uc3-ezidn2t-prd-alb - completed (4/11)

jsjiang commented 5 months ago

Verify N2T functionalities after go-live: ref ticket

[ ] Verify connectivity - How to verify?
[ ] Verify operation - What to verify?

Check logs in OpenSearch for

filebeat-uc3-ezid-legacyn2t*
filebeat-uc3-ezid-unit-prd

CDLUC3 / ezid

Assist N2T migration #582