mozilla-services / remote-settings-lambdas

Remote Settings scheduled tasks
Apache License 2.0
2 stars 8 forks source link

Failing backport records #862

Open leplatrem opened 4 years ago

leplatrem commented 4 years ago

We still receive 412 Modified Meanwhile errors on STAGE where version 5.3.3 is supposed to be deployed https://sentry.prod.mozaws.net/operations/kinto-lambdas-stage/issues/7699994/

I can't understand what's going on. I cannot reproduce it... For example with the dev server:

http PUT https://kinto.dev.mozaws.net/v1/buckets/test -a admin:s3cr3t
http PUT https://kinto.dev.mozaws.net/v1/buckets/test/collections/test -a admin:s3cr3t
http PUT https://kinto.dev.mozaws.net/v1/buckets/test/collections/test/records/haha -a admin:s3cr3t
http PUT https://kinto.dev.mozaws.net/v1/buckets/test2 -a admin:s3cr3t
http PUT https://kinto.dev.mozaws.net/v1/buckets/test2/collections/test2 -a admin:s3cr3t

Sync the 2 collections:

SERVER=https://kinto.dev.mozaws.net/v1 BACKPORT_RECORDS_SOURCE_AUTH=admin:s3cr3t BACKPORT_RECORDS_SOURCE_BUCKET=test BACKPORT_RECORDS_SOURCE_COLLECTION=test BACKPORT_RECORDS_DEST_BUCKET=test2 BACKPORT_RECORDS_DEST_COLLECTION=test2  python3 aws_lambda.py backport_records

Batch #0: PUT /buckets/test2/collections/test2/records/haha - 201 
Done. 1 changes applied.

Modify the record on source:

echo '{"data": {"pouet": 2}}' | http PUT https://kinto.dev.mozaws.net/v1/buckets/test/collections/test/records/haha -a admin:s3cr3t

Sync again:

SERVER=https://kinto.dev.mozaws.net/v1 BACKPORT_RECORDS_SOURCE_AUTH=admin:s3cr3t BACKPORT_RECORDS_SOURCE_BUCKET=test BACKPORT_RECORDS_SOURCE_COLLECTION=test BACKPORT_RECORDS_DEST_BUCKET=test2 BACKPORT_RECORDS_DEST_COLLECTION=test2  python3 aws_lambda.py backport_records
Batch #0: PUT /buckets/test2/collections/test2/records/haha - 200 
Done. 1 changes applied.
glasserc commented 4 years ago

Just using the URL in the Sentry, it seems like that recipe isn't in the collection? https://firefox.settings.services.mozilla.com/v1/buckets/main-workspace/collections/normandy-recipes/records/530 gives a 404. It's also missing in the capabilities collection. Is this a deletion? A creation? Is there something that got hung up in the Normandy publish?

leplatrem commented 4 years ago

It's on STAGE

http https://kinto.stage.mozaws.net/v1/buckets/main-workspace/collections/normandy-recipes-capabilities/records/530 | jq .data.last_modified
1585606901705
http https://kinto.stage.mozaws.net/v1/buckets/main-workspace/collections/normandy-recipes/records/530 | jq .data.last_modified 
1584476420988