Sporadic failure on `test_permission_request_notifications_flow_for_manual_review`

comic / grand-challenge.org

A platform for end-to-end development of machine learning solutions in biomedical imaging

https://grand-challenge.org

Apache License 2.0

176 stars 51 forks source link

Sporadic failure on `test_permission_request_notifications_flow_for_manual_review` #3704

Closed chrisvanrun closed 1 hour ago

chrisvanrun commented 6 hours ago

See run: https://github.com/comic/grand-challenge.org/actions/runs/11909994990/job/33188499636

I think it is quickly fixable by ordering the notifications.

jmsmkn commented 2 hours ago

Quick fix: you can mark the test as flaky using @pytest.mark.flaky(reruns=3). Proper fix: rewrite the test so that it is not dependent on the ordering of Notifications.