A single run of the Robot suite performs hundreds or thousands of certificate roations, depending on the test fleet size. Occasional test case failures are observed due to:
Expiry of the 3s Lambda timeout on the job execution terminal Lambda; this timeout needs to be longer to deal with occasional outliers.
Eventual consistency of the greengrassv2 API operations; sometimes GetDeployment returns a ResourceNotFound exception in the seconds after CreateDeployment.
Both issues are rare, but could happen on certificate rotations performed on production fleets, with greater likelhood of occuring on bigger fleet sizes.
A single run of the Robot suite performs hundreds or thousands of certificate roations, depending on the test fleet size. Occasional test case failures are observed due to:
Both issues are rare, but could happen on certificate rotations performed on production fleets, with greater likelhood of occuring on bigger fleet sizes.