Closed joe4dev closed 1 year ago
I disabled the moto tests for lambda a few weeks ago, because they blocked the entire test pipeline. Seemed to becaused by new iam rules we enforce in LS, and were not honored by the moto test. If the terraform tests work again, the "external test suite" will be checked again :)
Thank you for the context @steffyP
Seemed to becaused by new iam rules we enforce in LS, and were not honored by the moto test.
I see. Probably not worth fixing and better disabling IAM enforcement for them because they are not designed with IAM in mind.
@macnev2013 Did the TF lambda tests ever work? Any idea what's broken in the TF test setup?
@joe4dev: We are keeping track of the successful amount of test cases for this terraform-testing project, and it seems like for lambda there were only 5 test cases working in the past (and still are).
Regarding the moto tests: no, it doesn't make any sense to "fix" them. The only intention behind the moto-test project was to get some more test coverage for all services/operations that only rely on the moto fallback implementation and are therefore not tested in LocalStack explicitly.
We could think about removing the column "external test suite" for services where we already have a high internal test coverage, and no/little external tests.
it seems like for lambda there were only 5 test cases working in the past (and still are).
These 5 tests have little to do with Lambda itself (e.g., doing some parameter validations). It seems the Lambda tests never worked because the deployment package is missing (i.e., "test-fixtures/lambdatest.zip"
).
The Lambda coverage page in our docs does not show any ✅ for "External Test Suite" nor "Terraform Validated" (except for ListEventSourceMappings presumably covered somewhere else). The hug gap in the middle looks bad 😢
The logs of the latest run indicate an issue in the test setup:
It appears that the lambda test fixtures are not available:
Error: unable to load "test-fixtures/lambdatest.zip": open test-fixtures/lambdatest.zip: no such file or directory
Therefore, all Lambda tests fail.@macnev2013 /cc @steffyP