search

localstack / localstack-terraform-test

Utilities to run Terraform tests against LocalStack
25 stars 6 forks source link

reverted: terraform-provider-aws repo version #31

Closed macnev2013 closed 1 year ago

macnev2013 commented 1 year ago

Motivation

Unfortunately, we are required to rollback the updates made to the terraform-provider due to suboptimal test performance and refactored the codebase.

Added

github-actions[bot] commented 1 year ago

Terraform Test Results

175 tests  +175   127 :heavy_check_mark: +127   4h 25m 15s :stopwatch: + 4h 25m 15s     1 suites +    1       0 :zzz: ±    0      1 files   +    1     48 :x: +  48 

For more details on these failures, see this check.

Results for commit 3cef30ba. ± Comparison against base commit ec314041.

:recycle: This comment has been updated with latest results.

macnev2013 commented 1 year ago

Here is a workflow run for validation.

macnev2013 commented 1 year ago

@steffyP, I have resolved the bug identified by @joe4dev related to lambda fixture errors (#28) . The relevant workflow run can be accessed here. My apologies for incorporating the fix into this same PR.

steffyP commented 1 year ago

@steffyP, I have resolved the bug identified by @joe4dev related to lambda fixture errors (#28) . The relevant workflow run can be accessed here. My apologies for incorporating the fix into this same PR.

Nice 👍 let's wait for the result of the run, to see if everything works as expected 🙂

joe4dev commented 1 year ago

@steffyP, I have resolved the bug identified by @joe4dev related to lambda fixture errors (#28) . The relevant workflow run can be accessed here. My apologies for incorporating the fix into this same PR.

Exciting to see Lambda tests running 😁 🚀 Thank you @macnev2013

Seeing some other errors than before is a good sign (event source mapping is expected to break ATM) 🤞 :

Screenshot 2023-10-04 at 20 29 19
joe4dev commented 1 year ago

yeah 🥳 that took a while 🙀 48 failed, 127 passed in 15877.75s (4:24:37)

It looks like we have a summary of actually failing Lambda tests now 👀 /cc @dfangl @dominikschubert 

2023-10-04T20:26:54.1710794Z =========================== short test summary info ============================
2023-10-04T20:26:54.1711546Z FAILED terraform-provider-aws/internal/service/lambda/alias_test.go::TestAccLambdaAlias_routing
2023-10-04T20:26:54.1712179Z FAILED terraform-provider-aws/internal/service/lambda/code_signing_config_data_source_test.go::TestAccLambdaCodeSigningConfigDataSource_basic
2023-10-04T20:26:54.1713079Z FAILED terraform-provider-aws/internal/service/lambda/code_signing_config_data_source_test.go::TestAccLambdaCodeSigningConfigDataSource_policyID
2023-10-04T20:26:54.1713746Z FAILED terraform-provider-aws/internal/service/lambda/code_signing_config_data_source_test.go::TestAccLambdaCodeSigningConfigDataSource_description
2023-10-04T20:26:54.1714279Z FAILED terraform-provider-aws/internal/service/lambda/code_signing_config_test.go::TestAccLambdaCodeSigningConfig_basic
2023-10-04T20:26:54.1714829Z FAILED terraform-provider-aws/internal/service/lambda/code_signing_config_test.go::TestAccLambdaCodeSigningConfig_updatePolicy
2023-10-04T20:26:54.1715390Z FAILED terraform-provider-aws/internal/service/lambda/code_signing_config_test.go::TestAccLambdaCodeSigningConfig_updatePublishers
2023-10-04T20:26:54.1715947Z FAILED terraform-provider-aws/internal/service/lambda/event_source_mapping_test.go::TestAccLambdaEventSourceMapping_Kinesis_basic
2023-10-04T20:26:54.1716514Z FAILED terraform-provider-aws/internal/service/lambda/event_source_mapping_test.go::TestAccLambdaEventSourceMapping_SQS_basic
2023-10-04T20:26:54.1717072Z FAILED terraform-provider-aws/internal/service/lambda/event_source_mapping_test.go::TestAccLambdaEventSourceMapping_SQS_batchWindow
2023-10-04T20:26:54.1717636Z FAILED terraform-provider-aws/internal/service/lambda/event_source_mapping_test.go::TestAccLambdaEventSourceMapping_Kinesis_destination
2023-10-04T20:26:54.1718165Z FAILED terraform-provider-aws/internal/service/lambda/event_source_mapping_test.go::TestAccLambdaEventSourceMapping_msk
2023-10-04T20:26:54.1719138Z FAILED terraform-provider-aws/internal/service/lambda/event_source_mapping_test.go::TestAccLambdaEventSourceMapping_mskWithEventSourceConfig
2023-10-04T20:26:54.1719756Z FAILED terraform-provider-aws/internal/service/lambda/event_source_mapping_test.go::TestAccLambdaEventSourceMapping_selfManagedKafka
2023-10-04T20:26:54.1720577Z FAILED terraform-provider-aws/internal/service/lambda/event_source_mapping_test.go::TestAccLambdaEventSourceMapping_selfManagedKafkaWithEventSourceConfig
2023-10-04T20:26:54.1721119Z FAILED terraform-provider-aws/internal/service/lambda/event_source_mapping_test.go::TestAccLambdaEventSourceMapping_activeMQ
2023-10-04T20:26:54.1721668Z FAILED terraform-provider-aws/internal/service/lambda/event_source_mapping_test.go::TestAccLambdaEventSourceMapping_rabbitMQ
2023-10-04T20:26:54.1722239Z FAILED terraform-provider-aws/internal/service/lambda/event_source_mapping_test.go::TestAccLambdaEventSourceMapping_SQS_filterCriteria
2023-10-04T20:26:54.1722821Z FAILED terraform-provider-aws/internal/service/lambda/event_source_mapping_test.go::TestAccLambdaEventSourceMapping_SQS_scalingConfig
2023-10-04T20:26:54.1723359Z FAILED terraform-provider-aws/internal/service/lambda/event_source_mapping_test.go::TestAccLambdaEventSourceMapping_documentDB
2023-10-04T20:26:54.1723903Z FAILED terraform-provider-aws/internal/service/lambda/function_data_source_test.go::TestAccLambdaFunctionDataSource_fileSystem
2023-10-04T20:26:54.1724384Z FAILED terraform-provider-aws/internal/service/lambda/function_test.go::TestAccLambdaFunction_codeSigning
2023-10-04T20:26:54.1724855Z FAILED terraform-provider-aws/internal/service/lambda/function_test.go::TestAccLambdaFunction_concurrency
2023-10-04T20:26:54.1725358Z FAILED terraform-provider-aws/internal/service/lambda/function_test.go::TestAccLambdaFunction_concurrencyCycle
2023-10-04T20:26:54.1725830Z FAILED terraform-provider-aws/internal/service/lambda/function_test.go::TestAccLambdaFunction_envVariables
2023-10-04T20:26:54.1726371Z FAILED terraform-provider-aws/internal/service/lambda/function_test.go::TestAccLambdaFunction_EnvironmentVariables_emptyUpgrade
2023-10-04T20:26:54.1726879Z FAILED terraform-provider-aws/internal/service/lambda/function_test.go::TestAccLambdaFunction_encryptedEnvVariables
2023-10-04T20:26:54.1727345Z FAILED terraform-provider-aws/internal/service/lambda/function_test.go::TestAccLambdaFunction_fileSystem
2023-10-04T20:26:54.1727946Z FAILED terraform-provider-aws/internal/service/lambda/function_test.go::TestAccLambdaFunction_architectures
2023-10-04T20:26:54.1728456Z FAILED terraform-provider-aws/internal/service/lambda/function_test.go::TestAccLambdaFunction_architecturesUpdate
2023-10-04T20:26:54.1728961Z FAILED terraform-provider-aws/internal/service/lambda/function_test.go::TestAccLambdaFunction_architecturesWithLayer
2023-10-04T20:26:54.1729426Z FAILED terraform-provider-aws/internal/service/lambda/function_test.go::TestAccLambdaFunction_localUpdate
2023-10-04T20:26:54.1729921Z FAILED terraform-provider-aws/internal/service/lambda/function_test.go::TestAccLambdaFunction_LocalUpdate_nameOnly
2023-10-04T20:26:54.1730400Z FAILED terraform-provider-aws/internal/service/lambda/function_test.go::TestAccLambdaFunction_S3Update_basic
2023-10-04T20:26:54.1730911Z FAILED terraform-provider-aws/internal/service/lambda/function_test.go::TestAccLambdaFunction_S3Update_unversioned
2023-10-04T20:26:54.1731385Z FAILED terraform-provider-aws/internal/service/lambda/function_test.go::TestAccLambdaFunction_skipDestroy
2023-10-04T20:26:54.1731921Z FAILED terraform-provider-aws/internal/service/lambda/function_test.go::TestAccLambdaFunction_skipDestroyInconsistentPlan
2023-10-04T20:26:54.1732481Z FAILED terraform-provider-aws/internal/service/lambda/function_url_data_source_test.go::TestAccLambdaFunctionURLDataSource_basic
2023-10-04T20:26:54.1732955Z FAILED terraform-provider-aws/internal/service/lambda/function_url_test.go::TestAccLambdaFunctionURL_basic
2023-10-04T20:26:54.1733440Z FAILED terraform-provider-aws/internal/service/lambda/function_url_test.go::TestAccLambdaFunctionURL_Cors
2023-10-04T20:26:54.1733918Z FAILED terraform-provider-aws/internal/service/lambda/function_url_test.go::TestAccLambdaFunctionURL_Alias
2023-10-04T20:26:54.1734397Z FAILED terraform-provider-aws/internal/service/lambda/function_url_test.go::TestAccLambdaFunctionURL_TwoURLs
2023-10-04T20:26:54.1734979Z FAILED terraform-provider-aws/internal/service/lambda/function_url_test.go::TestAccLambdaFunctionURL_invokeMode
2023-10-04T20:26:54.1735557Z FAILED terraform-provider-aws/internal/service/lambda/layer_version_data_source_test.go::TestAccLambdaLayerVersionDataSource_runtime
2023-10-04T20:26:54.1736130Z FAILED terraform-provider-aws/internal/service/lambda/layer_version_permission_test.go::TestAccLambdaLayerVersionPermission_org
2023-10-04T20:26:54.1736699Z FAILED terraform-provider-aws/internal/service/lambda/layer_version_permission_test.go::TestAccLambdaLayerVersionPermission_account
2023-10-04T20:26:54.1737199Z FAILED terraform-provider-aws/internal/service/lambda/permission_test.go::TestAccLambdaPermission_principalOrgID
2023-10-04T20:26:54.1737876Z FAILED terraform-provider-aws/internal/service/lambda/provisioned_concurrency_config_test.go::TestAccLambdaProvisionedConcurrencyConfig_idMigration530
2023-10-04T20:26:54.1738089Z ================= 48 failed, 127 passed in 15877.75s (4:24:37) =================