pulumi / pulumi-terraform-bridge

A library allowing Terraform providers to be bridged into Pulumi.
Apache License 2.0
199 stars 43 forks source link

Plugin Framework bridge cross tests #2592

Closed VenelinMartinov closed 1 week ago

VenelinMartinov commented 2 weeks ago

This is a test-only PR - it adds cross-tests for Diff for the plugin framework for the existing behaviour.

Each test defines a set of schemas and a set of scenarios and the full matrix of schemas X scenarios is run in cross-tests. For each of these test cases both pulumi and TF are run with the initial input then a preview is run with the second set of inputs and the outcome of the preview is compared.

We also record the stdout for both pulumi and TF for manual comparison of the preview output. The recordings also contain the inputs in order to make spot-checking them easier.

The full test plan is available in https://github.com/pulumi/pulumi-terraform-bridge/issues/2597

fixes https://github.com/pulumi/pulumi-terraform-bridge/issues/2297 fixes https://github.com/pulumi/pulumi-terraform-bridge/issues/2597

VenelinMartinov commented 2 weeks ago

This change is part of the following stack:

Change managed by git-spice.

codecov[bot] commented 2 weeks ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 62.81%. Comparing base (e0fa71e) to head (6fda624). Report is 2 commits behind head on master.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #2592 +/- ## ========================================== + Coverage 62.79% 62.81% +0.01% ========================================== Files 389 389 Lines 51938 51939 +1 ========================================== + Hits 32615 32624 +9 + Misses 17515 17506 -9 - Partials 1808 1809 +1 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

VenelinMartinov commented 2 weeks ago

I'll follow-up with issues for the TODOs

pulumi-bot commented 15 hours ago

This PR has been shipped in release v3.96.0.