`sst remove` problems with aws-sdk in dynamic providers

[eschaefer]

When running AWS_PROFILE=myprofile sst remove --stage dev

    SST ❍ ion 0.0.419  ready!

➜  App:        pretest
   Stage:      dev

~  Removing

|  Deleting    WebCdn sst:aws:CDN → WebCdnWaiter sst:aws:DistributionDeploymentWaiter
|  Deleting    Web sst:aws:Nextjs → WebInvalidation sst:aws:DistributionInvalidation
Error: Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js: Error: Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js
    at Module._resolveFilename (node:internal/modules/cjs/loader:1143:15)
    at Module._load (node:internal/modules/cjs/loader:984:27)
    at Module.require (node:internal/modules/cjs/loader:1231:19)
    at require (node:internal/modules/helpers:179:18)
    at Object.<anonymous> (<anonymous>:72:22)
    at Module._compile (node:internal/modules/cjs/loader:1369:14)
    at requireFromString (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/require-from-string/index.js:28:4)
    at getProvider (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/cmd/dynamic-provider/index.ts:63:20)
    at Object.<anonymous> (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/cmd/dynamic-provider/index.ts:288:37)
    at Generator.next (<anonymous>)
|  Error       WebCdn sst:aws:CDN → WebCdnWaiter sst:aws:DistributionDeploymentWaiter Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js
Error: Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js: Error: Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js
    at Module._resolveFilename (node:internal/modules/cjs/loader:1143:15)
    at Module._load (node:internal/modules/cjs/loader:984:27)
    at Module.require (node:internal/modules/cjs/loader:1231:19)
    at require (node:internal/modules/helpers:179:18)
    at Object.<anonymous> (<anonymous>:75:22)
    at Module._compile (node:internal/modules/cjs/loader:1369:14)
    at requireFromString (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/require-from-string/index.js:28:4)
    at getProvider (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/cmd/dynamic-provider/index.ts:63:20)
    at Object.<anonymous> (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/cmd/dynamic-provider/index.ts:288:37)
    at Generator.next (<anonymous>)
|  Error       Web sst:aws:Nextjs → WebInvalidation sst:aws:DistributionInvalidation Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js
|  Deleting    WebImageOptimizer sst:aws:Function → WebImageOptimizerCodeUpdater sst:aws:FunctionCodeUpdater
Error: Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js: Error: Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js
    at Module._resolveFilename (node:internal/modules/cjs/loader:1143:15)
    at Module._load (node:internal/modules/cjs/loader:984:27)
    at Module.require (node:internal/modules/cjs/loader:1231:19)
    at require (node:internal/modules/helpers:179:18)
    at Object.<anonymous> (<anonymous>:86:22)
    at Module._compile (node:internal/modules/cjs/loader:1369:14)
    at requireFromString (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/require-from-string/index.js:28:4)
    at getProvider (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/cmd/dynamic-provider/index.ts:63:20)
    at Object.<anonymous> (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/cmd/dynamic-provider/index.ts:288:37)
    at Generator.next (<anonymous>)
|  Error       WebImageOptimizer sst:aws:Function → WebImageOptimizerCodeUpdater sst:aws:FunctionCodeUpdater Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js
|  Deleting    WebRevalidationEventsSubscriberRutnboFunction sst:aws:Function → WebRevalidationEventsSubscriberRutnboFunctionCodeUpdater sst:aws:FunctionCodeUpdater
Error: Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js: Error: Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js
    at Module._resolveFilename (node:internal/modules/cjs/loader:1143:15)
    at Module._load (node:internal/modules/cjs/loader:984:27)
    at Module.require (node:internal/modules/cjs/loader:1231:19)
    at require (node:internal/modules/helpers:179:18)
    at Object.<anonymous> (<anonymous>:86:22)
    at Module._compile (node:internal/modules/cjs/loader:1369:14)
    at requireFromString (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/require-from-string/index.js:28:4)
    at getProvider (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/cmd/dynamic-provider/index.ts:63:20)
    at Object.<anonymous> (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/cmd/dynamic-provider/index.ts:288:37)
    at Generator.next (<anonymous>)
|  Error       WebRevalidationEventsSubscriberRutnboFunction sst:aws:Function → WebRevalidationEventsSubscriberRutnboFunctionCodeUpdater sst:aws:FunctionCodeUpdater Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js
|  Deleting    WebRevalidationSeeder sst:aws:Function → WebRevalidationSeederCodeUpdater sst:aws:FunctionCodeUpdater
|  Deleting    WebDefault sst:aws:Function → WebDefaultCodeUpdater sst:aws:FunctionCodeUpdater
Error: Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js: Error: Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js
    at Module._resolveFilename (node:internal/modules/cjs/loader:1143:15)
    at Module._load (node:internal/modules/cjs/loader:984:27)
    at Module.require (node:internal/modules/cjs/loader:1231:19)
    at require (node:internal/modules/helpers:179:18)
    at Object.<anonymous> (<anonymous>:86:22)
    at Module._compile (node:internal/modules/cjs/loader:1369:14)
    at requireFromString (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/require-from-string/index.js:28:4)
    at getProvider (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/cmd/dynamic-provider/index.ts:63:20)
    at Object.<anonymous> (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/cmd/dynamic-provider/index.ts:288:37)
    at Generator.next (<anonymous>)
|  Error       WebRevalidationSeeder sst:aws:Function → WebRevalidationSeederCodeUpdater sst:aws:FunctionCodeUpdater Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js
Error: Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js: Error: Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js
    at Module._resolveFilename (node:internal/modules/cjs/loader:1143:15)
    at Module._load (node:internal/modules/cjs/loader:984:27)
    at Module.require (node:internal/modules/cjs/loader:1231:19)
    at require (node:internal/modules/helpers:179:18)
    at Object.<anonymous> (<anonymous>:86:22)
    at Module._compile (node:internal/modules/cjs/loader:1369:14)
    at requireFromString (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/require-from-string/index.js:28:4)
    at getProvider (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/cmd/dynamic-provider/index.ts:63:20)
    at Object.<anonymous> (/Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/cmd/dynamic-provider/index.ts:288:37)
    at Generator.next (<anonymous>)
|  Error       WebDefault sst:aws:Function → WebDefaultCodeUpdater sst:aws:FunctionCodeUpdater Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js

×  Failed
   WebCdn sst:aws:CDN → WebCdnWaiter sst:aws:DistributionDeploymentWaiter
   Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js
   Web sst:aws:Nextjs → WebInvalidation sst:aws:DistributionInvalidation
   Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js
   WebImageOptimizer sst:aws:Function → WebImageOptimizerCodeUpdater sst:aws:FunctionCodeUpdater
   Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js
   WebRevalidationEventsSubscriberRutnboFunction sst:aws:Function → WebRevalidationEventsSubscriberRutnboFunctionCodeUpdater sst:aws:FunctionCodeUpdater
   Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js
   WebRevalidationSeeder sst:aws:Function → WebRevalidationSeederCodeUpdater sst:aws:FunctionCodeUpdater
   Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js
   WebDefault sst:aws:Function → WebDefaultCodeUpdater sst:aws:FunctionCodeUpdater
   Cannot find module '@aws-sdk/middleware-retry/node_modules/@smithy/util-retry/dist-cjs/index.js'
Require stack:
- 
- /Users/ericschaefer/Projects/pretest/.sst/platform/node_modules/@pulumi/pulumi/cmd/dynamic-provider/index.js

[thdxr]

this is a result of dependencies not being where the serialized dynamic provider in state expects - this can happen because of package manager quirks and especially from the complexity of aws-sdk

right now i can't think of a way to fix this besides using sst state edit to delete the offending resources

doing that then running a remove should work

we're going to be moving away from aws-sdk for these dynamic providers since it's way too unreliable