meltano / sdk

Write 70% less code by using the SDK to build custom extractors and loaders that adhere to the Singer standard: https://sdk.meltano.com
https://sdk.meltano.com
Apache License 2.0
94 stars 68 forks source link

feat: port Meltano catalog manipulation conventions to SDK `config.json` #1383

Open kgpayne opened 1 year ago

kgpayne commented 1 year ago

Feature scope

Configuration (settings parsing, validation, etc.)

Description

In working on the SDK testing framework, it has become apparent that Meltanos' catalog manipulations (i.e. selection, metadata injection and schema overrides) would be very useful within the SDK config dictionary itself, so that tests can take advantage of these shorthands.

Use cases:

These things are possible by manually curating many catalog.json files, but this is labour intensive and repetitive work for Tap/Target developers.

stale[bot] commented 1 year ago

This has been marked as stale because it is unassigned, and has not had recent activity. It will be closed after 21 days if no further activity occurs. If this should never go stale, please add the evergreen label, or request that it be added.

edgarrmondragon commented 1 year ago

Still relevant

stale[bot] commented 1 month ago

This has been marked as stale because it is unassigned, and has not had recent activity. It will be closed after 21 days if no further activity occurs. If this should never go stale, please add the evergreen label, or request that it be added.