meltano / sdk

Write 70% less code by using the SDK to build custom extractors and loaders that adhere to the Singer standard: https://sdk.meltano.com
https://sdk.meltano.com
Apache License 2.0
94 stars 68 forks source link

feat: Support stream aliasing of `BATCH` messages via stream maps #2667

Closed ReubenFrankel closed 2 weeks ago

ReubenFrankel commented 2 weeks ago

Adds support for BATCH messages with __alias__ using stream maps - a small step towards #1117.


📚 Documentation preview 📚: https://meltano-sdk--2667.org.readthedocs.build/en/2667/

ReubenFrankel commented 2 weeks ago

Wasn't sure how/where to test this from the target side. Open to suggestions!

codspeed-hq[bot] commented 2 weeks ago

CodSpeed Performance Report

Merging #2667 will not alter performance

Comparing ReubenFrankel:feature/batch-stream-maps-alias (82290ba) with main (170f5bc)

Summary

✅ 6 untouched benchmarks

codecov[bot] commented 2 weeks ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 89.87%. Comparing base (170f5bc) to head (82290ba). Report is 1 commits behind head on main.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #2667 +/- ## ========================================== + Coverage 89.86% 89.87% +0.01% ========================================== Files 58 58 Lines 4885 4891 +6 Branches 960 963 +3 ========================================== + Hits 4390 4396 +6 Misses 344 344 Partials 151 151 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

edgarrmondragon commented 2 weeks ago

Wasn't sure how/where to test this from the target side. Open to suggestions!

I don't think there's anything we can base it off at the moment, but I'm happy to merge as is.

Thanks @ReubenFrankel!