Closed ingalls closed 1 year ago
The ADSB data reached the limit of how large of a payload can be pushed via the lambda Environment options. As the list isn't getting any smaller, I've migrated the ETL script to instead pull environment data as-needed directly from the API.
I've also refactored all common ETL setup/calls into a base library for even easier development - https://github.com/tak-ps/etl-base
Context
The ADSB data reached the limit of how large of a payload can be pushed via the lambda Environment options. As the list isn't getting any smaller, I've migrated the ETL script to instead pull environment data as-needed directly from the API.
I've also refactored all common ETL setup/calls into a base library for even easier development - https://github.com/tak-ps/etl-base