Part of trying to identify and build momentum behind a particular ETL framework within DLSS that also allows for use within other data engineering requests (can run over Spark; can support non-developer, configuration based transforms; has a data model validation step; can take streaming data input)
Part of trying to identify and build momentum behind a particular ETL framework within DLSS that also allows for use within other data engineering requests (can run over Spark; can support non-developer, configuration based transforms; has a data model validation step; can take streaming data input)
Traject+: https://github.com/sul-dlss/dlme/tree/master/lib/traject
DPLA Ingestion 3: https://github.com/dpla/ingestion3