-
### Describe the bug
As noted in https://github.com/singularity-energy/pudl/pull/3:
When running the `pudl.analysis.allocate_gen_fuel` pipeline for 2016 and 2017, we were getting a `TypeError` at `g…
-
A lot has changed since Data Prepper was initially introduced to the public in December 2020.
First, when Data Prepper launched there was no OpenSearch project. Shortly after the release of Data P…
-
This issue is about improving the pipeline to correctly flag websites that are down. More specifically, this issue is about making sure the ETL pipeline recognizes all the states that are already reco…
-
### Dagster version
1.4.17
### What's the issue?
LeaseLost error when writing outputs to Azure Blob Storage using Dagster Azure ADLS2 IO Manager.
During the execution of a Dagster pipeline, spec…
-
ETL pipeline has been down in staging since 4/12, but no staging alert has fired.
-
### Description
Currently, astronomer-cosmos provides an abstraction layer to map dbt objects to Airflow operators, allowing seamless integration between dbt and Airflow for orchestrating data pipeli…
-
Summarize Micro Frontends and their applications.
**References:**
> Micro Frontends - https://micro-frontends.org/
> GitHub Repository - https://github.com/teabyii/tractor-store-react
**Tasks:**
- R…
-
As our dags/utilizies are all python, we can integrate honeybadger reporting into the ETL pipeline.
-
We have lists with grants for certain translations. Depending on the data source this either contains also the amount or not. Anyway, this information should be mapped to RDF and added to our corpus s…
-
The current Rt and Dt calculations are hardcoded for Mumbai city.
Examples:
https://github.com/swb-ief/etl-pipeline/blob/dc9b590b63777d748013f79b34a1e9f071bcf4ff/R_scripts/Rt_calcs.R#L34
and …