-
The Microsoft Service Fabric platform (a full system from microsoft to develop & run microservices) uses the Microsoft ETW subsystem to manage both Infrastructure and Application Logging, in order to …
-
### Background / motivation
This is an epic to mature our pipeline for data going into the data `lake/`, and for consuming it in `analytics/`. By the end, the lake, etl, and analytics should only fet…
-
### Title
Build an ETL pipeline in airflow
### Describe your Talk
In this talk I’ll be giving a walk through on how to make a basic ETL pipeline using airflow
[Apache Airflow](https://airf…
-
To prioritize current projects needing Project Evaluations, we would like to add the `Pipeline` field from the [ATD Data Tech Services Issues](https://datahub.austintexas.gov/Transportation-and-Mobili…
-
In the spirit of [ETL](https://en.wikipedia.org/wiki/Extract,_transform,_load), it would be beneficial for downstream applications of `edgartools` to be able to discretize company filings persistence …
-
The current functionality of the FHIR gateway only allows the mutation of the query parameters. We have the requirement to modify the request content for de-identification purposes.
Specific Scenar…
-
### Describe the issue
Notifications and Trigger properties for Pipelines (Delta Live Table) are ignored
### Configuration
```
bundle:
name: etl_bundle
workspace:
host: https://dbc-xxx.…
-
## Description
Is your feature request related to a problem? A clear and concise description of what the problem is: "I'm always frustrated when ..."
Since Airflow 2.0, a simpler TaskFlowAPI for D…
-
Suppose you had a room full of data scientists for a day. What would you teach them about systems administration, package management, dev ops, and everything else they need to know to get from "works …
-
XML configuration files for districts need to be parsed into structured parquet files for load to the data warehouse. Dependent on #75