-
Hi there.
First of all, thanks for the super useful action templates. I have close to zero programming skills (UX designer here) and I managed to get it up and running. This is also my first Github…
-
I'm having an exactly same issue as this user - https://www.reddit.com/r/dataengineering/comments/lri9fv/airflow_dag_is_skipping_a_day/
**Apache Airflow version**: 2.0.1
**Environment**:
- **…
-
Thanks very much in advance for your time helping debug this!
### Terraform Version
```
terraform -v
Terraform v0.13.5
+ provider registry.terraform.io/databrickslabs/databricks v0.3.1
+ prov…
-
AWS provides this great built in async worker mechanism, and there's a lot of potentials to save cost. Without this, we have to maintain running-all-day servers or at least managed EKS, and not to men…
-
I came across this post on LinkedIn: https://www.linkedin.com/posts/eczachly_dataengineering-activity-6775447325725769728-EhK3 advocating to always use `COUNT(1)` vs `COUNT(*)`.
My personal opinion…
-
UPDATE: Jump to https://github.com/iterative/dvc.org/issues/1934#issuecomment-725444300
Hi, I am currently evaluating DVC for usage in my project.
We are working with Microsoft Azure Storage Blob …
-
Hello I am following this guide https://aws-dataengineering-day.workshop.aws/en/400/420-pre-lab-2.html.Prelab setup 1 was done successfully but in Prelab setup 2 I have next [problems:]
![picture](ht…
-
Executing below piece of code
```xml
```
Throwing the below error
NBi.NUnit.Runtime.TestSuite.My first test:
Exception during the setup of the test:
```
f…
-
```sh
Collecting pyobjc-core==6.1
Downloading https://artifactory.us-east-1.bamgrid.net/api/pypi/dataengineering-pypi/packages/packages/3a/80/0cdb2130b86a984e4765beb93135aa9c2120fd64be1a27e1c7cb…
-
Parquet schema changing for various writes to Hudi.
With the continuous writes to S3 in Hudi format, there are instance the schema of Paruet file is changing and when writing/upserting to same part…