-
### Describe the bug
Data set creation and import stack is failing in cloudformation and is always getting rolled back from past few days. This issue started recently and there is no change in the da…
-
### Describe the bug
The tmp table in incremental strategy can't access the temp view created in pre_hooks.
### Steps To Reproduce
### Expected behavior
1) Create a model with incremental…
-
Good Morning
i am trying out following.
i have ingested some fake data into Hudi datalake and i am trying to figure out if there is way to convert smaller files which are already in HUDI into …
-
I'm using this library with both dependencies (aws-java-sdk-sqs and spark-aws-messaging jars) to write value to SQS from AWS glue (pyspark). However, I'm facing following error issue due to which it's…
-
### Is this a new bug in dbt-core?
- [X] I believe this is a new bug in dbt-core
- [X] I have searched the existing issues, and I could not find an existing issue for this bug
### Current Behavior
…
-
Hello
i made sample hudi MOR table using glue job
# Glue Job
```
"""
--conf spark.serializer=org.apache.spark.serializer.KryoSerializer --conf spark.sql.hive.convertMetastoreParquet=false --c…
-
**Describe the bug**
I setup a glue table as per https://docs.aws.amazon.com/athena/latest/ug/connectors-dynamodb.html and used a crawler to generate the schema.
This table had ~ 50 columns so I the…
-
```
import sys
from awsglue.transforms import *
from awsglue.utils import getResolvedOptions
from pyspark.sql.session import SparkSession
from pyspark.context import SparkContext
from awsglue.co…
-
### Describe the issue
start_data_quality_ruleset_evaluation_run in glue provide runID and as there is no field in start_data_quality_ruleset_evaluation_run for jobName the job doesn't get executed a…
-
Hello i am trying to rollback to previous commit to see how the functionality works
### Steps
#### Step1 I inserted some sample dataset and took save points
#### Step 2 : i tried rollback it t…