search

astronomer / airflow-provider-great-expectations

Great Expectations Airflow operator
http://greatexpectations.io
Apache License 2.0
157 stars 53 forks source link

How to pass create_temp_table: False to SqlAlchemy? #112

Open kujaska opened 1 year ago

kujaska commented 1 year ago

When using great expectations with datasources from great_expectations.yml you can use 

  create_temp_table: False

setting for SqlAlchemyExecutionEngine to prevent SqlAlchemy from issuing SQLs like this:

CREATE OR REPLACE TEMPORARY TABLE gx_temp_d5435 AS select ...

Question: How to do the same if using airflow-provider-great-expectations with Airflow conn_id (which overrides datasources from great_expectations.yml)?

aaguilarguero commented 5 months ago

Hi, may I know where this is in the priority list. I ran across this issue on my end and it would be great to have this functionality. Thanks!

antelmoa commented 5 months ago

Hi again, I ended up giving this a try to add support for it. Would appreciate any eyes on this. TIA!

Lee-W commented 5 months ago

Sure! Sorry for the late reply. will take a look today