apache / airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
https://airflow.apache.org/
Apache License 2.0
35.21k stars 13.76k forks source link

ElasticsearchSQLHook fails with AttributeError: __enter__ #40430

Open Pooort opened 3 days ago

Pooort commented 3 days ago

Apache Airflow Provider(s)

elasticsearch

Versions of Apache Airflow Providers

apache-airflow-providers-common-io==1.3.2 apache-airflow-providers-common-sql==1.14.0 apache-airflow-providers-elasticsearch==5.4.1 apache-airflow-providers-fab==1.1.1 apache-airflow-providers-ftp==3.9.1 apache-airflow-providers-http==4.11.1 apache-airflow-providers-imap==3.6.1 apache-airflow-providers-smtp==1.7.1 apache-airflow-providers-sqlite==3.8.1

Apache Airflow version

v2.9.2

Operating System

Debian GNU/Linux 12 (bookworm)

Deployment

Docker-Compose

Deployment details

No response

What happened

Documentation's usage example for ElasticsearchSQLHook:

    es = ElasticsearchSQLHook(elasticsearch_conn_id=CONN_ID)

    # Handle ES conn with context manager
    with es.get_conn() as es_conn:
        tables = es_conn.execute("SHOW TABLES")
        for table, *_ in tables:
            print(f"table: {table}")
    return True

fails with: AttributeError: __enter__

What you think should happen instead

No response

How to reproduce

Implement Documentation's usage example.

Anything else

No response

Are you willing to submit PR?

Code of Conduct

eladkal commented 2 days ago

Since you mentioned you deploy with MWAA, are you interacting with elasticsearch or with opensearch?

Pooort commented 2 days ago

Since you mentioned you deploy with MWAA, are you interacting with elasticsearch or with opensearch?

Sorry. Docker-Compose.

With Elasticsearch.

aritra24 commented 2 days ago

@Pooort a full stack trace and a ready to use dag for repro would help speed up a fix.

potiuk commented 2 days ago

Yes. Lack of stack trace makes it impossible to help you.