search

open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.51k stars 1.04k forks source link

Athena query usage ingestion is not working as expected #16367

Closed vithushanms closed 5 months ago

vithushanms commented 5 months ago

Affected module Query usage ingestion

Describe the bug Although the query log duration is set to 100 and ingestion became successful, I couldn't able to see the queries used within last 100 days in the asssets.

image image

To Reproduce

  1. Add any athena connection
  2. Run queries in the source
  3. Ingest after 1 day, specifying the query log duration set to the number of days which covers that time window
image

Expected behavior I should see the executed queries in the assets within the specified timeframe

Version:

ulixius9 commented 5 months ago

@vithushanms this is not reproducible for me, hence closing this issue you can reach out to us on slack: https://slack.open-metadata.org/ on support channel

I would need more information related to this to understand the root cause, need to check the logs

image

closing this issue for now, we can reopen if we found anything over slack