open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.51k stars 1.04k forks source link

Failure in Azure datalake ingestions (similar to Issue #9291) #9855

Closed pauloventurab closed 1 year ago

pauloventurab commented 1 year ago

Affected module Does it impact the UI, backend or Ingestion Framework? Ingestion Framework

Describe the bug A clear and concise description of what the bug is. Unable to ingest the Azure datalake metadata through UI. Similar to issue : https://github.com/open-metadata/OpenMetadata/issues/9291 But now on Azure.

To Reproduce

Screenshots or steps to reproduce Followed the steps: https://docs.open-metadata.org/connectors/database/datalake

Expected behavior A clear and concise description of what you expected to happen. Successful ingestion of the datalake to surface the metadata in OM.

Version:

OS: [e.g. iOS]: Python version: Python 3.7.15 OpenMetadata version: [e.g. 0.8] 0.13.1 OpenMetadata Ingestion package version: openmetadata/ingestion:0.13.1 Additional context Add any other context about the problem here.

Error in ingestion pipeline: [2023-01-23, 00:09:39 UTC] {es_mixin.py:101} WARNING - Elasticsearch search failed for query [/search/query?q=fullyQualifiedName:ssceu_sdbConsolidations.default.dft-fr-dev-file-sys."datafirst/Landing/Retail&_Media/LA_REDOUTE/LA_REDOUTE_ENTRANT_AGADIR/Year=2022/Month=11/Day=22/fr_webhelp_full_tde_forms-Workflow-FAQ-Volumineux_day_20221122.csv.gz"&from=0&size=10&index=table_search_index]: 500 Server Error: Internal Server Error for url: http://10.253.69.89:8585/api/v1/search/query?q=fullyQualifiedName:ssceu_sdb_Consolidations.default.dft-fr-dev-file-sys.%22datafirst/Landing/Retail_&_Media/LA_REDOUTE/LA_REDOUTE_ENTRANT_AGADIR/Year=2022/Month=11/Day=22/fr_webhelp_full_tde_forms-Workflow-FAQ-Volumineux_day_20221122.csv.gz%22&from=0&size=10&index=table_search_index

pauloventurab commented 1 year ago

When I try to access the URL I have this:

{"code":401,"message":"Not Authorized! Token not present"}

pauloventurab commented 1 year ago

Hello guys, it is fixed? Can I use my openmetadata 0.13.1 and it will be working properly?