open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.67k stars 1.06k forks source link

Add validation in ingestion pipeline json schema to not include whitespace #13190

Closed OnkarVO7 closed 11 months ago

OnkarVO7 commented 1 year ago

Describe the bug Below error gets generated when we have a whitespace in the ingestion pipeline name. The logs do not get displayed.

image

We'll add validation in ingestion pipeline json schema to not include whitespace chars.

pmbrull commented 11 months ago

let's fix this by validating how we can clean the API call retrieving the logs

chirag-madlani commented 11 months ago

@pmbrull should we restrict space in the ingestion name to fix this?

pmbrull commented 11 months ago

hi we should allow spaces here. I'll fix the API to get this working, thanks!

Tested in Collate and it's fine there, so the issue is Airflow-specific.