search

datahub-project / datahub

The Metadata Platform for your Data and AI Stack
https://datahubproject.io
Apache License 2.0
9.92k stars 2.94k forks source link

(Frontend) Unable to add lineage to dataset in web UI #11713

Open peamboon opened 3 weeks ago

peamboon commented 3 weeks ago

Describe the bug Unable to add lineage to dataset in web UI

Datahub v0.14.1

To Reproduce Steps to reproduce the behavior:

  1. Go to Datahub frontend web UI
  2. Go to a dataset (in my case the dataplatform is SQL server)
  3. Click on 'Lineage' at the top right to visualize lineage image
  4. Click on Three dots on the dataset wanted to add lineage image
  5. Click on 'Edit Upstream'
  6. Fill in the Manage upstream lineage dataset then 'Save Changes'
  7. "Updated lineage!" will pop up.
  8. Everything looks fine here. Upstream lineage and Upstream dataset is visualized.
  9. Refresh the page
  10. The recently added lineage not shown.

Expected behavior

  1. number of upstream should be added. image
  2. The recently added lineage should be visualized after refresh the page. image

Desktop (please complete the following information):

Additional context Add any other context about the problem here.

jjoyce0510 commented 1 week ago

Hi there - this appears to me to be an issue with your search index / search service.

Either it is:

  1. Slow - It may take some time for the change to propagate through the system. Increasing memory and CPU for elasticsearch and datahub-gms should help here.

2, Dropping writes - If writes to elastcisearch are failing, you'll see this in the logs of datahub-gms container. Please check to make sure there are no issues there!