test-app-organization / test-repo-app

MIT License
0 stars 0 forks source link

[SUPPORT] Issue with duplicated records when using insert overwrite #95

Open Sheth-G opened 1 month ago

Sheth-G commented 1 month ago

Tips before filing an issue

Describe the problem you faced

I am facing an issue where duplicated records are being generated when using insert overwrite. There are multiple commit times existing in the Hudi table, and the target table also ends up with duplicate records. This query involves joining around 10 tables.

To Reproduce

Steps to reproduce the behavior:

1. 2. 3. 4.

Expected behavior

A clear and concise description of what you expected to happen.

Environment Description

Additional context

Add any other context about the problem here.

Stacktrace

Add the stacktrace of the error.