When sending back data back to the Gate, we saw success in the sharing state, but no output stage was generated. We found the root cause, shown in the screenshot below. This issue happens when we get the same external IDs with different tenant values.
Props to @dilipdhankecha2530 for finding this issue!
Expected Behavior
Even though there is already an output stage for the given external ID, a new output stage is generated in case the tenant value is different.
Steps To Reproduce
Process a new dataset with external ID = A and tenant value = null
Wait for the dataset to create an output stage
Process a new dataset with the same external ID = A and tenant value != null
There is no separate output stage created for the second dataset
Current Behavior
When sending back data back to the Gate, we saw success in the sharing state, but no output stage was generated. We found the root cause, shown in the screenshot below. This issue happens when we get the same external IDs with different tenant values.
Props to @dilipdhankecha2530 for finding this issue!
Expected Behavior
Even though there is already an output stage for the given external ID, a new output stage is generated in case the tenant value is different.
Steps To Reproduce