search

P3-Core-Dev-Team / P3-Q-A

This repo is for tracking features
Other
0 stars 0 forks source link

Partitioning not working #23

Closed suseela22 closed 3 months ago

suseela22 commented 8 months ago

Ingestion is getting failed after one set is completed

image

sowndaryameiyazhagan commented 8 months ago

BE pr link: https://github.com/P3-Core-Dev-Team/ADS_BE/pull/1944

sowndaryameiyazhagan commented 7 months ago

RCA : the bucketing /partitioning option will disabled once ingestion done

Image Image

Udhayanila8 commented 7 months ago

Once the ingestion done. partition and bucketing was disabled.

Image

ClementJosh21 commented 5 months ago

@kilam005 The fix available in version 2024.01.x version.

Now we can change partition even after ingestion and also will ingest multiple sets without any error even if partition(s) is applied

@Udhayanila8 Can you re-check this once and attach the valid screenshot here?

Udhayanila8 commented 5 months ago

The application has already been ingested, now apply the partition.

image image image image

Again trigger ingestion image image another ingestion was also completed. image

kilam005 commented 3 months ago

@ClementJosh21 please provide RCA and fix info for this

sowndaryameiyazhagan commented 3 months ago

RCA when doing second ingestion for the same partitioned table it tries to recreate the partition , so that it throws 'already exists exception'

Fis details if already exist means skip the creation of partitioning, and also provided re-partitioning feature to change partitioning and bucketing after ingestion

suseela22 commented 3 months ago

Working as expected