w-fsi
commented
1 year ago Can you please provide the manifest of the affected products, so we can check the original data?
Closed SYTHIER-ADS closed 1 year ago
w-fsi
commented
1 year ago Can you please provide the manifest of the affected products, so we can check the original data?
LAQU156
commented
1 year ago IVV_CCB_2023_w25 : Moved into "Accepted Werum" for analysis, Priority blocking, to be fixed phase 1. @Woljtek Please provide the manifest of the affected products
Woljtek
commented
1 year ago @w-fsi Here below the manifest:
s3cmd get s3://ops-rs-pug/S3B_SL_1_RBT____20230427T222346_20230427T222646_20230603T202503_0179_079_001_1440_LN3_O_NR_004.SEN3/xfdumanifest.xmlWerum_CCB_2023_w25 : @Woljtek please check if PDGS produces this products. Stays into "New Issues" until more analysis on this topic.
Woljtek
commented
1 year ago @w-fsi I checked on OMCS, there is a product relative to the datatake and the acquisition on the PRIP:
This behavior is a valid issue on RS.
May you ask the LTA to retrieve the product and compare with the RS version ?
w-fsi
commented
1 year ago @Woljtek : We are not having access to OMCS. Can you download it for us and just provide the manifest file of it. The actual payload is not interesting for us. SCIHUB might purged the product already.
LAQU156
commented
1 year ago Werum_CCB_2023_w26 : Stays into "New issues" until new imputs @Woljtek
Woljtek
commented
1 year ago Unfortunately, we are not able to download the data from S3-PDGS.
LAQU156
commented
1 year ago Werum_CCB_2023_w27 : Moved into "Sprint Backlog". Werum will catch the exception in order to avoid a block of the workflow and add a warning message, for V1.14.0-rc1 or rc2.
Woljtek
commented
1 year ago New occurences with OLCI production:
S3A_OL_2_LRR____20230715T221025_20230715T225445_20230716T161151_2660_101_115______LN3_O_NR_002.SEN3
S3A_OL_2_LRR____20230715T221025_20230715T225445_20230716T161151_2660_101_115______LN3_O_NR_002.SEN3
S3A_OL_2_LRR____20230715T221025_20230715T225445_20230716T161151_2660_101_115______LN3_O_NR_002.SEN3
S3A_OL_1_ERR____20230715T221025_20230715T225445_20230716T134852_2660_101_115______LN3_O_NR_002.SEN3
S3A_OL_1_ERR____20230715T221025_20230715T225445_20230716T134852_2660_101_115______LN3_O_NR_002.SEN3
S3A_OL_1_ERR____20230715T221025_20230715T225445_20230716T134852_2660_101_115______LN3_O_NR_002.SEN3
S3A_OL_2_LFR____20230715T221413_20230715T221713_20230716T122003_0180_101_115_1440_LN3_O_NR_002.SEN3
S3A_OL_2_LFR____20230715T221413_20230715T221713_20230716T122003_0180_101_115_1440_LN3_O_NR_002.SEN3
S3A_OL_2_LFR____20230715T221413_20230715T221713_20230716T122003_0180_101_115_1440_LN3_O_NR_002.SEN3
S3A_OL_1_EFR____20230715T221413_20230715T221713_20230716T115416_0180_101_115_1440_LN3_O_NR_002.SEN3
S3A_OL_1_EFR____20230715T221413_20230715T221713_20230716T115416_0180_101_115_1440_LN3_O_NR_002.SEN3
S3A_OL_1_EFR____20230715T221413_20230715T221713_20230716T115416_0180_101_115_1440_LN3_O_NR_002.SEN3
vgava-ads
commented
1 year ago Delivered in Production Common v1.14.0 (refer to https://github.com/COPRS/production-common/releases)
pcuq-ads
commented
1 year ago System_CCB_2023-w30 : Wait for deployment for both RS core Metadata Extraction and Metadata Search Control version 1.14.0.
pcuq-ads
commented
1 year ago @w-fsi We deploy version 1.14-RC1 for both "RS core metadata" and "Search Controller Service" on the 20/07. And we still have this issue during last week-end (23-25/07). Here are some logs.
https://app.zenhub.com/files/398313496/f8490ca2-94df-410e-9da9-d8fbf5b8eb7f/download
The issue is still opened.
suberti-ads
commented
1 year ago Error seen this week
Metadata extraction failed: java.lang.RuntimeException: Error: Number of retries has exceeded while performing Create metadata {"STC":false,"coastalPercentage":0.092292,"procName":"IPF-SY-2","absoluteStopOrbit":26069,"openOceanPercentage":"","snowOrIcePercentage":0.618438,"cloudPercentage":0.288099,"productName":"S3B_SY_2_VGP____20230428T000321_20230428T004740_20230722T174259_2659_079_002______LN3_D_NT_002.SEN3","absoluteStartOrbit":26069,"NRT":false,"procVersion":"06.23","processingLevel":2,"platformShortName":"Sentinel-3","continentalIcePercentage":"","productClass":"SY","landPercentage":24.763346,"t0PdgsDate":"2023-04-28T03:32:38.000000Z","operationalMode":"Earth Observation","s3timeliness":"NT","instrumentName":"SYNERGY","freshInlandWaterPercentage":0.382093,"timeliness":"NTC","validityStartTime":"2023-04-28T00:03:20.832685Z","generatingCentre":"LN3","NTC":true,"processMode":"NOMINAL","productFamily":"S3_L2_NTC","creationTime":"2023-07-22T17:42:59.000000Z","sliceCoordinates":{"orientation":"counterclockwise","coordinates":[[[-30.9501,80.8968],[-31.076,81.9171],[-31.422,82.9365],[-31.6543,83.9563],[-32.0329,84.9756],[-32.525,85.9948],[-33.2502,87.0138],[-34.5737,88.0321],[-38.4211,89.0478],[-153.575,89.8598],[154.632,88.8994],[151.502,87.8831],[150.306,86.8645],[149.639,85.8453],[149.171,84.826],[148.803,83.8067],[148.498,82.7872],[148.235,81.7674],[147.997,80.7476],[147.776,79.7275],[147.569,78.7076],[147.371,77.6875],[147.18,76.6672],[146.995,75.6468],[146.816,74.6262],[146.64,73.6055],[146.466,72.5847],[146.296,71.5637],[146.128,70.5419],[145.961,69.5208],[145.79,68.5003],[145.627,67.4785],[145.5,66.455],[145.351,65.4319],[145.164,64.4104],[145.011,63.3877],[144.848,62.3649],[144.683,61.342],[144.52,60.3189],[144.329,59.2966],[144.168,58.2729],[144.007,57.249],[143.845,56.2248],[143.684,55.2004],[143.522,54.1758],[143.36,53.151],[143.197,52.1259],[143.04,51.1002],[142.873,50.0748],[142.716,49.0485],[142.544,48.0228],[142.384,46.9962],[142.214,45.97],[142.049,44.9431],[141.886,43.9156],[141.716,42.8886],[141.548,41.8611],[141.38,40.8333],[141.216,39.8047],[141.041,38.777],[140.875,37.7481],[140.7,36.7198],[140.527,35.691],[140.354,34.662],[140.179,33.6327],[140.004,32.6031],[139.828,31.5733],[139.651,30.5436],[139.472,29.5137],[139.293,28.4837],[139.112,27.4532],[138.931,26.4225],[138.748,25.3922],[138.563,24.3617],[138.377,23.3309],[138.19,22.3002],[138.001,21.2695],[137.812,20.2382],[137.621,19.2068],[137.428,18.1756],[137.233,17.1447],[137.037,16.1138],[136.839,15.0825],[136.639,14.0516],[136.438,13.0201],[136.234,11.989],[136.028,10.9587],[135.82,9.92901],[135.61,8.89813],[135.399,7.86677],[135.185,6.8358],[134.969,5.80579],[134.75,4.77605],[134.529,3.74638],[134.305,2.71677],[134.079,1.68731],[133.85,0.658364],[133.617,-0.370257],[133.398,-1.40228],[133.144,-2.42682],[132.904,-3.45467],[132.659,-4.48161],[132.411,-5.50828],[132.159,-6.53468],[131.905,-7.56046],[131.646,-8.58589],[131.383,-9.61041],[131.117,-10.6347],[130.846,-11.6585],[130.57,-12.6813],[130.291,-13.7035],[130.006,-14.7249],[129.718,-15.7462],[129.423,-16.7659],[129.126,-17.7859],[128.821,-18.8041],[128.509,-19.8214],[128.191,-20.8375],[127.868,-21.853],[127.537,-22.8671],[127.201,-23.8804],[126.856,-24.892],[126.503,-25.9026],[126.142,-26.9115],[125.774,-27.9196],[125.395,-28.9257],[125.007,-29.9301],[124.611,-30.9334],[124.205,-31.9348],[123.788,-32.9348],[123.358,-33.932],[122.919,-34.9281],[122.467,-35.922],[122.003,-36.9142],[121.525,-37.9041],[121.032,-38.8906],[120.523,-39.8739],[119.999,-40.8559],[119.459,-41.8359],[118.9,-42.8123],[118.322,-43.7849],[117.723,-44.7537],[117.103,-45.7192],[116.46,-46.681],[115.793,-47.6389],[115.1,-48.5921],[114.379,-49.5404],[113.628,-50.4839],[112.847,-51.4222],[112.032,-52.3545],[111.18,-53.2806],[110.29,-54.1997],[110.206,-54.2843],[112.067,-54.8924],[113.671,-55.3796],[115.076,-55.7794],[116.158,-56.072],[117.317,-56.3694],[118.397,-56.6299],[119.405,-56.864],[120.212,-57.0518],[121.141,-57.2498],[122.046,-57.4341],[122.928,-57.6058],[123.687,-57.746],[124.57,-57.9036],[125.464,-58.0555],[126.232,-58.178],[127.168,-58.3224],[128.151,-58.4656],[129.188,-58.6047],[129.722,-58.6741],[130.184,-57.661],[130.628,-56.6442],[131.054,-55.6262],[131.464,-54.6071],[131.859,-53.587],[132.24,-52.5661],[132.61,-51.5443],[132.967,-50.5214],[133.314,-49.4978],[133.652,-48.4736],[133.981,-47.4488],[134.301,-46.4231],[134.613,-45.3967],[134.918,-44.3693],[135.217,-43.3416],[135.51,-42.3138],[135.797,-41.2852],[136.079,-40.2558],[136.355,-39.2257],[136.627,-38.1954],[136.895,-37.1645],[137.159,-36.1333],[137.419,-35.1014],[137.675,-34.0692],[137.929,-33.0365],[138.179,-32.0033],[138.426,-30.9697],[138.672,-29.9359],[138.915,-28.9017],[139.156,-27.867],[139.395,-26.8321],[139.631,-25.7967],[139.866,-24.7611],[140.1,-23.7251],[140.331,-22.6889],[140.562,-21.6522],[140.792,-20.6155],[141.021,-19.5785],[141.249,-18.5413],[141.476,-17.5038],[141.703,-16.4661],[141.928,-15.4282],[142.153,-14.39],[142.378,-13.3516],[142.603,-12.3131],[142.828,-11.2747],[143.053,-10.236],[143.277,-9.19719],[143.502,-8.1582],[143.726,-7.11891],[143.939,-6.07713],[144.169,-5.03908],[144.405,-4.00179],[144.632,-2.96263],[144.86,-1.92348],[145.088,-0.884323],[145.318,0.154899],[145.548,1.19401],[145.78,2.23297],[146.013,3.27184],[146.247,4.31052],[146.483,5.34942],[146.72,6.38835],[146.959,7.42693],[147.2,8.46473],[147.443,9.50245],[147.688,10.5403],[147.935,11.5781],[148.185,12.6155],[148.436,13.6526],[148.691,14.6892],[148.948,15.7255],[149.208,16.7616],[149.471,17.7975],[149.738,18.833],[150.008,19.8678],[150.281,20.9022],[150.559,21.9361],[150.84,22.9692],[151.126,24.0019],[151.416,25.0346],[151.711,26.0668],[152.012,27.0977],[152.317,28.1281],[152.628,29.1578],[152.945,30.1868],[153.268,31.2151],[153.598,32.2426],[153.935,33.2692],[154.279,34.2949],[154.631,35.3196],[154.992,36.3433],[155.361,37.366],[155.739,38.3876],[156.128,39.408],[156.527,40.427],[156.938,41.4448],[157.36,42.4612],[157.795,43.4761],[158.244,44.4894],[158.707,45.501],[159.186,46.5109],[159.682,47.5189],[160.195,48.5248],[160.728,49.5285],[161.281,50.5299],[161.857,51.5288],[162.456,52.525],[163.082,53.5183],[163.735,54.5085],[164.419,55.4954],[165.135,56.4786],[165.887,57.4577],[166.678,58.4325],[167.512,59.4026],[168.392,60.3676],[169.32,61.3272],[170.298,62.2821],[171.353,63.2265],[172.47,64.1649],[173.661,65.0945],[174.927,66.0161],[176.295,66.9246],[177.754,67.8242],[179.335,68.7079],[-178.958,69.5762],[-177.116,70.4287],[-175.12,71.2619],[-172.952,72.0729],[-170.592,72.8587],[-168.022,73.6157],[-165.22,74.3399],[-162.165,75.0265],[-158.837,75.6699],[-155.22,76.2642],[-151.303,76.8025],[-147.083,77.2779],[-142.568,77.6836],[-137.782,78.0124],[-132.769,78.257],[-127.588,78.4127],[-122.309,78.4758],[-117.016,78.445],[-111.792,78.3208],[-106.714,78.1061],[-101.846,77.8058],[-97.2347,77.426],[-92.9111,76.9738],[-88.8861,76.4572],[-85.1691,75.8802],[-81.7286,75.2582],[-81.4207,75.1952],[-80.0286,75.6296],[-78.6062,76.0406],[-77.1652,76.4263],[-75.9314,76.7371],[-74.4163,77.089],[-72.825,77.4305],[-71.1508,77.7613],[-69.6333,78.04],[-67.7275,78.36],[-65.6418,78.6779],[-63.3536,78.9915],[-61.1822,79.2531],[-58.3122,79.5651],[-54.9989,79.8737],[-51.7353,80.1317],[-47.2373,80.4161],[-41.7373,80.6681],[-34.9137,80.8512],[-30.9501,80.8968]]],"type":"Polygon"},"insertionTime":"2023-07-23T01:39:27.377478Z","stopOrbitDirection":"","procTime":"2023-07-22T15:59:23.592276Z","validityStopTime":"2023-04-28T00:47:40.220436Z","classId":"D_NT_002","brightPercentage":"","instanceId":"2659_079_002_____","closedSeaPercentage":"","tidalRegionPercentage":1.0738,"utcTime":"","relativeStopOrbit":2,"relativeStartOrbit":2,"startTime":"2023-04-28T00:03:20.832685Z","stopTime":"2023-04-28T00:47:40.220436Z","dumpStart":"2023-04-28T00:00:05.899995Z","granuleNumber":1,"productType":"SY_2_VGP___","qualityIndicator":"PASSED","missionId":"S3","satelliteId":"B","granulePosition":"FIRST","url":"S3B_SY_2_VGP____20230428T000321_20230428T004740_20230722T174259_2659_079_002______LN3_D_NT_002.SEN3","platformSerialIdentifier":"B","baselineCollection":"002","receivingGroundStation":"CGS","site":"Toulouse","utc1Time":"","orbitDirection":"ascending","cycleNumber":79,"salineWaterPercentage":75.226567} after 2 attempts: ElasticsearchStatusException[Elasticsearch exception [type=mapper_parsing_exception, reason=failed to parse field [utcTime] of type [date] in document with id 'S3B_SY_2_VGP____20230428T000321_20230428T004740_20230722T174259_2659_079_002______LN3_D_NT_002.SEN3'. Preview of field's value: '']]; nested: ElasticsearchException[Elasticsearch exception [type=illegal_argument_exception, reason=cannot parse empty date]];
[...]seems to refer to this issue: https://github.com/COPRS/rs-issues/issues/1027 No new occurrence.
pcuq-ads
commented
1 year ago Wrong analysis. My mistake.
pcuq-ads
commented
1 year ago System_CCB_2023-w30 : This issue is fixed with the release production common 1.14.
suberti-ads
commented
1 year ago Wrong analysis. My mistake.
No the mistake in on my side ... Sorry This week there were 3 ERRORS on catalog side
S3A_OL_1_EFR____20230715T221413_20230715T221713_20230725T090810_0179_101_115_1440_LN3_O_NT_002.SEN3
S3A_OL_1_EFR____20230715T221413_20230715T221713_20230725T090810_0179_101_115_1440_LN3_O_NT_002.SEN3
S3A_OL_1_EFR____20230715T221413_20230715T221713_20230725T090810_0179_101_115_1440_LN3_O_NT_002.SEN3
S3A_OL_2_LRR____20230427T212034_20230427T220452_20230724T221510_2658_098_143______LN3_O_NR_002.SEN3
S3A_OL_2_LRR____20230427T212034_20230427T220452_20230724T221510_2658_098_143______LN3_O_NR_002.SEN3
S3A_OL_2_LRR____20230427T212034_20230427T220452_20230724T221510_2658_098_143______LN3_O_NR_002.SEN3
S3A_OL_1_ERR____20230427T212034_20230427T220452_20230724T214656_2658_098_143______LN3_O_NR_002.SEN3
S3A_OL_1_ERR____20230427T212034_20230427T220452_20230724T214656_2658_098_143______LN3_O_NR_002.SEN3
S3A_OL_1_ERR____20230427T212034_20230427T220452_20230724T214656_2658_098_143______LN3_O_NR_002.SEN3
S3B_OL_1_ERR____20230722T215033_20230722T223451_20230724T182451_2658_082_072______LN3_O_NR_002.SEN3
S3B_OL_1_ERR____20230722T215033_20230722T223451_20230724T182451_2658_082_072______LN3_O_NR_002.SEN3
S3B_OL_1_ERR____20230722T215033_20230722T223451_20230724T182451_2658_082_072______LN3_O_NR_002.SEN3Hereafter error:
Metadata extraction failed: java.lang.RuntimeException: Error: Number of retries has exceeded while performing Create metadata {"STC":false,"coastalPercentage":0.0,"procName":"PUG","absoluteStopOrbit":38588,"openOceanPercentage":"","snowOrIcePercentage":"","cloudPercentage":"","productName":"S3A_OL_1_EFR____20230715T221413_20230715T221713_20230725T090810_0179_101_115_1440_LN3_O_NT_002.SEN3","absoluteStartOrbit":38588,"NRT":false,"procVersion":"03.48","processingLevel":1,"platformShortName":"Sentinel-3","continentalIcePercentage":"","productClass":"OL","landPercentage":"","t0PdgsDate":"2023-07-15T23:58:09.000000Z","operationalMode":"Earth Observation","s3timeliness":"NT","instrumentName":"OLCI","freshInlandWaterPercentage":0.0,"timeliness":"NRT","validityStartTime":"2023-07-15T22:14:12.962480Z","generatingCentre":"LN3","NTC":true,"processMode":"NOMINAL","productFamily":"S3_PUG","creationTime":"2023-07-25T09:08:10.000000Z","sliceCoordinates":{"orientation":"counterclockwise","coordinates":[[[173.757,83.7832],[179.454,83.7575],[-174.948,83.6728],[-169.525,83.5293],[-164.413,83.3327],[-159.602,83.0852],[-155.153,82.7932],[-151.09,82.464],[-147.363,82.0972],[-143.984,81.7013],[-140.898,81.2821],[-138.128,80.8387],[-135.598,80.3767],[-133.321,79.8952],[-131.245,79.4017],[-129.368,78.895],[-127.634,78.379],[-126.049,77.8515],[-124.597,77.3167],[-123.267,76.7748],[-111.93,77.8273],[-99.0252,78.3586],[-85.6215,78.2898],[-72.9895,77.6336],[-71.943,78.2148],[-70.8065,78.7881],[-69.5413,79.3603],[-68.1486,79.9263],[-66.5698,80.4826],[-64.8102,81.033],[-62.8122,81.5741],[-60.5678,82.1055],[-57.9955,82.6204],[-55.0616,83.1222],[-51.6594,83.6006],[-47.716,84.0541],[-43.1898,84.4738],[-37.9264,84.8548],[-31.8798,85.1861],[-25.0707,85.4553],[-17.4721,85.6544],[-9.33636,85.7706],[-0.95005,85.7964],[2.27663,88.397],[166.818,88.9761],[173.068,86.3795],[173.757,83.7832]]],"type":"Polygon"},"insertionTime":"2023-07-25T09:09:42.051506Z","stopOrbitDirection":"","procTime":"2023-07-25T09:08:35.000000","validityStopTime":"2023-07-15T22:17:12.962480Z","classId":"O_NT_002","brightPercentage":90.0,"instanceId":"0179_101_115_1440","closedSeaPercentage":"","tidalRegionPercentage":0.0,"utcTime":"2023-07-15T21:50:12.962480Z","relativeStopOrbit":115,"relativeStartOrbit":115,"startTime":"2023-07-15T22:14:12.962480Z","stopTime":"2023-07-15T22:17:12.962480Z","dumpStart":"2023-07-15T22:10:23.028972Z","granuleNumber":1,"productType":"OL_1_EFR___","qualityIndicator":"PASSED","missionId":"S3","satelliteId":"A","granulePosition":"FIRST","url":"S3A_OL_1_EFR____20230715T221413_20230715T221713_20230725T090810_0179_101_115_1440_LN3_O_NT_002.SEN3","platformSerialIdentifier":"A","baselineCollection":"002","receivingGroundStation":"CGS","site":"Toulouse","utc1Time":"2023-07-15T23:31:12.114159Z","orbitDirection":"ascending","cycleNumber":101,"salineWaterPercentage":86.0} after 2 attempts: ElasticsearchStatusException[Elasticsearch exception [type=mapper_parsing_exception, reason=failed to parse]]; nested: ElasticsearchException[Elasticsearch exception [type=topology_exception, reason=found non-noded intersection between LINESTRING ( 180.0 87.10153486818466, 2.27663 88.397 ) and LINESTRING ( 166.818 88.9761, 173.068 86.3795 ) [ (171.1752350853062, 87.16586054039902, NaN) ]]];@w-fsi Could you confirm above error was relative to this issue ?
pcuq-ads
commented
1 year ago The fix has failed. Moved back to column new.
pcuq-ads
commented
1 year ago System_CCB_2023-w30 : a fix will be provided by WERUM and ADS will check the fix with a specific catalog-job.
w-fsi
commented
1 year ago @Woljtek : Okay, new version had been build. Can you please give it a try if it is fixing this issue?
Woljtek
commented
1 year ago I republish the following message: PRODUCT=S3B_OL_1_ERR__20230722T215033_20230722T223451_20230724T182451_2658_082_072____LN3_O_NR_002.SEN3:
{"uid":"a24a162b-0594-4940-b086-773afe439211","creationDate":"2023-07-24T18:26:46.788Z","rsChainVersion":"1.13.2-rc1","missionId":"S3","satelliteId":"","keyObjectStorage":"S3B_OL_1_ERR____20230722T215033_20230722T223451_20230724T182451_2658_082_072______LN3_O_NR_002.SEN3","storagePath":"NOT_DEFINED","productFamily":"S3_PUG","podName":"s3-pug-nrt-part1-execution-worker-v34-69d6b8f85c-l6t9g","allowedActions":["RESUBMIT"],"retryCounter":0,"additionalFields":{"t0PdgsDate":"2023-07-22T23:38:12.000000Z"},"metadata":{"mode":"NOMINAL","productName":"S3B_OL_1_ERR____20230722T215033_20230722T223451_20230724T182451_2658_082_072______LN3_O_NR_002.SEN3"},"demandType":"NOMINAL","debug":false,"timeliness":"NRT","productSizeByte":990662154,"oqcFlag":"NOT_CHECKED","stationName":null}Product successfully ingested in catalog
Catalog:
I add WA (used develop version) and decrease priority of this issue. Waiting delivery to close this issue
w-fsi
commented
1 year ago From the logs I can confirm as well that the WA was successfully applied.
vgava-ads
commented
1 year ago System_CCB_2023_w31: Delivered in the Processing Common v1.14.0 (Refer to https://github.com/COPRS/production-common/releases/tag/1.14.0-rc2) To be validated by IVV/OPS team.
Woljtek
commented
1 year ago To be tested after v1.14.0 deployment.
suberti-ads
commented
1 year ago System_CCB_2023_w32: No issue seen on v 1.14.0-rc2 issue can be closed
Environment:
Traçability:
Current Behavior: The metadata fails to extract metadata for 1 spectific data for SL_1 and SL_2 (generated by PUG).
Expected Behavior: Metadata should extract the metadata for all data generated by PUG.
Steps To Reproduce: Ingest the catalog event related to S3B_SL_2_LST__20230427T222046_20230427T222346_20230607T014948_0179_079_001_1260_LN3_O_NR_004 or S3B_SL_1_RBT__20230427T222346_20230427T222646_20230603T202503_0179_079_001_1440_LN3_O_NR_004
Test execution artefacts (i.e. logs, screenshots…) The current error is the following: Metadata extraction failed: java.lang.RuntimeException: Error: Number of retries has exceeded while performing Create metadata {"STC":false,"coastalPercentage":"","procName":"PUG","absoluteStopOrbit":26068,"openOceanPercentage":"","snowOrIcePercentage":"","cloudPercentage":"","productName":"S3B_SL_2_LST20230427T222346_20230427T222646_20230606T233407_0179_079_001_1440_LN3_O_NR_004.SEN3","absoluteStartOrbit":26068,"NRT":true,"procVersion":"03.45","processingLevel":2,"platformShortName":"Sentinel-3","continentalIcePercentage":"","productClass":"SL","landPercentage":"","t0PdgsDate":"2023-04-28T00:07:45.000000Z","operationalMode":"Earth Observation","s3timeliness":"NR","instrumentName":"SLSTR","freshInlandWaterPercentage":"","timeliness":"NRT","validityStartTime":"2023-04-27T22:23:45.972813Z","generatingCentre":"LN3","NTC":false,"processMode":"NOMINAL","productFamily":"S3_PUG","creationTime":"2023-06-06T23:34:07.000000Z","sliceCoordinates":{"orientation":"counterclockwise","coordinates":[[[169.705,83.7802],[173.897,83.7875],[178.102,83.7541],[-177.768,83.6838],[-173.748,83.5948],[-169.817,83.4587],[-166.119,83.3072],[-162.581,83.1316],[-159.207,82.9174],[-156.055,82.6948],[-153.137,82.4387],[-150.372,82.1657],[-147.785,81.8879],[-145.401,81.5814],[-143.159,81.2703],[-141.085,80.9495],[-139.124,80.6073],[-137.364,80.256],[-135.705,79.9067],[-134.142,79.5439],[-132.69,79.1758],[-131.331,78.8001],[-130.054,78.4167],[-128.91,78.0264],[-127.782,77.6308],[-126.724,77.2424],[-125.731,76.8371],[-124.834,76.4337],[-123.932,76.025],[-123.112,75.6162],[-122.827,75.4652],[-112.494,76.4036],[-100.876,76.884],[-88.8893,76.8259],[-77.4969,76.2388],[-77.4492,76.2445],[-77.2102,76.4029],[-76.6217,76.8404],[-75.9272,77.2729],[-75.2327,77.7026],[-74.4569,78.1251],[-73.6271,78.5535],[-72.7364,78.9814],[-71.7855,79.4004],[-70.7701,79.811],[-69.6397,80.2332],[-68.433,80.6425],[-67.1151,81.0473],[-65.7017,81.4439],[-64.124,81.8393],[-62.3537,82.2334],[-60.4549,82.6035],[-58.2804,82.982],[-55.9426,83.3351],[-53.286,83.6896],[-50.4234,84.0185],[-47.222,84.3339],[-43.5266,84.6336],[-39.5811,84.9035],[-35.0112,85.1491],[-30.1744,85.3603],[-24.8951,85.5407],[-19.2055,85.6638],[-13.1885,85.7644],[-7.05887,85.8044],[-0.763057,85.7887],[-0.754708,85.7973],[6.5312,88.3765],[154.93,88.9118],[167.825,86.3421],[169.705,83.7802]]],"type":"Polygon"},"insertionTime":"2023-06-13T15:34:43.756844Z","stopOrbitDirection":"","procTime":"2023-06-06T23:34:09.000000","validityStopTime":"2023-04-27T22:26:45.972813Z","classId":"O_NR_004","brightPercentage":"","instanceId":"0179_079_001_1440","closedSeaPercentage":"","tidalRegionPercentage":"","utcTime":"2023-04-27T21:59:45.972813Z","relativeStopOrbit":1,"relativeStartOrbit":1,"startTime":"2023-04-27T22:23:45.972813Z","stopTime":"2023-04-27T22:26:45.972813Z","dumpStart":"2023-04-27T22:18:19.914214Z","granuleNumber":1,"productType":"SL_2_LST___","qualityIndicator":"PASSED","missionId":"S3","satelliteId":"B","granulePosition":"FIRST","url":"S3B_SL_2_LST20230427T222346_20230427T222646_20230606T233407_0179_079_001_1440_LN3_O_NR_004.SEN3","platformSerialIdentifier":"B","baselineCollection":"004","receivingGroundStation":"CGS","site":"Toulouse","utc1Time":"2023-04-27T23:40:45.143984Z","orbitDirection":"ascending","cycleNumber":79,"salineWaterPercentage":""} after 2 attempts: ElasticsearchStatusException[Elasticsearch exception [type=mapper_parsing_exception, reason=failed to parse]]; nested: ElasticsearchException[Elasticsearch exception [type=topology_exception, reason=found non-noded intersection between LINESTRING ( 180.0 87.10802012038124, 6.5312 88.3765 ) and LINESTRING ( 154.93 88.9118, 167.825 86.3421 ) [ (163.37135983634673, 87.2296160239271, NaN) ]]]; at org.elasticsearch.rest.BytesRestResponse.errorFromXContent(BytesRestResponse.java:176) at org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:2011) at org.elasticsearch.client.RestHighLevelClient.parseResponseException(RestHighLevelClient.java:1988) at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1745) at org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:1702) at org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:1672) at org.elasticsearch.client.RestHighLevelClient.index(RestHighLevelClient.java:1029) at esa.s1pdgs.cpoc.metadata.extraction.service.elastic.ElasticsearchDAO.index(ElasticsearchDAO.java:33) at esa.s1pdgs.cpoc.metadata.extraction.service.elastic.EsServices.createMetadata(EsServices.java:115) at esa.s1pdgs.cpoc.metadata.extraction.service.elastic.EsServices.lambda$createMetadataWithRetries$0(EsServices.java:82) at esa.s1pdgs.cpoc.common.utils.Retries.performWithRetries(Retries.java:23) at esa.s1pdgs.cpoc.metadata.extraction.service.elastic.EsServices.createMetadataWithRetries(EsServices.java:79) at esa.s1pdgs.cpoc.metadata.extraction.service.ExtractionService.handleMessage(ExtractionService.java:155) at esa.s1pdgs.cpoc.metadata.extraction.service.ExtractionService.apply(ExtractionService.java:105) at esa.s1pdgs.cpoc.metadata.extraction.service.ExtractionService.apply(ExtractionService.java:57) at org.springframework.cloud.function.context.catalog.SimpleFunctionRegistry$FunctionInvocationWrapper.invokeFunctionAndEnrichResultIfNecessary(SimpleFunctionRegistry.java:897) at org.springframework.cloud.function.context.catalog.SimpleFunctionRegistry$FunctionInvocationWrapper.invokeFunction(SimpleFunctionRegistry.java:853) at org.springframework.cloud.function.context.catalog.SimpleFunctionRegistry$FunctionInvocationWrapper.doApply(SimpleFunctionRegistry.java:708) at org.springframework.cloud.function.context.catalog.SimpleFunctionRegistry$FunctionInvocationWrapper.apply(SimpleFunctionRegistry.java:551) at org.springframework.cloud.stream.function.PartitionAwareFunctionWrapper.apply(PartitionAwareFunctionWrapper.java:84) at org.springframework.cloud.stream.function.FunctionConfiguration$FunctionWrapper.apply(FunctionConfiguration.java:754) at org.springframework.cloud.stream.function.FunctionConfiguration$FunctionToDestinationBinder$1.handleMessageInternal(FunctionConfiguration.java:586) at org.springframework.integration.handler.AbstractMessageHandler.handleMessage(AbstractMessageHandler.java:56) at org.springframework.integration.dispatcher.AbstractDispatcher.tryOptimizedDispatch(AbstractDispatcher.java:115) at org.springframework.integration.dispatcher.UnicastingDispatcher.doDispatch(UnicastingDispatcher.java:133) at org.springframework.integration.dispatcher.UnicastingDispatcher.dispatch(UnicastingDispatcher.java:106) at org.springframework.integration.channel.AbstractSubscribableChannel.doSend(AbstractSubscribableChannel.java:72) at org.springframework.integration.channel.AbstractMessageChannel.send(AbstractMessageChannel.java:317) at org.springframework.integration.channel.AbstractMessageChannel.send(AbstractMessageChannel.java:272) at org.springframework.messaging.core.GenericMessagingTemplate.doSend(GenericMessagingTemplate.java:187) at org.springframework.messaging.core.GenericMessagingTemplate.doSend(GenericMessagingTemplate.java:166) at org.springframework.messaging.core.GenericMessagingTemplate.doSend(GenericMessagingTemplate.java:47) at org.springframework.messaging.core.AbstractMessageSendingTemplate.send(AbstractMessageSendingTemplate.java:109) at org.springframework.integration.endpoint.MessageProducerSupport.sendMessage(MessageProducerSupport.java:216) at org.springframework.integration.kafka.inbound.KafkaMessageDrivenChannelAdapter.sendMessageIfAny(KafkaMessageDrivenChannelAdapter.java:397) at org.springframework.integration.kafka.inbound.KafkaMessageDrivenChannelAdapter.access$300(KafkaMessageDrivenChannelAdapter.java:83) at org.springframework.integration.kafka.inbound.KafkaMessageDrivenChannelAdapter$IntegrationRecordMessageListener.onMessage(KafkaMessageDrivenChannelAdapter.java:454) at org.springframework.integration.kafka.inbound.KafkaMessageDrivenChannelAdapter$IntegrationRecordMessageListener.onMessage(KafkaMessageDrivenChannelAdapter.java:428) at org.springframework.kafka.listener.adapter.RetryingMessageListenerAdapter.lambda$onMessage$0(RetryingMessageListenerAdapter.java:125) at org.springframework.retry.support.RetryTemplate.doExecute(RetryTemplate.java:329) at org.springframework.retry.support.RetryTemplate.execute(RetryTemplate.java:255) at org.springframework.kafka.listener.adapter.RetryingMessageListenerAdapter.onMessage(RetryingMessageListenerAdapter.java:119) at org.springframework.kafka.listener.adapter.RetryingMessageListenerAdapter.onMessage(RetryingMessageListenerAdapter.java:42) at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.doInvokeOnMessage(KafkaMessageListenerContainer.java:2629) at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.invokeOnMessage(KafkaMessageListenerContainer.java:2609) at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.doInvokeRecordListener(KafkaMessageListenerContainer.java:2536) at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.doInvokeWithRecords(KafkaMessageListenerContainer.java:2427) at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.invokeRecordListener(KafkaMessageListenerContainer.java:2305) at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.invokeListener(KafkaMessageListenerContainer.java:1979) at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.invokeIfHaveRecords(KafkaMessageListenerContainer.java:1364) at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.pollAndInvoke(KafkaMessageListenerContainer.java:1355) at org.springframework.kafka.listener.KafkaMessageListenerContainer$ListenerConsumer.run(KafkaMessageListenerContainer.java:1247) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.lang.Thread.run(Thread.java:829) Suppressed: org.elasticsearch.client.ResponseException: method [PUT], host [http://elasticsearch-processing-es-http.database.svc.cluster.local:9200], URI [/s3_pug/_doc/S3B_SL_2_LST____20230427T222346_20230427T222646_20230606T233407_0179_079_001_1440_LN3_O_NR_004.SEN3?refresh=wait_for&timeout=1m], status line [HTTP/1.1 400 Bad Request] {"error":{"root_cause":[{"type":"mapper_parsing_exception","reason":"failed to parse"}],"type":"mapper_parsing_exception","reason":"failed to parse","caused_by":{"type":"topology_exception","reason":"found non-noded intersection between LINESTRING ( 180.0 87.10802012038124, 6.5312 88.3765 ) and LINESTRING ( 154.93 88.9118, 167.825 86.3421 ) [ (163.37135983634673, 87.2296160239271, NaN) ]"}},"status":400} at org.elasticsearch.client.RestClient.convertResponse(RestClient.java:326) at org.elasticsearch.client.RestClient.performRequest(RestClient.java:296) at org.elasticsearch.client.RestClient.performRequest(RestClient.java:270) at org.elasticsearch.client.RestHighLevelClient.performClientRequest(RestHighLevelClient.java:2082) at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1732) ... 51 more Caused by: ElasticsearchException[Elasticsearch exception [type=topology_exception, reason=found non-noded intersection between LINESTRING ( 180.0 87.10802012038124, 6.5312 88.3765 ) and LINESTRING ( 154.93 88.9118, 167.825 86.3421 ) [ (163.37135983634673, 87.2296160239271, NaN) ]]] at org.elasticsearch.ElasticsearchException.innerFromXContent(ElasticsearchException.java:485) at org.elasticsearch.ElasticsearchException.fromXContent(ElasticsearchException.java:396) at org.elasticsearch.ElasticsearchException.innerFromXContent(ElasticsearchException.java:426) at org.elasticsearch.ElasticsearchException.failureFromXContent(ElasticsearchException.java:592) at org.elasticsearch.rest.BytesRestResponse.errorFromXContent(BytesRestResponse.java:168) ... 54 more
Caused by: ElasticsearchStatusException[Elasticsearch exception [type=mapper_parsing_exception, reason=failed to parse]]; nested: ElasticsearchException[Elasticsearch exception [type=topology_exception, reason=found non-noded intersection between LINESTRING ( 180.0 87.10802012038124, 6.5312 88.3765 ) and LINESTRING ( 154.93 88.9118, 167.825 86.3421 ) [ (163.37135983634673, 87.2296160239271, NaN) ]]]; at org.elasticsearch.rest.BytesRestResponse.errorFromXContent(BytesRestResponse.java:176) at org.elasticsearch.client.RestHighLevelClient.parseEntity(RestHighLevelClient.java:2011) at org.elasticsearch.client.RestHighLevelClient.parseResponseException(RestHighLevelClient.java:1988) at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1745) at org.elasticsearch.client.RestHighLevelClient.performRequest(RestHighLevelClient.java:1702) at org.elasticsearch.client.RestHighLevelClient.performRequestAndParseEntity(RestHighLevelClient.java:1672) at org.elasticsearch.client.RestHighLevelClient.index(RestHighLevelClient.java:1029) at esa.s1pdgs.cpoc.metadata.extraction.service.elastic.ElasticsearchDAO.index(ElasticsearchDAO.java:33) at esa.s1pdgs.cpoc.metadata.extraction.service.elastic.EsServices.createMetadata(EsServices.java:115) at esa.s1pdgs.cpoc.metadata.extraction.service.elastic.EsServices.lambda$createMetadataWithRetries$0(EsServices.java:82) at esa.s1pdgs.cpoc.common.utils.Retries.performWithRetries(Retries.java:23) ... 44 more Suppressed: org.elasticsearch.client.ResponseException: method [PUT], host [http://elasticsearch-processing-es-http.database.svc.cluster.local:9200], URI [/s3_pug/_doc/S3B_SL_2_LST____20230427T222346_20230427T222646_20230606T233407_0179_079_001_1440_LN3_O_NR_004.SEN3?refresh=wait_for&timeout=1m], status line [HTTP/1.1 400 Bad Request] {"error":{"root_cause":[{"type":"mapper_parsing_exception","reason":"failed to parse"}],"type":"mapper_parsing_exception","reason":"failed to parse","caused_by":{"type":"topology_exception","reason":"found non-noded intersection between LINESTRING ( 180.0 87.10802012038124, 6.5312 88.3765 ) and LINESTRING ( 154.93 88.9118, 167.825 86.3421 ) [ (163.37135983634673, 87.2296160239271, NaN) ]"}},"status":400} at org.elasticsearch.client.RestClient.convertResponse(RestClient.java:326) at org.elasticsearch.client.RestClient.performRequest(RestClient.java:296) at org.elasticsearch.client.RestClient.performRequest(RestClient.java:270) at org.elasticsearch.client.RestHighLevelClient.performClientRequest(RestHighLevelClient.java:2082) at org.elasticsearch.client.RestHighLevelClient.internalPerformRequest(RestHighLevelClient.java:1732) ... 51 more Caused by: ElasticsearchException[Elasticsearch exception [type=topology_exception, reason=found non-noded intersection between LINESTRING ( 180.0 87.10802012038124, 6.5312 88.3765 ) and LINESTRING ( 154.93 88.9118, 167.825 86.3421 ) [ (163.37135983634673, 87.2296160239271, NaN) ]]] at org.elasticsearch.ElasticsearchException.innerFromXContent(ElasticsearchException.java:485) at org.elasticsearch.ElasticsearchException.fromXContent(ElasticsearchException.java:396) at org.elasticsearch.ElasticsearchException.innerFromXContent(ElasticsearchException.java:426) at org.elasticsearch.ElasticsearchException.failureFromXContent(ElasticsearchException.java:592) at org.elasticsearch.rest.BytesRestResponse.errorFromXContent(BytesRestResponse.java:168) ... 54 more
Whenever possible, first analysis of the root cause Seems to be related to the NaN value in the LINESTRING (which is strange).
Bug Generic Definition of Ready (DoR)
Bug Generic Definition of Done (DoD)