Closed danielvillalbamota closed 4 months ago
I'm not able or reproduce it just with a poor sink pointed to nowhere
time=2024-02-29T14:05:01.423Z | lvl=DEBUG | corr=a44e5a54-da33-42a9-b957-f936fcd30331; cbnotif=1 | trans=f69ea31f-e027-4efa-a01d-af64bb98c3a3 | srv=base | subsrv=/path/FeatureServer/0 | comp=cygnus-ngsi | op=tryRegister | msg=org.eclipse.jetty.io.FillInterest[79] : interested FillInterest@41ce330e{AC.ReadCB@c4280a{HttpConnection@c4280a::SocketChannelEndPoint@4f3ed5a6{l=/172.17.0.11:5059,r=/172.17.0.16:47174,OPEN,fill=FI,flush=-,to=0/30000}{io=0/0,kio=0,kro=1}->HttpConnection@c4280a[p=HttpParser{s=START,0 of -1},g=HttpGenerator@310e0bf7{s=START}]=>HttpChannelOverHttp@41f92231{s=HttpChannelState@45c6bed6{s=IDLE rs=BLOCKING os=OPEN is=IDLE awp=false se=false i=true al=0},r=1,c=false/false,a=IDLE,uri=null,age=0}}}
time=2024-02-29T14:05:01.423Z | lvl=DEBUG | corr=a44e5a54-da33-42a9-b957-f936fcd30331; cbnotif=1 | trans=f69ea31f-e027-4efa-a01d-af64bb98c3a3 | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=persistAggregation | msg=com.telefonica.iot.cygnus.sinks.NGSIArcgisFeatureTableSink[378] : [arcgis-sink] persisting aggregation, 1 features.
time=2024-02-29T14:05:01.423Z | lvl=DEBUG | corr=a44e5a54-da33-42a9-b957-f936fcd30331; cbnotif=1 | trans=f69ea31f-e027-4efa-a01d-af64bb98c3a3 | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=persistAggregation | msg=com.telefonica.iot.cygnus.sinks.NGSIArcgisFeatureTableSink[384] : [arcgis-sink] persistAggregation - Feature table: localhost/base/path/FeatureServer/0 is new: true
time=2024-02-29T14:05:01.423Z | lvl=DEBUG | corr=a44e5a54-da33-42a9-b957-f936fcd30331; cbnotif=1 | trans=f69ea31f-e027-4efa-a01d-af64bb98c3a3 | srv=base | subsrv=/path/FeatureServer/0 | comp=cygnus-ngsi | op=changeInterests | msg=org.eclipse.jetty.io.ChannelEndPoint[422] : changeInterests p=false 0->1 for SocketChannelEndPoint@4f3ed5a6{l=/172.17.0.11:5059,r=/172.17.0.16:47174,OPEN,fill=FI,flush=-,to=0/30000}{io=0/1,kio=0,kro=1}->HttpConnection@c4280a[p=HttpParser{s=START,0 of -1},g=HttpGenerator@310e0bf7{s=START}]=>HttpChannelOverHttp@41f92231{s=HttpChannelState@45c6bed6{s=IDLE rs=BLOCKING os=OPEN is=IDLE awp=false se=false i=true al=0},r=1,c=false/false,a=IDLE,uri=null,age=0}
time=2024-02-29T14:05:01.423Z | lvl=DEBUG | corr=a44e5a54-da33-42a9-b957-f936fcd30331; cbnotif=1 | trans=f69ea31f-e027-4efa-a01d-af64bb98c3a3 | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=getPersistenceBackend | msg=com.telefonica.iot.cygnus.sinks.NGSIArcgisFeatureTableSink[172] : Creating new persistenceBackend for Feature table: localhost/base/path/FeatureServer/0
time=2024-02-29T14:05:01.424Z | lvl=DEBUG | corr=a44e5a54-da33-42a9-b957-f936fcd30331; cbnotif=1 | trans=f69ea31f-e027-4efa-a01d-af64bb98c3a3 | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=getPersistenceBackend | msg=com.telefonica.iot.cygnus.sinks.NGSIArcgisFeatureTableSink[173] : Token url: localhost
time=2024-02-29T14:05:01.424Z | lvl=DEBUG | corr=a44e5a54-da33-42a9-b957-f936fcd30331; cbnotif=1 | trans=f69ea31f-e027-4efa-a01d-af64bb98c3a3 | srv=base | subsrv=/path/FeatureServer/0 | comp=cygnus-ngsi | op=submit | msg=org.eclipse.jetty.io.ManagedSelector[286] : Queued change lazy=false org.eclipse.jetty.io.ChannelEndPoint$$Lambda$222/0x00007f84ec21e420@60ebd745 on ManagedSelector@6771a5f4{STARTED} id=3 keys=1 selected=0 updates=0
time=2024-02-29T14:05:01.424Z | lvl=DEBUG | corr=a44e5a54-da33-42a9-b957-f936fcd30331; cbnotif=1 | trans=f69ea31f-e027-4efa-a01d-af64bb98c3a3 | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=
time=2024-02-29T14:05:01.425Z | lvl=DEBUG | corr=a44e5a54-da33-42a9-b957-f936fcd30331; cbnotif=1 | trans=f69ea31f-e027-4efa-a01d-af64bb98c3a3 | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=persistAggregation | msg=com.telefonica.iot.cygnus.sinks.NGSIArcgisFeatureTableSink[402] : PersistAggregation Error: com.telefonica.iot.cygnus.errors.CygnusRuntimeError: CygnusRuntimeError (com.telefonica.iot.cygnus.errors.CygnusRuntimeError). Error creating new persistence Backend. (CygnusRuntimeError. [arcgis-sinkError creating Persistence backend: -1 - Can´t parse token generation url, MalformedURLException. localhost/base/path/FeatureServer/0 - localhost. ). at com.telefonica.iot.cygnus.sinks.NGSIArcgisFeatureTableSink.getPersistenceBackend(NGSIArcgisFeatureTableSink.java:195) at com.telefonica.iot.cygnus.sinks.NGSIArcgisFeatureTableSink.persistAggregation(NGSIArcgisFeatureTableSink.java:386) at com.telefonica.iot.cygnus.sinks.NGSIArcgisFeatureTableSink.persistBatch(NGSIArcgisFeatureTableSink.java:305) at com.telefonica.iot.cygnus.sinks.NGSISink.processNewBatches(NGSISink.java:597) at com.telefonica.iot.cygnus.sinks.NGSISink.process(NGSISink.java:372) at com.telefonica.iot.cygnus.sinks.NGSIArcgisFeatureTableSink.process(NGSIArcgisFeatureTableSink.java:325) at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:39) at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145) at java.base/java.lang.Thread.run(Thread.java:840)
time=2024-02-29T14:05:01.425Z | lvl=ERROR | corr=a44e5a54-da33-42a9-b957-f936fcd30331; cbnotif=1 | trans=f69ea31f-e027-4efa-a01d-af64bb98c3a3 | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=persistBatch | msg=com.telefonica.iot.cygnus.sinks.NGSIArcgisFeatureTableSink[310] : [arcgis-sink] Error persisting batch, CygnusRuntimeError.CygnusRuntimeError (com.telefonica.iot.cygnus.errors.CygnusRuntimeError). Error creating new persistence Backend. (CygnusRuntimeError. [arcgis-sinkError creating Persistence backend: -1 - Can´t parse token generation url, MalformedURLException. localhost/base/path/FeatureServer/0 - localhost. ). time=2024-02-29T14:05:01.425Z | lvl=ERROR | corr=a44e5a54-da33-42a9-b957-f936fcd30331; cbnotif=1 | trans=f69ea31f-e027-4efa-a01d-af64bb98c3a3 | srv=N/A | subsrv=N/A | comp=cygnus-ngsi | op=processNewBatches | msg=com.telefonica.iot.cygnus.sinks.NGSISink[610] : CygnusRuntimeError. CygnusRuntimeError (com.telefonica.iot.cygnus.errors.CygnusRuntimeError). Error creating new persistence Backend. (CygnusRuntimeError. [arcgis-sinkError creating Persistence backend: -1 - Can´t parse token generation url, MalformedURLException. localhost/base/path/FeatureServer/0 - localhost. ). . Sink: arcgis-sink Destination: base_/path/FeatureServer/0_Otracosa2_name Stack trace: [com.telefonica.iot.cygnus.sinks.NGSIArcgisFeatureTableSink.persistBatch(NGSIArcgisFeatureTableSink.java:311), com.telefonica.iot.cygnus.sinks.NGSISink.processNewBatches(NGSISink.java:597), com.telefonica.iot.cygnus.sinks.NGSISink.process(NGSISink.java:372), com.telefonica.iot.cygnus.sinks.NGSIArcgisFeatureTableSink.process(NGSIArcgisFeatureTableSink.java:325), org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:39), org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145), java.base/java.lang.Thread.run(Thread.java:840)]
Cygnus version: 3.5.0
Having a subscription in CB for arcgis sink which is working and getting persistence, if I change the value of
type
(unique field) the sink is not able to prepare the query properly getting the following error:How to reproduce the error:
Example working httpCustom in subs:
After some notifications, change the type
s value by
name`The sink performs the following query:
in which
where
param is using the original type's value and is not setting the entityId inside parenthesis.