search

samuvack / ldes-grar

1 stars 1 forks source link

LDES URLs not correct #2

Open goemaere opened 5 months ago

goemaere commented 5 months ago

Tried to run this LDES consumer PoC but getting errors on each of the LDES starting URLs:

2024-02-12 15:14:59,006 ERROR [Timer-Driven Process Thread-9] b.v.i.ldes.processors.LdesClient LdesClient[id=cc9aafe9-251f-3ce6-d4b6-ce12c7ecb91e] Failed to properly initialize Processor. If still scheduled to run, NiFi will attempt to initialize and run the Processor again after the 'Administrative Yield Duration' has elapsed. Failure is due to java.lang.IllegalArgumentException: Starting url could not be determined for fragmentId: https://onboarding1.smartdataspace.beta-vlaanderen.be/building-units/by-page java.lang.IllegalArgumentException: Starting url could not be determined for fragmentId: https://onboarding1.smartdataspace.beta-vlaanderen.be/building-units/by-page at be.vlaanderen.informatievlaanderen.ldes.processors.LdesClient.lambda$getStartingUrl$0(LdesClient.java:91) at java.base/java.util.Optional.orElseThrow(Optional.java:403) at be.vlaanderen.informatievlaanderen.ldes.processors.LdesClient.getStartingUrl(LdesClient.java:90) at be.vlaanderen.informatievlaanderen.ldes.processors.LdesClient.onScheduled(LdesClient.java:80) at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) at java.base/java.lang.reflect.Method.invoke(Method.java:577) at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:145) at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:133) at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:78) at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:55) at org.apache.nifi.controller.StandardProcessorNode.lambda$initiateStart$8(StandardProcessorNode.java:1736) at org.apache.nifi.engine.FlowEngine$3.call(FlowEngine.java:123) at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833)

Currently these URLs are configured: https://onboarding1.smartdataspace.beta-vlaanderen.be/addresses/by-time https://onboarding1.smartdataspace.beta-vlaanderen.be/building-units/by-page https://onboarding1.smartdataspace.beta-vlaanderen.be/parcels/by-page

Where can I find the correct URLs?

samuvack commented 5 months ago

Hi,

We have indeed observed internally that the currently used demo LDES endpoints do not contain any LDES members. Therefore, it is indeed impossible to run this demo at the moment. If you change the demo LDES endpoint (e.g., https://onboarding1.smartdataspace.beta-vlaanderen.be/parcels/by-page) to the Geomobility LDES endpoint: https://brugge-ldes.geomobility.eu/observations/by-page, then this data flow in Apache Nifi should work.

We apologize for the inconvenience and are working to resolve this as quickly as possible, so that this demo can also be performed.