Informatievlaanderen / VSDS-Tech-Docs

Technical documentation, part of the VSDS Portal
https://informatievlaanderen.github.io/VSDS-Tech-Docs/
0 stars 9 forks source link

docs/quickstart.md: Consuming an LDES: Running NiFi flow gives exceptions #20

Open ghsnd opened 1 year ago

ghsnd commented 1 year ago

When running the NiFi flow as described in Consuming an LDES, step 4, the VersionMaterialiseProcessor appears to be doing nothing, and some exceptions like the following appear in the logging:

nifi-graph  | 2023-05-12 06:42:39,624 INFO [Timer-Driven Process Thread-3] org.hibernate.tuple.PojoInstantiator HHH000182: No default (no-argument) constructor for class: be.vlaanderen.informatievlaanderen.ldes.client.member.sqlite.Member (class must be instantiated by Interceptor)

nifi-graph  | 2023-05-12 06:42:39,846 WARN [Timer-Driven Process Thread-8] o.h.t.s.i.ExceptionHandlerLoggedImpl GenerationTarget encountered exception accepting command : Error executing DDL "create table Member (id varchar(255) not null, primary key (id))" via JDBC Statement
nifi-graph  | org.hibernate.tool.schema.spi.CommandAcceptanceException: Error executing DDL "create table Member (id varchar(255) not null, primary key (id))" via JDBC Statement
nifi-graph  |   at org.hibernate.tool.schema.internal.exec.GenerationTargetToDatabase.accept(GenerationTargetToDatabase.java:67)
nifi-graph  |   at org.hibernate.tool.schema.internal.AbstractSchemaMigrator.applySqlString(AbstractSchemaMigrator.java:581)
nifi-graph  |   at org.hibernate.tool.schema.internal.AbstractSchemaMigrator.applySqlStrings(AbstractSchemaMigrator.java:526)
nifi-graph  |   at org.hibernate.tool.schema.internal.AbstractSchemaMigrator.createTable(AbstractSchemaMigrator.java:293)
nifi-graph  |   at org.hibernate.tool.schema.internal.GroupedSchemaMigratorImpl.performTablesMigration(GroupedSchemaMigratorImpl.java:74)
nifi-graph  |   at org.hibernate.tool.schema.internal.AbstractSchemaMigrator.performMigration(AbstractSchemaMigrator.java:220)
nifi-graph  |   at org.hibernate.tool.schema.internal.AbstractSchemaMigrator.doMigration(AbstractSchemaMigrator.java:123)
nifi-graph  |   at org.hibernate.tool.schema.spi.SchemaManagementToolCoordinator.performDatabaseAction(SchemaManagementToolCoordinator.java:196)
nifi-graph  |   at org.hibernate.tool.schema.spi.SchemaManagementToolCoordinator.process(SchemaManagementToolCoordinator.java:85)
nifi-graph  |   at org.hibernate.internal.SessionFactoryImpl.<init>(SessionFactoryImpl.java:335)
nifi-graph  |   at org.hibernate.boot.internal.SessionFactoryBuilderImpl.build(SessionFactoryBuilderImpl.java:471)
nifi-graph  |   at org.hibernate.jpa.boot.internal.EntityManagerFactoryBuilderImpl.build(EntityManagerFactoryBuilderImpl.java:1498)
nifi-graph  |   at org.hibernate.jpa.HibernatePersistenceProvider.createEntityManagerFactory(HibernatePersistenceProvider.java:56)
nifi-graph  |   at javax.persistence.Persistence.createEntityManagerFactory(Persistence.java:79)
nifi-graph  |   at javax.persistence.Persistence.createEntityManagerFactory(Persistence.java:54)
nifi-graph  |   at be.vlaanderen.informatievlaanderen.ldes.client.member.sqlite.SqliteMemberRepository.<init>(SqliteMemberRepository.java:15)
nifi-graph  |   at be.vlaanderen.informatievlaanderen.ldes.client.state.SqlitePersistedLdesStateManager.<init>(SqlitePersistedLdesStateManager.java:57)
nifi-graph  |   at be.vlaanderen.informatievlaanderen.ldes.client.LdesClientImplFactory.getSqlitePersistedStateManager(LdesClientImplFactory.java:42)
nifi-graph  |   at be.vlaanderen.informatievlaanderen.ldes.client.LdesClientImplFactory.getStateManager(LdesClientImplFactory.java:23)
nifi-graph  |   at be.vlaanderen.informatievlaanderen.ldes.client.LdesClientImplFactory.getLdesService(LdesClientImplFactory.java:54)
nifi-graph  |   at be.vlaanderen.informatievlaanderen.ldes.processors.LdesClient.onScheduled(LdesClient.java:76)
nifi-graph  |   at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
nifi-graph  |   at java.base/java.lang.reflect.Method.invoke(Method.java:577)
nifi-graph  |   at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:145)
nifi-graph  |   at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:133)
nifi-graph  |   at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotations(ReflectionUtils.java:78)
nifi-graph  |   at org.apache.nifi.util.ReflectionUtils.invokeMethodsWithAnnotation(ReflectionUtils.java:55)
nifi-graph  |   at org.apache.nifi.controller.StandardProcessorNode.lambda$initiateStart$8(StandardProcessorNode.java:1736)
nifi-graph  |   at org.apache.nifi.engine.FlowEngine$3.call(FlowEngine.java:123)
nifi-graph  |   at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
nifi-graph  |   at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
nifi-graph  |   at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
nifi-graph  |   at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
nifi-graph  |   at java.base/java.lang.Thread.run(Thread.java:833)
nifi-graph  | Caused by: org.sqlite.SQLiteException: [SQLITE_ERROR] SQL error or missing database (table Member already exists)
nifi-graph  |   at org.sqlite.core.DB.newSQLException(DB.java:1179)
nifi-graph  |   at org.sqlite.core.DB.newSQLException(DB.java:1190)
nifi-graph  |   at org.sqlite.core.DB.execute(DB.java:988)
nifi-graph  |   at org.sqlite.core.CoreStatement.exec(CoreStatement.java:79)
nifi-graph  |   at org.sqlite.jdbc3.JDBC3Statement.lambda$execute$0(JDBC3Statement.java:52)
nifi-graph  |   at org.sqlite.jdbc3.JDBC3Statement.withConnectionTimeout(JDBC3Statement.java:454)
nifi-graph  |   at org.sqlite.jdbc3.JDBC3Statement.execute(JDBC3Statement.java:40)
nifi-graph  |   at org.hibernate.tool.schema.internal.exec.GenerationTargetToDatabase.accept(GenerationTargetToDatabase.java:54)