ALIADA / aliada-tool

Aliada tool implementation
GNU General Public License v3.0
35 stars 14 forks source link

RDFizer bug at eu.aliada.rdfizer.pipeline.processors.CheckJobCompleteness #108

Closed idoiamurua closed 9 years ago

idoiamurua commented 9 years ago

@agazzarini Sorry for this bug bombing, but yesterday (with the RDFizer previous version) and today (with the RDFizer latest version), the following error appears in the "infraestructure.log" file:

2015-05-12 09:02:45,524 ERROR Duplicate entry '488' for key 'PRIMARY'
2015-05-12 09:02:45,750 ERROR Failed delivery for (MessageId: ID-aliada-scanbit-58581-1431413842850-0-1 on ExchangeId: ID-aliada-scanbit-58581-1431413842850-0-45). Exhausted after delivery attempt: 1 caught: org.springframework.dao.DataIntegrityViolationException: Duplicate entry '488' for key 'PRIMARY'; SQL [n/a]; constraint [null]; nested exception is org.hibernate.exception.ConstraintViolationException: Duplicate entry '488' for key 'PRIMARY'

Message History
---------------------------------------------------------------------------------------------------------------------------------------
RouteId              ProcessorId          Processor                                                                        Elapsed (ms)
[route13           ] [route13           ] [seda://lido-record-channel?blockWhenFull=true&concurrentConsumers=2&size=1000 ] [     12630]
[route6            ] [to7               ] [seda:lido-record-channel?concurrentConsumers=2&size=1000&blockWhenFull=true   ] [         0]
[route13           ] [process31         ] [ref:string-to-xml                                                             ] [         1]
[route13           ] [process32         ] [ref:xml-to-rdf                                                                ] [        62]
[route13           ] [process33         ] [ref:check-job-completeness                                                    ] [       549]

Exchange
---------------------------------------------------------------------------------------------------------------------------------------
Exchange[
    Id                  ID-aliada-scanbit-58581-1431413842850-0-45
    ExchangePattern     InOnly
    Headers             {breadcrumbId=ID-aliada-scanbit-58581-1431413842850-0-1, CamelFileAbsolute=true, CamelFileAbsolutePath=/work/data/aliada/lido/.working/mfa_lido_20_presentation_en1431414119072.xml.488, CamelFileLastModified=1431414096000, CamelFileLength=245031, CamelFileName=mfa_lido_20_presentation_en1431414119072.xml.488, CamelFileNameConsumed=mfa_lido_20_presentation_en1431414119072.xml.488, CamelFileNameOnly=mfa_lido_20_presentation_en1431414119072.xml.488, CamelFileParent=/work/data/aliada/lido/.working, CamelFilePath=/work/data/aliada/lido/.working/mfa_lido_20_presentation_en1431414119072.xml.488, CamelFileRelativePath=/work/data/aliada/lido/.working/mfa_lido_20_presentation_en1431414119072.xml.488, CamelRedelivered=false, CamelRedeliveryCounter=0, format=lido, graphName=http://data.artium.org/id/collections/librarian, jobId=488}
    BodyType            String
    Body                <http://aliada.scanbit.net:8891/id/collections/library/bib/E41_Appellation/szepmuveszetihuobject432> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E41_Appellation> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E41_Appellation/szepmuveszetihuobject432> <http://erlangen-crm.org/current/P3_has_note> "szepmuveszeti.hu_object_432" .<http://aliada.scanbit.net:8891/id/collections/library/bib/E31_Document/szepmuveszetihuobject432> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E31_Document> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E31_Document/szepmuveszetihuobject432> <http://erlangen-crm.org/current/P1_is_identified_by> <http://aliada.scanbit.net:8891/id/collections/library/bib/E41_Appellation/szepmuveszetihuobject432> . <http://aliada.scanbit.net:8891/id/collections/library/bib/E18_Physical_Thing/szepmuveszeti.hu_object_432> <http://erlangen-crm.org/current/P70i_is_documented_in> <http://aliada.scanbit.net:8891/id/collections/library/bib/E31_Document/szepmuveszetihuobject432> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E18_Physical_Thing/szepmuveszeti.hu_object_432> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E18_Physical_Thing> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E18_Physical_Thing/szepmuveszeti.hu_object_432> <http://erlangen-crm.org/current/P2_has_type> <http://aliada-project.eu/2014/aliada-ontology#id/resource/Concept/MFAB/Classification/68> . <http://aliada.scanbit.net:8891/id/collections/library/bib/E18_Physical_Thing/szepmuveszeti.hu_object_432> <http://erlangen-crm.org/current/P2_has_type> <http://aliada-project.eu/2014/aliada-ontology#id/resource/Concept/IMAGE> . <http://aliada.scanbit.net:8891/id/collections/library/bib/E18_Physical_Thing/szepmuveszeti.hu_object_432> <http://erlangen-crm.org/current/P2_has_type> <http://aliada-project.eu/2014/aliada-ontology#id/resource/Concept/MFAB/Department/2> . <http://aliada.scanbit.net:8891/id/collections/library/bib/E41_Appellation/thepontneuf> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E41_Appellation> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E41_Appellation/thepontneuf> <http://erlangen-crm.org/current/P3_has_note> "The Pont-Neuf" .<http://aliada.scanbit.net:8891/id/collections/library/bib/E18_Physical_Thing/szepmuveszeti.hu_object_432> <http://erlangen-crm.org/current/P1_is_identified_by> <http://aliada.scanbit.net:8891/id/collections/library/bib/E41_Appellation/thepontneuf> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E82_Actor_Appellation/szepmuveszetimuzeum> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E82_Actor_Appellation> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E82_Actor_Appellation/szepmuveszetimuzeum> <http://erlangen-crm.org/current/P3_has_note> "Szépművészeti Múzeum" .<http://aliada.scanbit.net:8891/id/collections/library/bib/E39_Actor/szepmuveszetimuzeum> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E39_Actor> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E18_Physical_Thing/szepmuveszeti.hu_object_432> <http://erlangen-crm.org/current/P50_has_current_keeper> <http://aliada.scanbit.net:8891/id/collections/library/bib/E39_Actor/szepmuveszetimuzeum> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E39_Actor/szepmuveszetimuzeum> <http://erlangen-crm.org/current/P131_is_identified_by> <http://aliada.scanbit.net:8891/id/collections/library/bib/E82_Actor_Appellation/szepmuveszetimuzeum> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E82_Actor_Appellation/szepmuveszetimuzeum> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E82_Actor_Appellation> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E82_Actor_Appellation/szepmuveszetimuzeum> <http://erlangen-crm.org/current/P3_has_note> "Szépművészeti Múzeum" .<http://aliada.scanbit.net:8891/id/collections/library/bib/E39_Actor/szepmuveszetimuzeum> <http://erlangen-crm.org/current/P131_is_identified_by> <http://aliada.scanbit.net:8891/id/collections/library/bib/E82_Actor_Appellation/szepmuveszetimuzeum> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E75_Conceptual_Object_Appellation/d0b6c67b-fa10-3270-ab47-0c45d8ae0c30> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E75_Conceptual_Object_Appellation> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E75_Conceptual_Object_Appellation/d0b6c67b-fa10-3270-ab47-0c45d8ae0c30> <http://erlangen-crm.org/current/P3_has_note> "http://www.szepmuveszeti.hu" .<http://aliada.scanbit.net:8891/id/collections/library/bib/E73_Information_Object/httpwwwszepmuveszetihu> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E73_Information_Object> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E73_Information_Object/httpwwwszepmuveszetihu> <http://erlangen-crm.org/current/P2_has_type> <http://aliada-project.eu/2014/aliada-ontology#id/resource/Concept/web_resource> . <http://aliada.scanbit.net:8891/id/collections/library/bib/E73_Information_Object/httpwwwszepmuveszetihu> <http://erlangen-crm.org/current/P149_is_identified_by> <http://aliada.scanbit.net:8891/id/collections/library/bib/E75_Conceptual_Object_Appellation/d0b6c67b-fa10-3270-ab47-0c45d8ae0c30> . <http://aliada.scanbit.net:8891/id/collections/library/bib/E39_Actor/szepmuveszetimuzeum> <http://erlangen-crm.org/current/P129i_is_subject_of> <http://aliada.scanbit.net:8891/id/collections/library/bib/E73_Information_Object/httpwwwszepmuveszetihu> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E44_Place_Appellation/1146BudapestDozsaGyorgyut41> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E44_Place_Appellation> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E44_Place_Appellation/1146BudapestDozsaGyorgyut41> <http://erlangen-crm.org/current/P3_has_note> "1146 Budapest, Dózsa György út 41." . <http://aliada.scanbit.net:8891/id/collections/library/bib/E53_Place/1146BudapestDozsaGyorgyut41> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E53_Place> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E53_Place/1146BudapestDozsaGyorgyut41> <http://erlangen-crm.org/current/P87_is_identified_by> <http://aliada.scanbit.net:8891/id/collections/library/bib/E44_Place_Appellation/1146BudapestDozsaGyorgyut41> . <http://aliada.scanbit.net:8891/id/collections/library/bib/E18_Physical_Thing/szepmuveszeti.hu_object_432> <http://erlangen-crm.org/current/P53_has_former_or_current_location> <http://aliada.scanbit.net:8891/id/collections/library/bib/E53_Place/1146BudapestDozsaGyorgyut41> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E44_Place_Appellation/budapest> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E44_Place_Appellation> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E44_Place_Appellation/budapest> <http://erlangen-crm.org/current/P3_has_note> "Budapest" . <http://aliada.scanbit.net:8891/id/collections/library/bib/E53_Place/budapest> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E53_Place> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E53_Place/budapest> <http://erlangen-crm.org/current/P87_is_identified_by> <http://aliada.scanbit.net:8891/id/collections/library/bib/E44_Place_Appellation/budapest> . <http://aliada.scanbit.net:8891/id/collections/library/bib/E53_Place/budapest> <http://erlangen-crm.org/current/P89i_contains> <http://aliada.scanbit.net:8891/id/collections/library/bib/E53_Place/1146BudapestDozsaGyorgyut41> . <http://aliada.scanbit.net:8891/id/collections/library/bib/E44_Place_Appellation/hungary> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E44_Place_Appellation> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E44_Place_Appellation/hungary> <http://erlangen-crm.org/current/P3_has_note> "Hungary" . <http://aliada.scanbit.net:8891/id/collections/library/bib/E53_Place/hungary> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E53_Place> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E53_Place/hungary> <http://erlangen-crm.org/current/P87_is_identified_by> <http://aliada.scanbit.net:8891/id/collections/library/bib/E44_Place_Appellation/hungary> . <http://aliada.scanbit.net:8891/id/collections/library/bib/E53_Place/hungary> <http://erlangen-crm.org/current/P89i_contains> <http://aliada.scanbit.net:8891/id/collections/library/bib/E53_Place/1146BudapestDozsaGyorgyut41> . <http://aliada.scanbit.net:8891/id/collections/library/bib/E44_Place_Appellation/europe> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E44_Place_Appellation> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E44_Place_Appellation/europe> <http://erlangen-crm.org/current/P3_has_note> "Europe" . <http://aliada.scanbit.net:8891/id/collections/library/bib/E53_Place/europe> <http://www.w3.org/1999/02/22-rdf-syntax-ns#type> <http://erlangen-crm.org/current/E53_Place> .<http://aliada.scanbit.net:8891/id/collections/library/bib/E53_Place/europe> <http://erlangen-crm.org/current/P87_is_identified_by> <http://aliada.scanbit.net:8891/id/collections/library/bib/E44_Place_Appellation/europe> . <http://aliada.scanbit.net:8891/id/collections/library/bib/E53_Place/europe> <http://erlangen-crm.org/current/P89i_contains> <http://aliada.scanbit.net:8891/id/collections/library/bib/E53_Place/1146BudapestDozsaGyorgyut41> . <http://aliada.scanbit.net:8891/id/collections/library/bib/E18_Physical_Thing/szepmuveszeti.hu_object_432> <http://erlangen-crm.org/current... [Body clipped after 1...
]

Stacktrace
---------------------------------------------------------------------------------------------------------------------------------------
org.springframework.dao.DataIntegrityViolationException: Duplicate entry '488' for key 'PRIMARY'; SQL [n/a]; constraint [null]; nested exception is org.hibernate.exception.ConstraintViolationException: Duplicate entry '488' for key 'PRIMARY'
    at org.springframework.orm.hibernate3.SessionFactoryUtils.convertHibernateAccessException(SessionFactoryUtils.java:643)
    at org.springframework.orm.jpa.vendor.HibernateJpaDialect.translateExceptionIfPossible(HibernateJpaDialect.java:106)
    at org.springframework.orm.jpa.JpaTransactionManager.doCommit(JpaTransactionManager.java:517)
    at org.springframework.transaction.support.AbstractPlatformTransactionManager.processCommit(AbstractPlatformTransactionManager.java:755)
    at org.springframework.transaction.support.AbstractPlatformTransactionManager.commit(AbstractPlatformTransactionManager.java:724)
    at org.springframework.transaction.interceptor.TransactionAspectSupport.commitTransactionAfterReturning(TransactionAspectSupport.java:475)
    at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:270)
    at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:94)
    at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
    at org.springframework.dao.support.PersistenceExceptionTranslationInterceptor.invoke(PersistenceExceptionTranslationInterceptor.java:155)
    at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
    at org.springframework.data.jpa.repository.support.CrudMethodMetadataPostProcessor$CrudMethodMetadataPopulatingMethodIntercceptor.invoke(CrudMethodMetadataPostProcessor.java:111)
    at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
    at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
    at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
    at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
    at com.sun.proxy.$Proxy197.save(Unknown Source)
    at eu.aliada.rdfizer.pipeline.processors.CheckJobCompleteness.persistJobStats(CheckJobCompleteness.java:114)
    at eu.aliada.rdfizer.pipeline.processors.CheckJobCompleteness.checkForCompleteness(CheckJobCompleteness.java:72)
    at eu.aliada.rdfizer.pipeline.processors.CheckJobCompleteness.process(CheckJobCompleteness.java:60)
    at org.apache.camel.processor.DelegateSyncProcessor.process(DelegateSyncProcessor.java:63)
    at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:72)
    at org.apache.camel.processor.interceptor.TraceInterceptor.process(TraceInterceptor.java:163)
    at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:398)
    at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:191)
    at org.apache.camel.processor.Pipeline.process(Pipeline.java:118)
    at org.apache.camel.processor.Pipeline.process(Pipeline.java:80)
    at org.apache.camel.processor.CamelInternalProcessor.process(CamelInternalProcessor.java:191)
    at org.apache.camel.component.seda.SedaConsumer.sendToConsumers(SedaConsumer.java:291)
    at org.apache.camel.component.seda.SedaConsumer.doRun(SedaConsumer.java:200)
    at org.apache.camel.component.seda.SedaConsumer.run(SedaConsumer.java:147)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
Caused by: org.hibernate.exception.ConstraintViolationException: Duplicate entry '488' for key 'PRIMARY'
    at org.hibernate.exception.internal.SQLExceptionTypeDelegate.convert(SQLExceptionTypeDelegate.java:74)
    at org.hibernate.exception.internal.StandardSQLExceptionConverter.convert(StandardSQLExceptionConverter.java:49)
    at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:125)
    at org.hibernate.engine.jdbc.spi.SqlExceptionHelper.convert(SqlExceptionHelper.java:110)
    at org.hibernate.engine.jdbc.internal.proxy.AbstractStatementProxyHandler.continueInvocation(AbstractStatementProxyHandler.java:129)
    at org.hibernate.engine.jdbc.internal.proxy.AbstractProxyHandler.invoke(AbstractProxyHandler.java:81)
    at com.sun.proxy.$Proxy230.executeUpdate(Unknown Source)
    at org.hibernate.engine.jdbc.batch.internal.NonBatchingBatch.addToBatch(NonBatchingBatch.java:56)
    at org.hibernate.persister.entity.AbstractEntityPersister.insert(AbstractEntityPersister.java:3028)
    at org.hibernate.persister.entity.AbstractEntityPersister.insert(AbstractEntityPersister.java:3469)
    at org.hibernate.action.internal.EntityInsertAction.execute(EntityInsertAction.java:88)
    at org.hibernate.engine.spi.ActionQueue.execute(ActionQueue.java:362)
    at org.hibernate.engine.spi.ActionQueue.executeActions(ActionQueue.java:354)
    at org.hibernate.engine.spi.ActionQueue.executeActions(ActionQueue.java:275)
    at org.hibernate.event.internal.AbstractFlushingEventListener.performExecutions(AbstractFlushingEventListener.java:326)
    at org.hibernate.event.internal.DefaultFlushEventListener.onFlush(DefaultFlushEventListener.java:52)
    at org.hibernate.internal.SessionImpl.flush(SessionImpl.java:1213)
    at org.hibernate.internal.SessionImpl.managedFlush(SessionImpl.java:402)
    at org.hibernate.engine.transaction.internal.jdbc.JdbcTransaction.beforeTransactionCommit(JdbcTransaction.java:101)
    at org.hibernate.engine.transaction.spi.AbstractTransactionImpl.commit(AbstractTransactionImpl.java:175)
    at org.hibernate.ejb.TransactionImpl.commit(TransactionImpl.java:75)
    at org.springframework.orm.jpa.JpaTransactionManager.doCommit(JpaTransactionManager.java:513)
    ... 31 more
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLIntegrityConstraintViolationException: Duplicate entry '488' for key 'PRIMARY'
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:408)
    at com.mysql.jdbc.Util.handleNewInstance(Util.java:408)
    at com.mysql.jdbc.Util.getInstance(Util.java:383)
    at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1049)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4208)
    at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:4140)
    at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2597)
    at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2758)
    at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2826)
    at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2082)
    at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2334)
    at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2262)
    at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2246)
    at org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:106)
    at org.apache.commons.dbcp.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:106)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:483)
    at org.hibernate.engine.jdbc.internal.proxy.AbstractStatementProxyHandler.continueInvocation(AbstractStatementProxyHandler.java:122)
    ... 48 more