orientechnologies / orientdb

OrientDB is the most versatile DBMS supporting Graph, Document, Reactive, Full-Text and Geospatial models in one Multi-Model product. OrientDB can run distributed (Multi-Master), supports SQL, ACID Transactions, Full-Text indexing and Reactive Queries.
https://orientdb.dev
Apache License 2.0
4.73k stars 869 forks source link

Internal Server Error while getting connected vertices. #8607

Closed anukul-mohil closed 3 years ago

anukul-mohil commented 5 years ago

OrientDB Version: 3.0.4

Java Version: "1.8.0_131"

OS: CentOS 7.3

Expected behavior

Return all the vertices having an edge to the vertex with name 'main', g.V().has('MyVertex', 'name', 'main').in()

Actual behavior

Returns Error: java.lang.NullPointerException: out vertex on edge COMPONENT_OF#89:7648{out:null,in:#45:2} v2 on studio and in server logs this:

Internal server error: java.lang.NullPointerException: out vertex on edge COMPONENT_OF#89:7648{out:null,in:#45:2} v2
        at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:226)
        at org.apache.tinkerpop.gremlin.orientdb.OrientEdge.<init>(OrientEdge.java:32)
        at org.apache.tinkerpop.gremlin.orientdb.OrientEdge.<init>(OrientEdge.java:39)
        at org.apache.tinkerpop.gremlin.orientdb.OrientEdge.<init>(OrientEdge.java:48)
        at org.apache.tinkerpop.gremlin.orientdb.OElementFactory.wrapEdge(OElementFactory.java:18)
        at org.apache.tinkerpop.gremlin.orientdb.OrientVertex.lambda$edges$8(OrientVertex.java:131)
        at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
        at java.util.Iterator.forEachRemaining(Iterator.java:116)
        at java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1801)
        at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
        at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
        at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
        at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
        at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
        at org.apache.tinkerpop.gremlin.orientdb.OrientVertex.edges(OrientVertex.java:133)
        at org.apache.tinkerpop.gremlin.process.traversal.step.map.VertexStep.flatMap(VertexStep.java:55)
        at org.apache.tinkerpop.gremlin.process.traversal.step.map.FlatMapStep.processNextStart(FlatMapStep.java:49)
        at org.apache.tinkerpop.gremlin.process.traversal.step.util.AbstractStep.hasNext(AbstractStep.java:143)
        at org.apache.tinkerpop.gremlin.process.traversal.step.util.ExpandableStepIterator.hasNext(ExpandableStepIterator.java:42)
        at org.apache.tinkerpop.gremlin.process.traversal.step.util.ReducingBarrierStep.processAllStarts(ReducingBarrierStep.java:83)
        at org.apache.tinkerpop.gremlin.process.traversal.step.util.ReducingBarrierStep.processNextStart(ReducingBarrierStep.java:113)
        at org.apache.tinkerpop.gremlin.process.traversal.step.util.AbstractStep.hasNext(AbstractStep.java:143)
        at org.apache.tinkerpop.gremlin.process.traversal.util.DefaultTraversal.hasNext(DefaultTraversal.java:192)
        at org.apache.tinkerpop.gremlin.orientdb.executor.OGremlinScriptResultSet.hasNext(OGremlinScriptResultSet.java:37)
        at com.orientechnologies.orient.core.sql.parser.OLocalResultSetLifecycleDecorator.hasNext(OLocalResultSetLifecycleDecorator.java:44)
        at com.orientechnologies.orient.server.network.protocol.http.command.post.OServerCommandPostCommand.execute(OServerCommandPostCommand.java:92)
        at com.orientechnologies.orient.server.network.protocol.http.command.post.OServerCommandPostCommandGraph.execute(OServerCommandPostCommandGraph.java:36)
        at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.service(ONetworkProtocolHttpAbstract.java:172)
        at com.orientechnologies.orient.server.network.protocol.http.ONetworkProtocolHttpAbstract.execute(ONetworkProtocolHttpAbstract.java:633)
        at com.orientechnologies.common.thread.OSoftThread.run(OSoftThread.java:82)

Steps to reproduce

We can't seem to reproduce this but there were some rollback transactions that failed, that may have caused this. We tried running repair database command which did return this

The only thing it did was in the exception returned one of the vertex which was deleted but was showing up like this:

Internal server error:
java.lang.NullPointerException: out vertex on edge COMPONENT_OF#89:7648{out:#44:7642,in:#45:2} v1 

changed to 

 java.lang.NullPointerException: out vertex on edge COMPONENT_OF#89:7648{out:null,in:#45:2} v2 

that is I think it just cleared the dead vertices lying around but apparently was not able to clear the reference of the dead edge on this main vertex.

Any help is appreciated. Thanks.

luigidellaquila commented 5 years ago

HI @anukul-mohil

The problem here is that your DB contains a broken edge: #89:7648{out:null,in:#45:2}

What I can suggest is to run a DELETE EDGE #89:7648 from Studio. If it fails, you can manually check record #45:2 (from Studio) and see if it points to the edge, detach it manually using plain SQL and delete the edge with DELETE #89:7648 UNSAFE

It would be interesting to understand how it happened, but I don't know how easy it is. What I can suggest in general is to upgrade to v 3.0.9, as it contains a lot of bug fixes

Thanks

Luigi

anukul-mohil commented 5 years ago

Thanks @luigidellaquila for your quick response. Deleting the edge fixes it.

As for the cause of this, we got tons of errors like the one below which we suspect landed the database in an inconsistent state. Notice that we got all of these messages when running in distributed mode and receiving concurrent requests. They seem to go away when all queries are fired on just one node.

com.orientechnologies.orient.core.exception.OPaginatedClusterException: Error during record creation
    DB name="my_db"
    Component Name="edits_1"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.createRecord(OPaginatedCluster.java:517)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.doCreateRecord(OAbstractPaginatedStorage.java:4301)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitEntry(OAbstractPaginatedStorage.java:4921)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2145)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitPreAllocated(OAbstractPaginatedStorage.java:1999)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.internalCommit2pc(ODatabaseDocumentDistributed.java:638)
    at com.orientechnologies.orient.server.distributed.impl.ONewDistributedTxContextImpl.commit(ONewDistributedTxContextImpl.java:74)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.commit2pc(ODatabaseDocumentDistributed.java:608)
    at com.orientechnologies.orient.server.distributed.impl.task.OTransactionPhase2Task.execute(OTransactionPhase2Task.java:85)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin$1.call(ODistributedAbstractPlugin.java:613)
    at com.orientechnologies.orient.core.db.OScenarioThreadLocal.executeAsDistributed(OScenarioThreadLocal.java:69)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin.executeOnLocalNode(ODistributedAbstractPlugin.java:609)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.onMessage(ODistributedWorker.java:347)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.run(ODistributedWorker.java:121)
Caused by: com.orientechnologies.orient.core.exception.OClusterPositionMapException: Error of update of mapping between logical adn physical record position
    DB name="my_db"
    Component Name="edits_1"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMap.update(OClusterPositionMap.java:310)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.createRecord(OPaginatedCluster.java:504)
    ... 13 more
Caused by: com.orientechnologies.orient.core.exception.OStorageException: Provided index 1336 is out of range
    DB name="my_db"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMapBucket.set(OClusterPositionMapBucket.java:98)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMap.update(OClusterPositionMap.java:302)
    ... 14 more
Exception `16E18EED` in storage `plocal:/graphdb/orientdb-tp3-3.0.4/databases/my_db`: 3.0.4 - Veloce (build 4578b51f72a55feaa0852bc8ddd52929011d956c, branch 3.0.x)
com.orientechnologies.orient.core.exception.OPaginatedClusterException: Error during record deletion
    DB name="my_db"
    Component Name="edits_1"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.deleteRecord(OPaginatedCluster.java:856)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.doCreateRecord(OAbstractPaginatedStorage.java:4318)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitEntry(OAbstractPaginatedStorage.java:4921)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2145)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitPreAllocated(OAbstractPaginatedStorage.java:1999)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.internalCommit2pc(ODatabaseDocumentDistributed.java:638)
    at com.orientechnologies.orient.server.distributed.impl.ONewDistributedTxContextImpl.commit(ONewDistributedTxContextImpl.java:74)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.commit2pc(ODatabaseDocumentDistributed.java:608)
    at com.orientechnologies.orient.server.distributed.impl.task.OTransactionPhase2Task.execute(OTransactionPhase2Task.java:85)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin$1.call(ODistributedAbstractPlugin.java:613)
    at com.orientechnologies.orient.core.db.OScenarioThreadLocal.executeAsDistributed(OScenarioThreadLocal.java:69)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin.executeOnLocalNode(ODistributedAbstractPlugin.java:609)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.onMessage(ODistributedWorker.java:347)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.run(ODistributedWorker.java:121)
Caused by: com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.ONestedRollbackException: Atomic operation was rolled back by internal component, exception which caused this rollback is :
com.orientechnologies.orient.core.exception.OPaginatedClusterException: Error during record creation
    DB name="my_db"
    Component Name="edits_1"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.createRecord(OPaginatedCluster.java:517)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.doCreateRecord(OAbstractPaginatedStorage.java:4301)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitEntry(OAbstractPaginatedStorage.java:4921)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2145)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitPreAllocated(OAbstractPaginatedStorage.java:1999)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.internalCommit2pc(ODatabaseDocumentDistributed.java:638)
    at com.orientechnologies.orient.server.distributed.impl.ONewDistributedTxContextImpl.commit(ONewDistributedTxContextImpl.java:74)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.commit2pc(ODatabaseDocumentDistributed.java:608)
    at com.orientechnologies.orient.server.distributed.impl.task.OTransactionPhase2Task.execute(OTransactionPhase2Task.java:85)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin$1.call(ODistributedAbstractPlugin.java:613)
    at com.orientechnologies.orient.core.db.OScenarioThreadLocal.executeAsDistributed(OScenarioThreadLocal.java:69)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin.executeOnLocalNode(ODistributedAbstractPlugin.java:609)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.onMessage(ODistributedWorker.java:347)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.run(ODistributedWorker.java:121)
Caused by: com.orientechnologies.orient.core.exception.OClusterPositionMapException: Error of update of mapping between logical adn physical record position
    DB name="my_db"
    Component Name="edits_1"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMap.update(OClusterPositionMap.java:310)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.createRecord(OPaginatedCluster.java:504)
    ... 13 more
Caused by: com.orientechnologies.orient.core.exception.OStorageException: Provided index 1336 is out of range
    DB name="my_db"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMapBucket.set(OClusterPositionMapBucket.java:98)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMap.update(OClusterPositionMap.java:302)
    ... 14 more

    DB name="my_db"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.endAtomicOperation(OAtomicOperationsManager.java:393)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.base.ODurableComponent.endAtomicOperation(ODurableComponent.java:107)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMap.remove(OClusterPositionMap.java:414)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.deleteRecord(OPaginatedCluster.java:849)
    ... 13 more
Error on creating record in cluster: plocal cluster: edits_1
com.orientechnologies.orient.core.exception.OPaginatedClusterException: Error during record creation
    DB name="my_db"
    Component Name="edits_1"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.createRecord(OPaginatedCluster.java:517)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.doCreateRecord(OAbstractPaginatedStorage.java:4301)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitEntry(OAbstractPaginatedStorage.java:4921)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2145)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitPreAllocated(OAbstractPaginatedStorage.java:1999)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.internalCommit2pc(ODatabaseDocumentDistributed.java:638)
    at com.orientechnologies.orient.server.distributed.impl.ONewDistributedTxContextImpl.commit(ONewDistributedTxContextImpl.java:74)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.commit2pc(ODatabaseDocumentDistributed.java:608)
    at com.orientechnologies.orient.server.distributed.impl.task.OTransactionPhase2Task.execute(OTransactionPhase2Task.java:85)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin$1.call(ODistributedAbstractPlugin.java:613)
    at com.orientechnologies.orient.core.db.OScenarioThreadLocal.executeAsDistributed(OScenarioThreadLocal.java:69)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin.executeOnLocalNode(ODistributedAbstractPlugin.java:609)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.onMessage(ODistributedWorker.java:347)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.run(ODistributedWorker.java:121)
Caused by: com.orientechnologies.orient.core.exception.OClusterPositionMapException: Error of update of mapping between logical adn physical record position
    DB name="my_db"
    Component Name="edits_1"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMap.update(OClusterPositionMap.java:310)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.createRecord(OPaginatedCluster.java:504)
    ... 13 more
Caused by: com.orientechnologies.orient.core.exception.OStorageException: Provided index 1337 is out of range
    DB name="my_db"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMapBucket.set(OClusterPositionMapBucket.java:98)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMap.update(OClusterPositionMap.java:302)
    ... 14 more
Exception `7E338C37` in storage `plocal:/graphdb/orientdb-tp3-3.0.4/databases/my_db`: 3.0.4 - Veloce (build 4578b51f72a55feaa0852bc8ddd52929011d956c, branch 3.0.x)
com.orientechnologies.orient.core.exception.OPaginatedClusterException: Error during record deletion
    DB name="my_db"
    Component Name="edits_1"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.deleteRecord(OPaginatedCluster.java:856)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.doCreateRecord(OAbstractPaginatedStorage.java:4318)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitEntry(OAbstractPaginatedStorage.java:4921)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2145)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitPreAllocated(OAbstractPaginatedStorage.java:1999)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.internalCommit2pc(ODatabaseDocumentDistributed.java:638)
    at com.orientechnologies.orient.server.distributed.impl.ONewDistributedTxContextImpl.commit(ONewDistributedTxContextImpl.java:74)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.commit2pc(ODatabaseDocumentDistributed.java:608)
    at com.orientechnologies.orient.server.distributed.impl.task.OTransactionPhase2Task.execute(OTransactionPhase2Task.java:85)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin$1.call(ODistributedAbstractPlugin.java:613)
    at com.orientechnologies.orient.core.db.OScenarioThreadLocal.executeAsDistributed(OScenarioThreadLocal.java:69)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin.executeOnLocalNode(ODistributedAbstractPlugin.java:609)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.onMessage(ODistributedWorker.java:347)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.run(ODistributedWorker.java:121)
Caused by: com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.ONestedRollbackException: Atomic operation was rolled back by internal component, exception which caused this rollback is :
com.orientechnologies.orient.core.exception.OPaginatedClusterException: Error during record creation
    DB name="my_db"
    Component Name="edits_1"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.createRecord(OPaginatedCluster.java:517)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.doCreateRecord(OAbstractPaginatedStorage.java:4301)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitEntry(OAbstractPaginatedStorage.java:4921)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2145)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitPreAllocated(OAbstractPaginatedStorage.java:1999)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.internalCommit2pc(ODatabaseDocumentDistributed.java:638)
    at com.orientechnologies.orient.server.distributed.impl.ONewDistributedTxContextImpl.commit(ONewDistributedTxContextImpl.java:74)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.commit2pc(ODatabaseDocumentDistributed.java:608)
    at com.orientechnologies.orient.server.distributed.impl.task.OTransactionPhase2Task.execute(OTransactionPhase2Task.java:85)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin$1.call(ODistributedAbstractPlugin.java:613)
    at com.orientechnologies.orient.core.db.OScenarioThreadLocal.executeAsDistributed(OScenarioThreadLocal.java:69)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin.executeOnLocalNode(ODistributedAbstractPlugin.java:609)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.onMessage(ODistributedWorker.java:347)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.run(ODistributedWorker.java:121)
Caused by: com.orientechnologies.orient.core.exception.OClusterPositionMapException: Error of update of mapping between logical adn physical record position
    DB name="my_db"
    Component Name="edits_1"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMap.update(OClusterPositionMap.java:310)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.createRecord(OPaginatedCluster.java:504)
    ... 13 more
Caused by: com.orientechnologies.orient.core.exception.OStorageException: Provided index 1337 is out of range
    DB name="my_db"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMapBucket.set(OClusterPositionMapBucket.java:98)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMap.update(OClusterPositionMap.java:302)
    ... 14 more

    DB name="my_db"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.endAtomicOperation(OAtomicOperationsManager.java:393)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.base.ODurableComponent.endAtomicOperation(ODurableComponent.java:107)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMap.remove(OClusterPositionMap.java:414)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.deleteRecord(OPaginatedCluster.java:849)
    ... 13 more
Error on creating record in cluster: plocal cluster: edits_1
com.orientechnologies.orient.core.exception.OPaginatedClusterException: Error during record creation
    DB name="my_db"
    Component Name="edits_1"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.createRecord(OPaginatedCluster.java:517)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.doCreateRecord(OAbstractPaginatedStorage.java:4301)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitEntry(OAbstractPaginatedStorage.java:4921)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2145)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitPreAllocated(OAbstractPaginatedStorage.java:1999)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.internalCommit2pc(ODatabaseDocumentDistributed.java:638)
    at com.orientechnologies.orient.server.distributed.impl.ONewDistributedTxContextImpl.commit(ONewDistributedTxContextImpl.java:74)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.commit2pc(ODatabaseDocumentDistributed.java:608)
    at com.orientechnologies.orient.server.distributed.impl.task.OTransactionPhase2Task.execute(OTransactionPhase2Task.java:85)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin$1.call(ODistributedAbstractPlugin.java:613)
    at com.orientechnologies.orient.core.db.OScenarioThreadLocal.executeAsDistributed(OScenarioThreadLocal.java:69)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin.executeOnLocalNode(ODistributedAbstractPlugin.java:609)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.onMessage(ODistributedWorker.java:347)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.run(ODistributedWorker.java:121)
Caused by: com.orientechnologies.orient.core.exception.OClusterPositionMapException: Error of update of mapping between logical adn physical record position
    DB name="my_db"
    Component Name="edits_1"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMap.update(OClusterPositionMap.java:310)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.createRecord(OPaginatedCluster.java:504)
    ... 13 more
Caused by: com.orientechnologies.orient.core.exception.OStorageException: Provided index 1338 is out of range
    DB name="my_db"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMapBucket.set(OClusterPositionMapBucket.java:98)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMap.update(OClusterPositionMap.java:302)
    ... 14 more
Exception `71C53697` in storage `plocal:/graphdb/orientdb-tp3-3.0.4/databases/my_db`: 3.0.4 - Veloce (build 4578b51f72a55feaa0852bc8ddd52929011d956c, branch 3.0.x)
com.orientechnologies.orient.core.exception.OPaginatedClusterException: Error during record deletion
    DB name="my_db"
    Component Name="edits_1"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.deleteRecord(OPaginatedCluster.java:856)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.doCreateRecord(OAbstractPaginatedStorage.java:4318)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitEntry(OAbstractPaginatedStorage.java:4921)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2145)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitPreAllocated(OAbstractPaginatedStorage.java:1999)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.internalCommit2pc(ODatabaseDocumentDistributed.java:638)
    at com.orientechnologies.orient.server.distributed.impl.ONewDistributedTxContextImpl.commit(ONewDistributedTxContextImpl.java:74)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.commit2pc(ODatabaseDocumentDistributed.java:608)
    at com.orientechnologies.orient.server.distributed.impl.task.OTransactionPhase2Task.execute(OTransactionPhase2Task.java:85)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin$1.call(ODistributedAbstractPlugin.java:613)
    at com.orientechnologies.orient.core.db.OScenarioThreadLocal.executeAsDistributed(OScenarioThreadLocal.java:69)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin.executeOnLocalNode(ODistributedAbstractPlugin.java:609)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.onMessage(ODistributedWorker.java:347)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.run(ODistributedWorker.java:121)
Caused by: com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.ONestedRollbackException: Atomic operation was rolled back by internal component, exception which caused this rollback is :
com.orientechnologies.orient.core.exception.OPaginatedClusterException: Error during record creation
    DB name="my_db"
    Component Name="edits_1"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.createRecord(OPaginatedCluster.java:517)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.doCreateRecord(OAbstractPaginatedStorage.java:4301)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitEntry(OAbstractPaginatedStorage.java:4921)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commit(OAbstractPaginatedStorage.java:2145)
    at com.orientechnologies.orient.core.storage.impl.local.OAbstractPaginatedStorage.commitPreAllocated(OAbstractPaginatedStorage.java:1999)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.internalCommit2pc(ODatabaseDocumentDistributed.java:638)
    at com.orientechnologies.orient.server.distributed.impl.ONewDistributedTxContextImpl.commit(ONewDistributedTxContextImpl.java:74)
    at com.orientechnologies.orient.server.distributed.impl.ODatabaseDocumentDistributed.commit2pc(ODatabaseDocumentDistributed.java:608)
    at com.orientechnologies.orient.server.distributed.impl.task.OTransactionPhase2Task.execute(OTransactionPhase2Task.java:85)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin$1.call(ODistributedAbstractPlugin.java:613)
    at com.orientechnologies.orient.core.db.OScenarioThreadLocal.executeAsDistributed(OScenarioThreadLocal.java:69)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedAbstractPlugin.executeOnLocalNode(ODistributedAbstractPlugin.java:609)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.onMessage(ODistributedWorker.java:347)
    at com.orientechnologies.orient.server.distributed.impl.ODistributedWorker.run(ODistributedWorker.java:121)
Caused by: com.orientechnologies.orient.core.exception.OClusterPositionMapException: Error of update of mapping between logical adn physical record position
    DB name="my_db"
    Component Name="edits_1"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMap.update(OClusterPositionMap.java:310)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.createRecord(OPaginatedCluster.java:504)
    ... 13 more
Caused by: com.orientechnologies.orient.core.exception.OStorageException: Provided index 1338 is out of range
    DB name="my_db"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMapBucket.set(OClusterPositionMapBucket.java:98)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMap.update(OClusterPositionMap.java:302)
    ... 14 more

    DB name="my_db"
    at com.orientechnologies.orient.core.storage.impl.local.paginated.atomicoperations.OAtomicOperationsManager.endAtomicOperation(OAtomicOperationsManager.java:393)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.base.ODurableComponent.endAtomicOperation(ODurableComponent.java:107)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OClusterPositionMap.remove(OClusterPositionMap.java:414)
    at com.orientechnologies.orient.core.storage.impl.local.paginated.OPaginatedCluster.deleteRecord(OPaginatedCluster.java:849)
    ... 13 more

Do you have any ideas as to what might be causing this.