orientechnologies / orientdb

OrientDB is the most versatile DBMS supporting Graph, Document, Reactive, Full-Text and Geospatial models in one Multi-Model product. OrientDB can run distributed (Multi-Master), supports SQL, ACID Transactions, Full-Text indexing and Reactive Queries.
https://orientdb.dev
Apache License 2.0
4.74k stars 870 forks source link

Error deserializing record #6133

Closed kerner1000 closed 8 years ago

kerner1000 commented 8 years ago

WARNING: {db=XXX} Error deserializing record with id #15:5132 send this data for debugging: ABxSZWZlcmVuY2VfUGVhaxx1bmRlclRocmVzaG9sZAAAARQAHE5vcm1hbGl6ZWRBcmVhAAABFQU2/v//a0FyZWEAAAEdBSBSZXRlbnRpb25UaW1lTWluAAABJQEiUmV0ZW50aW9uVGltZVNlYzEAAAEpASJSZXRlbnRpb25UaW1lU2VjMgAAAS0BHFJldGVudGlvbkluZGV4AAABLwEmUGVha0ludGVuc2l0eVZhbHVlcwAAATEKHENsYXNzaWZpY2F0aW9uAAABdAcGSGl0AAABggcYTWFzc1NwZWN0cnVtAAABng0SU3Vic3RhbmNlAAABog0MT3JpZ2luAAABpA0YTGlicmFyeVBlYWtzAAABpg8AAD+wrI2Ib1pHQVLouQAAAAC8+fACwNPwAvwl6jwaFw0g8osIDSD0iwgNIPaLCA0g+IsIDSD6iwgNIPyLCA0g/osIDSCAjAgNIIKMCA0ghIwIDSCGjAgNIIiMCA0giowIGm4tL2lzby1BbGthbmU2RG9kZWNhbmUsIDIsNywxMC10cmltZXRoeWwtIqrwARwGGggCJqJP

wolf4ood commented 8 years ago

hi @kerner1000

can you write more info about this issue?

Which api do you use?

kerner1000 commented 8 years ago

Hi, i use Java Document API, version 2.1.16.

andrii0lomakin commented 8 years ago

Hi @kerner1000 , Was database created under this API, you it is an old database ?

kerner1000 commented 8 years ago

Hi, database was created using the same API and version.

andrii0lomakin commented 8 years ago

Well, that is strange. How did you discover that ? Which operations were done with this database ? Could you send us this database for analysis ?

tglman commented 8 years ago

hi @kerner1000,

you should have an additional log that show the stack trace of the problem, with the original exception, can you look for that and add it here .

Regards

kerner1000 commented 8 years ago

Hi @laa I will try to reproduce the problem and provide you with the database if possible. @tglman , where can I find this additional log? Best

kerner1000 commented 8 years ago

Hi all, I am able to reproduce the problem: WARNING: {db=XXX$test} Error deserializing record with id #15:5132 send this data for debugging: ABxSZWZlcmVuY2VfUGVhaxx1bmRlclRocmVzaG9sZAAAARQAHE5vcm1hbGl6ZWRBcmVhAAABFQU2/v//a0FyZWEAAAEdBSBSZXRlbnRpb25UaW1lTWluAAABJQEiUmV0ZW50aW9uVGltZVNlYzEAAAEpASJSZXRlbnRpb25UaW1lU2VjMgAAAS0BHFJldGVudGlvbkluZGV4AAABLwEmUGVha0ludGVuc2l0eVZhbHVlcwAAATEKHENsYXNzaWZpY2F0aW9uAAABdAcGSGl0AAABggcYTWFzc1NwZWN0cnVtAAABng0SU3Vic3RhbmNlAAABog0MT3JpZ2luAAABpA0YTGlicmFyeVBlYWtzAAABpg8AAD+wrI2Ib1pHQVLouQAAAAC8+fACwNPwAvwl6jwaFw0g8osIDSD0iwgNIPaLCA0g+IsIDSD6iwgNIPyLCA0g/osIDSCAjAgNIIKMCA0ghIwIDSCGjAgNIIiMCA0giowIGm4tL2lzby1BbGthbmU2RG9kZWNhbmUsIDIsNywxMC10cmltZXRoeWwtIqrwARwGGggCJqJP java.lang.ArrayIndexOutOfBoundsException: 620831314 at com.orientechnologies.orient.core.serialization.serializer.record.binary.OVarIntSerializer.readUnsignedVarLong(OVarIntSerializer.java:126) at com.orientechnologies.orient.core.serialization.serializer.record.binary.OVarIntSerializer.readSignedVarLong(OVarIntSerializer.java:102) at com.orientechnologies.orient.core.serialization.serializer.record.binary.OVarIntSerializer.readAsInteger(OVarIntSerializer.java:44) at com.orientechnologies.orient.core.serialization.serializer.record.binary.ORecordSerializerBinaryV0.readString(ORecordSerializerBinaryV0.java:767) at com.orientechnologies.orient.core.serialization.serializer.record.binary.ORecordSerializerBinaryV0.readSingleValue(ORecordSerializerBinaryV0.java:300) at com.orientechnologies.orient.core.serialization.serializer.record.binary.ORecordSerializerBinaryV0.deserializePartial(ORecordSerializerBinaryV0.java:139) at com.orientechnologies.orient.core.serialization.serializer.record.binary.ORecordSerializerBinary.fromStream(ORecordSerializerBinary.java:72) at com.orientechnologies.orient.core.record.impl.ODocument.deserializeFields(ODocument.java:1817) at com.orientechnologies.orient.core.record.impl.ODocument.checkForFields(ODocument.java:2416) at com.orientechnologies.orient.core.record.impl.ODocument.rawField(ODocument.java:767) at com.orientechnologies.orient.core.record.impl.ODocument.field(ODocument.java:792) at com.orientechnologies.orient.core.record.impl.ODocument.field(ODocument.java:842) at net.openchrom.chromatogram.xxd.identifier.supplier.xident.database.document.Documents.getInteger(Documents.java:102) at net.openchrom.chromatogram.xxd.identifier.supplier.xident.database.document.Documents.getInteger(Documents.java:109) at net.openchrom.chromatogram.xxd.identifier.supplier.xident.database.document.ReferencePeakDocuments.getRetentionTimeSec1(ReferencePeakDocuments.java:138) at net.openchrom.chromatogram.xxd.identifier.supplier.chromident.ui.nattable.DocumentWrapper3.getRetentionTimeSec1(DocumentWrapper3.java:153) at net.openchrom.chromatogram.xxd.identifier.supplier.chromident.ui.nattable.ColumnPropertyAccessorImpl.getDataValue(ColumnPropertyAccessorImpl.java:46) at net.openchrom.chromatogram.xxd.identifier.supplier.chromident.ui.nattable.ColumnPropertyAccessorImpl.getDataValue(ColumnPropertyAccessorImpl.java:1) at org.eclipse.nebula.widgets.nattable.data.ListDataProvider.getDataValue(ListDataProvider.java:51) at org.eclipse.nebula.widgets.nattable.layer.DataLayer.getDataValue(DataLayer.java:143) at org.eclipse.nebula.widgets.nattable.layer.DataLayer.getDataValueByPosition(DataLayer.java:424) at org.eclipse.nebula.widgets.nattable.layer.AbstractLayerTransform.getDataValueByPosition(AbstractLayerTransform.java:372) at org.eclipse.nebula.widgets.nattable.layer.AbstractLayerTransform.getDataValueByPosition(AbstractLayerTransform.java:372) at org.eclipse.nebula.widgets.nattable.layer.AbstractLayerTransform.getDataValueByPosition(AbstractLayerTransform.java:372) at org.eclipse.nebula.widgets.nattable.layer.AbstractLayerTransform.getDataValueByPosition(AbstractLayerTransform.java:372) at org.eclipse.nebula.widgets.nattable.layer.AbstractLayerTransform.getDataValueByPosition(AbstractLayerTransform.java:372) at org.eclipse.nebula.widgets.nattable.layer.AbstractIndexLayerTransform.getDataValueByPosition(AbstractIndexLayerTransform.java:381) at org.eclipse.nebula.widgets.nattable.layer.AbstractLayerTransform.getDataValueByPosition(AbstractLayerTransform.java:372) at org.eclipse.nebula.widgets.nattable.layer.CompositeLayer.getDataValueByPosition(CompositeLayer.java:600) at org.eclipse.nebula.widgets.nattable.layer.cell.AbstractLayerCell.getDataValue(AbstractLayerCell.java:64) at org.eclipse.nebula.widgets.nattable.layer.cell.CellDisplayConversionUtils.convertDataType(CellDisplayConversionUtils.java:21) at org.eclipse.nebula.widgets.nattable.painter.cell.AbstractTextPainter.convertDataType(AbstractTextPainter.java:175) at org.eclipse.nebula.widgets.nattable.painter.cell.TextPainter.paintCell(TextPainter.java:159) at org.eclipse.nebula.widgets.nattable.painter.cell.CellPainterWrapper.paintCell(CellPainterWrapper.java:73) at org.eclipse.nebula.widgets.nattable.painter.cell.decorator.LineBorderDecorator.paintCell(LineBorderDecorator.java:84) at org.eclipse.nebula.widgets.nattable.painter.layer.CellLayerPainter.paintCell(CellLayerPainter.java:230) at org.eclipse.nebula.widgets.nattable.painter.layer.CellLayerPainter.paintLayer(CellLayerPainter.java:88) at org.eclipse.nebula.widgets.nattable.painter.layer.GridLineCellLayerPainter.paintLayer(GridLineCellLayerPainter.java:116) at org.eclipse.nebula.widgets.nattable.selection.SelectionLayerPainter.paintLayer(SelectionLayerPainter.java:109) at org.eclipse.nebula.widgets.nattable.layer.CompositeLayer$CompositeLayerPainter.paintLayer(CompositeLayer.java:993) at org.eclipse.nebula.widgets.nattable.painter.layer.NatLayerPainter.paintLayer(NatLayerPainter.java:47) at org.eclipse.nebula.widgets.nattable.NatTable.paintNatTable(NatTable.java:453) at org.eclipse.nebula.widgets.nattable.NatTable.paintControl(NatTable.java:448) at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:230) at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84) at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4481) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1329) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1353) at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1338) at org.eclipse.swt.widgets.Control.gtk_expose_event(Control.java:3250) at org.eclipse.swt.widgets.Composite.gtk_expose_event(Composite.java:760) at org.eclipse.swt.widgets.Canvas.gtk_expose_event(Canvas.java:181) at org.eclipse.swt.widgets.Widget.windowProc(Widget.java:1973) at org.eclipse.swt.widgets.Control.windowProc(Control.java:5685) at org.eclipse.swt.widgets.Display.windowProc(Display.java:4717) at org.eclipse.swt.internal.gtk.OS._gtk_main_do_event(Native Method) at org.eclipse.swt.internal.gtk.OS.gtk_main_do_event(OS.java:9326) at org.eclipse.swt.widgets.Display.eventProc(Display.java:1225) at org.eclipse.swt.internal.gtk.OS._g_main_context_iteration(Native Method) at org.eclipse.swt.internal.gtk.OS.g_main_context_iteration(OS.java:2435) at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3428) at org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$4.run(PartRenderingEngine.java:1127) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:337) at org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1018) at org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:156) at org.eclipse.ui.internal.Workbench$5.run(Workbench.java:694) at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:337) at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:606) at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150) at org.eclipse.chemclipse.rcp.app.ui.internal.support.ApplicationSupport.startGraphicalContext(ApplicationSupport.java:118) at org.eclipse.chemclipse.rcp.app.ui.internal.support.ApplicationSupport.start(ApplicationSupport.java:92) at org.eclipse.chemclipse.rcp.app.ui.Application.start(Application.java:34) at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134) at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380) at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:669) at org.eclipse.equinox.launcher.Main.basicRun(Main.java:608) at org.eclipse.equinox.launcher.Main.run(Main.java:1515) at org.eclipse.equinox.launcher.Main.main(Main.java:1488)

I can provide you with the db if needed/ wanted. Many thanks! Best

andrii0lomakin commented 8 years ago

Hi , Would be better if you provide us steps how to reproduce issue then. Looking forward to see them ))

kerner1000 commented 8 years ago

@laa , just read the document to reproduce. But of course I cannot tell you how it happened to write it in the first place, sorry.

andrii0lomakin commented 8 years ago

Hi, Could you explain how did you use it ? Did you discover it after you have used database for some time or you discovered it just after initial data load ? Did you use database in single thread or multi threading mode ? Could you provide full log of your database . You may find it in log directory .

вс, 15 мая 2016, 15:49 Kerner notifications@github.com:

@laa https://github.com/laa , just read the document to reproduce. But of course I cannot tell you how it happened to write it in the first place, sorry.

— You are receiving this because you were mentioned.

Reply to this email directly or view it on GitHub https://github.com/orientechnologies/orientdb/issues/6133#issuecomment-219284005

Best regards, Andrey Lomakin, R&D lead. OrientDB Ltd

twitter: @Andrey_Lomakin linkedin: https://ua.linkedin.com/in/andreylomakin blogger: http://andreylomakin.blogspot.com/

tglman commented 8 years ago

hi @kerner1000,

can you run on your database select from #0:1 and post the result json here, or in a gist, is really important for us for debug properly, be aware that that json result is your schema informations.

Regards

kerner1000 commented 8 years ago

`{ "result": [ { "@type": "d", "@rid": "#0:1", "@version": 91, "schemaVersion": 4, "globalProperties": [ { "@type": "d", "@version": 0, "name": "name", "type": "STRING", "id": 0 }, { "@type": "d", "@version": 0, "name": "mode", "type": "BYTE", "id": 1 }, { "@type": "d", "@version": 0, "name": "rules", "type": "EMBEDDEDMAP", "id": 2 }, { "@type": "d", "@version": 0, "name": "inheritedRole", "type": "LINK", "id": 3 }, { "@type": "d", "@version": 0, "name": "password", "type": "STRING", "id": 4 }, { "@type": "d", "@version": 0, "name": "roles", "type": "LINKSET", "id": 5 }, { "@type": "d", "@version": 0, "name": "status", "type": "STRING", "id": 6 }, { "@type": "d", "@version": 0, "name": "_allow", "type": "LINKSET", "id": 7 }, { "@type": "d", "@version": 0, "name": "_allowRead", "type": "LINKSET", "id": 8 }, { "@type": "d", "@version": 0, "name": "_allowUpdate", "type": "LINKSET", "id": 9 }, { "@type": "d", "@version": 0, "name": "_allowDelete", "type": "LINKSET", "id": 10 }, { "@type": "d", "@version": 0, "name": "code", "type": "STRING", "id": 11 }, { "@type": "d", "@version": 0, "name": "language", "type": "STRING", "id": 12 }, { "@type": "d", "@version": 0, "name": "idempotent", "type": "BOOLEAN", "id": 13 }, { "@type": "d", "@version": 0, "name": "parameters", "type": "EMBEDDEDLIST", "id": 14 }, { "@type": "d", "@version": 0, "name": "rule", "type": "STRING", "id": 15 }, { "@type": "d", "@version": 0, "name": "arguments", "type": "EMBEDDEDMAP", "id": 16 }, { "@type": "d", "@version": 0, "name": "function", "type": "LINK", "id": 17 }, { "@type": "d", "@version": 0, "name": "starttime", "type": "DATETIME", "id": 18 }, { "@type": "d", "@version": 0, "name": "start", "type": "BOOLEAN", "id": 19 }, { "@type": "d", "@version": 0, "name": "ReferenceMassSpectra", "type": "EMBEDDEDSET", "id": 20 }, { "@type": "d", "@version": 0, "name": "Substances", "type": "EMBEDDEDSET", "id": 21 }, { "@type": "d", "@version": 0, "name": "MassSpectrum", "type": "LONG", "id": 22 }, { "@type": "d", "@version": 0, "name": "Classifications", "type": "EMBEDDEDSET", "id": 23 }, { "@type": "d", "@version": 0, "name": "IsIncluded", "type": "BOOLEAN", "id": 24 }, { "@type": "d", "@version": 0, "name": "PeakIdentification", "type": "LONG", "id": 25 }, { "@type": "d", "@version": 0, "name": "Ions", "type": "EMBEDDEDMAP", "id": 26 }, { "@type": "d", "@version": 0, "name": "RetentionTime", "type": "INTEGER", "id": 27 }, { "@type": "d", "@version": 0, "name": "RetentionIndex", "type": "FLOAT", "id": 28 }, { "@type": "d", "@version": 0, "name": "RetentionTimeColumn1", "type": "INTEGER", "id": 29 }, { "@type": "d", "@version": 0, "name": "RetentionTimeColumn2", "type": "INTEGER", "id": 30 } ], "classes": [ { "@type": "d", "@version": 0, "name": "ORole", "shortName": null, "defaultClusterId": 4, "clusterIds": [ 4 ], "clusterSelection": "round-robin", "overSize": 0, "strictMode": false, "abstract": false, "properties": [ { "@type": "d", "@version": 0, "name": "rules", "type": 12, "globalId": 2, "mandatory": false, "readonly": false, "notNull": false, "defaultValue": null, "min": null, "max": null, "regexp": null, "linkedType": 17, "customFields": null, "collate": "default" }, { "@type": "d", "@version": 0, "name": "mode", "type": 17, "globalId": 1, "mandatory": false, "readonly": false, "notNull": false, "defaultValue": null, "min": null, "max": null, "regexp": null, "customFields": null, "collate": "default" }, { "@type": "d", "@version": 0, "name": "inheritedRole", "type": 13, "globalId": 3, "mandatory": false, "readonly": false, "notNull": false, "defaultValue": null, "min": null, "max": null, "regexp": null, "linkedClass": "ORole", "customFields": null, "collate": "default" }, { "@type": "d", "@version": 0, "name": "name", "type": 7, "globalId": 0, "mandatory": true, "readonly": false, "notNull": true, "defaultValue": null, "min": null, "max": null, "regexp": null, "customFields": null, "collate": "ci" } ], "superClass": "OIdentity", "superClasses": [ "OIdentity" ], "customFields": null, "@fieldTypes": "overSize=f,properties=e" }, { "@type": "d", "@version": 0, "name": "ChromIdent_MassSpectrum", "shortName": null, "defaultClusterId": 17, "clusterIds": [ 17 ], "clusterSelection": "round-robin", "overSize": 0, "strictMode": false, "abstract": false, "properties": [

                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "MassSpectrum",
                "shortName": null,
                "defaultClusterId": 12,
                "clusterIds": [
                    12
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": false,
                "properties": [
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "RetentionTimeColumn2",
                        "type": 1,
                        "globalId": 30,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "Ions",
                        "type": 12,
                        "globalId": 26,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "RetentionTime",
                        "type": 1,
                        "globalId": 27,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "RetentionIndex",
                        "type": 4,
                        "globalId": 28,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "RetentionTimeColumn1",
                        "type": 1,
                        "globalId": 29,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    }
                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "ORestricted",
                "shortName": null,
                "defaultClusterId": -1,
                "clusterIds": [
                    -1
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": true,
                "properties": [
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "_allowUpdate",
                        "type": 15,
                        "globalId": 9,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "linkedClass": "OIdentity",
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "_allowDelete",
                        "type": 15,
                        "globalId": 10,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "linkedClass": "OIdentity",
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "_allowRead",
                        "type": 15,
                        "globalId": 8,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "linkedClass": "OIdentity",
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "_allow",
                        "type": 15,
                        "globalId": 7,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "linkedClass": "OIdentity",
                        "customFields": null,
                        "collate": "default"
                    }
                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "ORIDs",
                "shortName": null,
                "defaultClusterId": 8,
                "clusterIds": [
                    8
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": false,
                "properties": [

                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "_studio",
                "shortName": null,
                "defaultClusterId": 20,
                "clusterIds": [
                    20
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": false,
                "properties": [

                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "Reference_Peak",
                "shortName": null,
                "defaultClusterId": 15,
                "clusterIds": [
                    15
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": false,
                "properties": [

                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "ChromIdent_LibraryPeakDocument",
                "shortName": null,
                "defaultClusterId": 19,
                "clusterIds": [
                    19
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": false,
                "properties": [

                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "OTriggered",
                "shortName": null,
                "defaultClusterId": -1,
                "clusterIds": [
                    -1
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": true,
                "properties": [

                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "ChromIdent_Origin",
                "shortName": null,
                "defaultClusterId": 13,
                "clusterIds": [
                    13
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": false,
                "properties": [

                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "OSchedule",
                "shortName": null,
                "defaultClusterId": 7,
                "clusterIds": [
                    7
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": false,
                "properties": [
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "name",
                        "type": 7,
                        "globalId": 0,
                        "mandatory": true,
                        "readonly": false,
                        "notNull": true,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "start",
                        "type": 0,
                        "globalId": 19,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "function",
                        "type": 13,
                        "globalId": 17,
                        "mandatory": true,
                        "readonly": false,
                        "notNull": true,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "linkedClass": "OFunction",
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "status",
                        "type": 7,
                        "globalId": 6,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "arguments",
                        "type": 12,
                        "globalId": 16,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "rule",
                        "type": 7,
                        "globalId": 15,
                        "mandatory": true,
                        "readonly": false,
                        "notNull": true,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "starttime",
                        "type": 6,
                        "globalId": 18,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    }
                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "ChromIdent_Ion",
                "shortName": null,
                "defaultClusterId": 18,
                "clusterIds": [
                    18
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": false,
                "properties": [

                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "OFunction",
                "shortName": null,
                "defaultClusterId": 6,
                "clusterIds": [
                    6
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": false,
                "properties": [
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "code",
                        "type": 7,
                        "globalId": 11,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "parameters",
                        "type": 10,
                        "globalId": 14,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "linkedType": 7,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "name",
                        "type": 7,
                        "globalId": 0,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "idempotent",
                        "type": 0,
                        "globalId": 13,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "language",
                        "type": 7,
                        "globalId": 12,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    }
                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "ChromIdent_IntensityValues",
                "shortName": null,
                "defaultClusterId": 16,
                "clusterIds": [
                    16
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": false,
                "properties": [

                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "ChromIdent_Substance",
                "shortName": null,
                "defaultClusterId": 14,
                "clusterIds": [
                    14
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": false,
                "properties": [

                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "OUser",
                "shortName": null,
                "defaultClusterId": 5,
                "clusterIds": [
                    5
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": false,
                "properties": [
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "roles",
                        "type": 15,
                        "globalId": 5,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "linkedClass": "ORole",
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "password",
                        "type": 7,
                        "globalId": 4,
                        "mandatory": true,
                        "readonly": false,
                        "notNull": true,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "status",
                        "type": 7,
                        "globalId": 6,
                        "mandatory": true,
                        "readonly": false,
                        "notNull": true,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "name",
                        "type": 7,
                        "globalId": 0,
                        "mandatory": true,
                        "readonly": false,
                        "notNull": true,
                        "defaultValue": null,
                        "min": "1",
                        "max": null,
                        "regexp": "\\S+(.*\\S+)*",
                        "customFields": null,
                        "collate": "ci"
                    }
                ],
                "superClass": "OIdentity",
                "superClasses": [
                    "OIdentity"
                ],
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "LibraryDescription",
                "shortName": null,
                "defaultClusterId": 9,
                "clusterIds": [
                    9
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": false,
                "properties": [

                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "OIdentity",
                "shortName": null,
                "defaultClusterId": -1,
                "clusterIds": [
                    -1
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": true,
                "properties": [

                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "LibraryRecord",
                "shortName": null,
                "defaultClusterId": 11,
                "clusterIds": [
                    11
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": false,
                "properties": [
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "Classifications",
                        "type": 11,
                        "globalId": 23,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "linkedType": 3,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "IsIncluded",
                        "type": 0,
                        "globalId": 24,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "MassSpectrum",
                        "type": 3,
                        "globalId": 22,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "ReferenceMassSpectra",
                        "type": 11,
                        "globalId": 20,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "linkedType": 3,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "Substances",
                        "type": 11,
                        "globalId": 21,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "linkedType": 3,
                        "customFields": null,
                        "collate": "default"
                    },
                    {
                        "@type": "d",
                        "@version": 0,
                        "name": "PeakIdentification",
                        "type": 3,
                        "globalId": 25,
                        "mandatory": false,
                        "readonly": false,
                        "notNull": false,
                        "defaultValue": null,
                        "min": null,
                        "max": null,
                        "regexp": null,
                        "customFields": null,
                        "collate": "default"
                    }
                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            },
            {
                "@type": "d",
                "@version": 0,
                "name": "Settings",
                "shortName": null,
                "defaultClusterId": 10,
                "clusterIds": [
                    10
                ],
                "clusterSelection": "round-robin",
                "overSize": 0,
                "strictMode": false,
                "abstract": false,
                "properties": [

                ],
                "superClass": null,
                "superClasses": null,
                "customFields": null,
                "@fieldTypes": "overSize=f,properties=e"
            }
        ],
        "@fieldTypes": "classes=e"
    }
],
"notification": "Query executed in 0.037 sec. Returned 1 record(s)"

}`

tglman commented 8 years ago

hi @kerner1000,

I just read now that you can send us the db, that will be realy helpful, and actually from the debugging i've done til now it seems that we need it.

Regards

kerner1000 commented 8 years ago

Hi @tglman , you can download the db here.

tglman commented 8 years ago

hi @kerner1000,

We got the database and we identified the broken record, now we are trying to understand the root cause of this problem, a couple or thing that may help as on the investigation, did you use Tx or noTx for do operation on the database? did you disable the wal or used any tooning like massive insert intent ?

we will try to come back as soon as we have info.

Regards

kerner1000 commented 8 years ago

HI, I use instances of ODatabaseDocumentTx but no explicit transactions. Also no intents used. Best

andrii0lomakin commented 8 years ago

@kerner1000 do you have any database log files before the date when exception was thrown ?

kerner1000 commented 8 years ago

@laa , if you tell me some logs are created by default and if you tell me in what directory, I can have a look.

kerner1000 commented 8 years ago

If I remember correctly, the exception was first thrown when cancelled a db import and clearing the cache right after. So maybe its related to the caching mechanism.

andrii0lomakin commented 8 years ago

Hi @kerner1000 , could you be more specific: What does it mean ?

  1. When canceled a db import.
  2. Clearing the cache right after

How did you perform those actions ?

andrii0lomakin commented 8 years ago

About log files, they are stored under directory <db folder>/log . Could you send them too ?

kerner1000 commented 8 years ago

cancelling a db import has nothing to to with the db itself. It was just a long running, mainly writing import job that i canceled. After, I called db.getLocalCache().clear() as proposed here.

You guys have the complete DB folder available, as I zipped it and shared it here. (But I cannot see any log file..)

andrii0lomakin commented 8 years ago

@kerner1000 what do you mean "job that i canceled." , how did you do that ?

andrii0lomakin commented 8 years ago

@kerner1000 I mean not database itself but server or application folder if you use embedded version of database.

kerner1000 commented 8 years ago

I mean I just cancelled the import job. This was only in the application. It would stop to write documents to the db.

I will try to find this folder.

andrii0lomakin commented 8 years ago

@kerner1000 was it standalone application with embedded database or you used remote connection ? How did you cancel the application by sending kill signal ?

kerner1000 commented 8 years ago

Hi its a local DB inside an Eclipse RCP application. I 'cancel' the import job by 'break'ing the for-loop, so as I said, its not really related to the db. I just mention it, because after stopping the import I immediately call db.getLocalCache().clear(). Im not sure if this is one possible source of error, right now its the only one I can think of.

PS: I did not find the log directory, sorry.

andrii0lomakin commented 8 years ago

@kerner1000 did you share database between multiple threads when this issue happened ? Because that is very typical cause of such problems.

kerner1000 commented 8 years ago

@laa , I used the programming 'pattern' which we where discussing here. Nevertheless, there is one performance hotspot in our application model where I tried parallel streams on a collection of documents. But I understood some time ago that this is not a good idea, so I stopped to do it. I cannot say for sure if I was using parallel streams when this issue here happened.

andrii0lomakin commented 8 years ago

@kerner1000 well I see. Let's delay this issue then for some time. If you will have the same problem with correct connection model, let me know.

andrii0lomakin commented 8 years ago

@kerner1000 because the cause of this bug may be in incorrect usage of DB connection, I close it. Feel free to reopen it if you reproduce the error.