We are experiencing issues when using SharedHashMap (collections-3.2.1) on Windows OS. Under certain circumstances the whole JVM crashes after inserting 10M items into the map. Following code can be used to reproduce the issue:

    @Test
public void crashJVMWindowsTest() throws IOException {
    final SharedHashMap<CharSequence, CharSequence> map = new SharedHashMapBuilder().entries(15_000_000)
        .minSegments(128).file(getPersistenceFile()).kClass(CharSequence.class).vClass(CharSequence.class).create();

    for (int i = 0; i < 10_000_000; ++i) {
        String s = String.valueOf(i);
        map.put(s, s);
    }       

    map.close();    
}

It seems there is an issue when a map segment is being locked:

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) j sun.misc.Unsafe.compareAndSwapLong(Ljava/lang/Object;JJJ)Z+0 j net.openhft.lang.io.NativeBytes.compareAndSwapLong(JJJ)Z+13 j net.openhft.lang.io.AbstractBytes.tryLockNanos8a(JJ)Z+12 j net.openhft.lang.io.AbstractBytes.tryLockNanosLong(JJ)Z+41 j net.openhft.collections.AbstractVanillaSharedHashMap$Segment.lock()V+12 j net.openhft.collections.AbstractVanillaSharedHashMap$Segment.put(Lnet/openhft/lang/io/Bytes;Ljava/lang/Object;Ljava/lang/Object;IZ)Ljava/lang/Object;+1 j net.openhft.collections.AbstractVanillaSharedHashMap.put0(Ljava/lang/Object;Ljava/lang/Object;Z)Ljava/lang/Object;+60 j net.openhft.collections.AbstractVanillaSharedHashMap.put(Ljava/lang/Object;Ljava/lang/Object;)Ljava/lang/Object;+4 j test.Test.crashTest()V+52 j test.Test.main([Ljava/lang/String;)V+0 v ~StubRoutines::call_stub

Environment: Windows 8.1 64-bit Java(TM) SE Runtime Environment (build 1.7.0_25-b17) Java HotSpot(TM) 64-Bit Server VM (build 23.25-b01, mixed mode)

We were not able to reproduce this issue on Unix-based OS.

Thanks for your help.

Hi Jaromirs The same happened to me in windows7, as soon as I set the entries() > 1_000_000 Shame as the shared map was exactly what I was looking for. BTW same happens with ChronicleMap recompile for 1.7

java version "1.7.0_07" Java(TM) SE Runtime Environment (build 1.7.0_07-b11) Java HotSpot(TM) 64-Bit Server VM (build 23.3-b01, mixed mode)

Hi Manuel,

Peter said the guys would look into this issue: https://groups.google.com/forum/?hl=en-GB#!topic/java-chronicle/dl4enNtqFVY

So hopefully the fix will be available soon.

Jaromir

Hi Manuel, Jaromir

Thanks for your feedback, we are very pleased you are using SharedHashMap and are grateful that you are contributing to our efforts to improve the quality of OpenHFT software.

It would enormously helpful to us if you could spend a few minutes answering the following questions:

We understand that people might have privacy concerns and that you might not want to answer all the questions. Please don't worry if that's the case. Also the more information we can gather the better but feel free to write one liners if you want! You can send the answers back to me on my private email daniel.shaya@higherfrequencytrading.com

What's the name of your company?
How many employees are there at the company?
Please describe the project in which OpenHFT software is being used and how it has helped.
Is it in evaluation or production?
Would you consider paying for a support model http://openhft.net/support/ which could include priority support, training, bespoke software changes.
How can we improve your experience with OpenHFT software?

Thanks Daniel

On Wed, Sep 17, 2014 at 10:01 AM, Jaromir Satanek notifications@github.com wrote:

Hi Manuel,

Peter said the guys would look into this issue: https://groups.google.com/forum/?hl=en-GB#!topic/java-chronicle/dl4enNtqFVY

So hopefully the fix will be available soon.

Jaromir

— Reply to this email directly or view it on GitHub https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55866920 .

Hi Daniel sure I am more than happy to share infos with you

Pivotal
1000+
I am writting a post processing standalone program that need to deal with 25+M of entries The goals is to process the entries, store them in a repository and then let other programs accessing them
Evaluation
not sure but why not :-)
Fixing my issue :-) ?

Thanks very much for your efforts, I thing this is a fantastic product

Regards, Manuel

On Wed, Sep 17, 2014 at 10:16 AM, danielshaya notifications@github.com wrote:

Hi Manuel, Jaromir

Thanks for your feedback, we are very pleased you are using SharedHashMap and are grateful that you are contributing to our efforts to improve the quality of OpenHFT software.

It would enormously helpful to us if you could spend a few minutes answering the following questions:

We understand that people might have privacy concerns and that you might not want to answer all the questions. Please don't worry if that's the case. Also the more information we can gather the better but feel free to write one liners if you want! You can send the answers back to me on my private email daniel.shaya@higherfrequencytrading.com

What's the name of your company?

How many employees are there at the company?

Please describe the project in which OpenHFT software is being used and how it has helped.

Is it in evaluation or production?

Would you consider paying for a support model http://openhft.net/support/ which could include priority support, training, bespoke software changes.

How can we improve your experience with OpenHFT software?

Thanks Daniel

On Wed, Sep 17, 2014 at 10:01 AM, Jaromir Satanek < notifications@github.com> wrote:

Hi Manuel,

Peter said the guys would look into this issue:

https://groups.google.com/forum/?hl=en-GB#!topic/java-chronicle/dl4enNtqFVY

So hopefully the fix will be available soon.

Jaromir

— Reply to this email directly or view it on GitHub < https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55866920>

.

— Reply to this email directly or view it on GitHub https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55868554 .

Thanks! Can I ask for a website address for Pivotal?

Please keep in touch and let us know if there's any further way in which we can be of assistance.

Rgds

On Wed, Sep 17, 2014 at 10:20 AM, ManuelPivotal notifications@github.com wrote:

Hi Daniel sure I am more than happy to share infos with you

Pivotal

1000+

I am writting a post processing standalone program that need to deal with 25+M of entries The goals is to process the entries, store them in a repository and then let other programs accessing them

Evaluation

not sure but why not :-)

Fixing my issue :-) ?

Thanks very much for your efforts, I thing this is a fantastic product

Regards, Manuel

On Wed, Sep 17, 2014 at 10:16 AM, danielshaya notifications@github.com wrote:

Hi Manuel, Jaromir

Thanks for your feedback, we are very pleased you are using SharedHashMap and are grateful that you are contributing to our efforts to improve the quality of OpenHFT software.

It would enormously helpful to us if you could spend a few minutes answering the following questions:

We understand that people might have privacy concerns and that you might not want to answer all the questions. Please don't worry if that's the case. Also the more information we can gather the better but feel free to write one liners if you want! You can send the answers back to me on my private email daniel.shaya@higherfrequencytrading.com

What's the name of your company?

How many employees are there at the company?

Please describe the project in which OpenHFT software is being used and how it has helped.

Is it in evaluation or production?

Would you consider paying for a support model http://openhft.net/support/ which could include priority support, training, bespoke software changes.

How can we improve your experience with OpenHFT software?

Thanks Daniel

On Wed, Sep 17, 2014 at 10:01 AM, Jaromir Satanek < notifications@github.com> wrote:

Hi Manuel,

Peter said the guys would look into this issue:

https://groups.google.com/forum/?hl=en-GB#!topic/java-chronicle/dl4enNtqFVY

So hopefully the fix will be available soon.

Jaromir

— Reply to this email directly or view it on GitHub <

https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55866920>

.

— Reply to this email directly or view it on GitHub < https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55868554>

.

— Reply to this email directly or view it on GitHub https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55868949 .

Hi Daniel,

DET Technologies (www.det-tech.com)
6
We develop a trading platform called DET Hub (http://www.det-tech.com/products.html). I am not sure if you remember but we met in January in London and gave you and Peter a short demonstration.
We are evaluating SharedHashMap, but we already use Chronicle Queue in prod.
Potentially in the future. We've pushed a few commits on GitHub ourselves.
The same as Manuel :-) But in general we are very satisfied with the products.

Regards, Jaromir

Thanks - yes I do remember - hope all is going well.

This is very helpful information.

Regards

On Wed, Sep 17, 2014 at 10:38 AM, Jaromir Satanek notifications@github.com wrote:

Hi Daniel,

DET Technologies (www.det-tech.com)

6

We develop a trading platform called DET Hub ( http://www.det-tech.com/products.html). I am not sure if you remember but we met in January in London and gave you and Peter a short demonstration.

We are evaluating SharedHashMap, but we already use Chronicle Queue in prod.

Potentially in the future. We've pushed a few commits on GitHub ourselves.

The same as Manuel :-) But in general we are very satisfied with the products.

Regards, Jaromir

— Reply to this email directly or view it on GitHub https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55870621 .

sure www.pivotal.io

Manuel

On Wed, Sep 17, 2014 at 10:30 AM, danielshaya notifications@github.com wrote:

Thanks! Can I ask for a website address for Pivotal?

Please keep in touch and let us know if there's any further way in which we can be of assistance.

Rgds

On Wed, Sep 17, 2014 at 10:20 AM, ManuelPivotal notifications@github.com

wrote:

Hi Daniel sure I am more than happy to share infos with you

Pivotal

1000+

I am writting a post processing standalone program that need to deal with 25+M of entries The goals is to process the entries, store them in a repository and then let other programs accessing them

Evaluation

not sure but why not :-)

Fixing my issue :-) ?

Thanks very much for your efforts, I thing this is a fantastic product

Regards, Manuel

On Wed, Sep 17, 2014 at 10:16 AM, danielshaya notifications@github.com

wrote:

Hi Manuel, Jaromir

Thanks for your feedback, we are very pleased you are using SharedHashMap and are grateful that you are contributing to our efforts to improve the quality of OpenHFT software.

It would enormously helpful to us if you could spend a few minutes answering the following questions:

We understand that people might have privacy concerns and that you might not want to answer all the questions. Please don't worry if that's the case. Also the more information we can gather the better but feel free to write one liners if you want! You can send the answers back to me on my private email daniel.shaya@higherfrequencytrading.com

What's the name of your company?

How many employees are there at the company?

Please describe the project in which OpenHFT software is being used and how it has helped.

Is it in evaluation or production?

Would you consider paying for a support model http://openhft.net/support/ which could include priority support, training, bespoke software changes.

How can we improve your experience with OpenHFT software?

Thanks Daniel

On Wed, Sep 17, 2014 at 10:01 AM, Jaromir Satanek < notifications@github.com> wrote:

Hi Manuel,

Peter said the guys would look into this issue:

https://groups.google.com/forum/?hl=en-GB#!topic/java-chronicle/dl4enNtqFVY

So hopefully the fix will be available soon.

Jaromir

— Reply to this email directly or view it on GitHub <

https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55866920>

.

— Reply to this email directly or view it on GitHub <

https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55868554>

.

— Reply to this email directly or view it on GitHub < https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55868949>

.

— Reply to this email directly or view it on GitHub https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55869859 .

Sorry for the delay in fixing this issue. This issue as now been assigned, so someone will start looking at it soon.

Rob

On 17 Sep 2014, at 04:46, ManuelPivotal notifications@github.com wrote:

Hi Jaromirs The same happened to me in windows7, as soon as I set the entries() > 1_000_000 Shame as the shared map was exactly what I was looking for. BTW same happens with ChronicleMap recompile for 1.7

java version "1.7.0_07" Java(TM) SE Runtime Environment (build 1.7.0_07-b11) Java HotSpot(TM) 64-Bit Server VM (build 23.3-b01, mixed mode)

— Reply to this email directly or view it on GitHub.

@jaromirs @ManuelPivotal I cannot reproduce the issue with locks during putting entries into so large, but succesfully constructed map. When I change the number of entries in Builder config and the insertion loop, the test is either finish succesfully or fail on map construction, obviously due to lack of memory.

Note that the default entrySize is 256, which is too much for the case: up to 8 bytes (7 bytes of data + 1 byte for writing data length) for key and value, 1 byte for writing key length and 1 for value length = 18 bytes is enough. See the test referenced in commit referencing this issue.

Windows allocates physical memory pages more eagerly than Linux, that may be the cause of the difference in behaviour on Linux and Windows. But I'm not sure, because I actually couldn't reproduce your crash scenario during locking.

Hi Roman Thanks for your asnwer May be it is a incorrect use on my side then?

The code crashing is

@Test public void bigMap() throws Exception { final long mapSize = 10_000_000; final String name = "/tmp/shm-test/myfile.dat"; File file = new File(name); if (file.exists()) { file.delete(); } final SharedHashMap<String, String> map = new SharedHashMapBuilder() .entries(mapSize) .minSegments(128) .file(file) .kClass(String.class) .vClass(String.class) .create(); for (long i = 0; i < mapSize; ++i) { String s = String.valueOf(i); map.put(s, s); if(i % 50_000 == 0) { System.out.println(String.format("Total put is %,d", totalPut)); } } }

and I've attached a minidump

I am on windows 7 enterprise, build 7601 SP1

On Wed, Sep 17, 2014 at 3:03 PM, Roman Leventov notifications@github.com wrote:

@jaromirs https://github.com/jaromirs @ManuelPivotal https://github.com/ManuelPivotal I cannot reproduce the issue with locks during putting entries into so large, but succesfully constructed map. When I change the number of entries in Builder config and the insertion loop, the test is either finish succesfully or fail on map construction, obviously due to lack of memory.

Note that the default entrySize is 256, which is too much for the case: up to 8 bytes (7 bytes of data + 1 byte for writing data length) for key and value, 1 byte for writing key length and 1 for value length = 18 bytes is enough. See the test referenced in commit referencing this issue.

Windows allocates physical memory pages more eagerly than Linux, that may be the cause of the difference in behaviour on Linux and Windows. But I'm not sure, because I actually couldn't reproduce your crash scenario during locking.

— Reply to this email directly or view it on GitHub https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55897799 .

Thanks for the sample code, we will try to reproduce the issue from this.

On 17 Sep 2014, at 10:31, ManuelPivotal notifications@github.com wrote:

Hi Roman Thanks for your asnwer May be it is a incorrect use on my side then?

The code crashing is

@Test public void bigMap() throws Exception { final long mapSize = 10_000_000; final String name = "/tmp/shm-test/myfile.dat"; File file = new File(name); if (file.exists()) { file.delete(); } final SharedHashMap<String, String> map = new SharedHashMapBuilder() .entries(mapSize) .minSegments(128) .file(file) .kClass(String.class) .vClass(String.class) .create(); for (long i = 0; i < mapSize; ++i) { String s = String.valueOf(i); map.put(s, s); if(i % 50_000 == 0) { System.out.println(String.format("Total put is %,d", totalPut)); } } }

and I've attached a minidump

I am on windows 7 enterprise, build 7601 SP1

On Wed, Sep 17, 2014 at 3:03 PM, Roman Leventov notifications@github.com wrote:

@jaromirs https://github.com/jaromirs @ManuelPivotal https://github.com/ManuelPivotal I cannot reproduce the issue with locks during putting entries into so large, but succesfully constructed map. When I change the number of entries in Builder config and the insertion loop, the test is either finish succesfully or fail on map construction, obviously due to lack of memory.

Note that the default entrySize is 256, which is too much for the case: up to 8 bytes (7 bytes of data + 1 byte for writing data length) for key and value, 1 byte for writing key length and 1 for value length = 18 bytes is enough. See the test referenced in commit referencing this issue.

Windows allocates physical memory pages more eagerly than Linux, that may be the cause of the difference in behaviour on Linux and Windows. But I'm not sure, because I actually couldn't reproduce your crash scenario during locking.

— Reply to this email directly or view it on GitHub https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55897799 .

— Reply to this email directly or view it on GitHub.

@ManuelPivotal your test performs equally uninteresting on my Windows machine: fail on map creation or success, depending on the map size. When I configured NO_ALIGNMENT and entrySize = 18 the map started to consume really not very much memory and the test finishes successfully even with map size = 10_000_000.

I don't see your attachment on github.

Here is my precise config from one of the crashed vm reports, if it is meaningful: --------------- S Y S T E M ---------------

OS: Windows 8.1 , 64 bit Build 9600

CPU:total 6 (6 cores per cpu, 1 threads per core) family 16 model 10 stepping 0, cmov, cx8, fxsr, mmx, sse, sse2, sse3, popcnt, mmxext, 3dnowpref, lzcnt, sse4a, tsc, tscinvbit

Memory: 4k page, physical 8386100k(4133016k free), swap 8386100k(2447272k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (25.5-b02) for windows-amd64 JRE (1.8.0_05-b13), built on Mar 18 2014 01:08:39 by "java_re" with MS VC++ 10.0 (VS2010)

@Roman Here is the dump, I suppose github get rid of it :-)

A fatal error has been detected by the Java Runtime Environment:

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000665d3d86,

pid=7196, tid=2744 #

JRE version: 7.0_07-b11

Java VM: Java HotSpot(TM) 64-Bit Server VM (23.3-b01 mixed mode

windows-amd64 compressed oops)

Problematic frame:

V [jvm.dll+0x193d86]

Failed to write core dump. Minidumps are not enabled by default on client

versions of Windows #

If you would like to submit a bug report, please visit:

http://bugreport.sun.com/bugreport/crash.jsp

--------------- T H R E A D ---------------

Current thread (0x00000000025ae800): JavaThread "main" [_thread_in_vm, id=2744, stack(0x00000000028b0000,0x00000000029b0000)]

siginfo: ExceptionCode=0xc0000005, reading address 0x00000000493f5d40

Registers: RAX=0x00000000025ae800, RBX=0x00000000025ae800, RCX=0x000000000000000c, RDX=0x00000000029adae8 RSP=0x00000000029ada10, RBP=0x00000000029adab8, RSI=0x00000000efa75065, RDI=0x00000000493f5d40 R8 =0x00000000493f5d40, R9 =0x00000007d730a128, R10=0x00000000029c237c, R11=0x0000000066602040 R12=0x0000000000000000, R13=0x000000077cad5240, R14=0x00000000029adae8, R15=0x00000000025ae800 RIP=0x00000000665d3d86, EFLAGS=0x0000000000010246

Top of Stack: (sp=0x00000000029ada10) 0x00000000029ada10: 00000000029ada60 000000077d3e0830 0x00000000029ada20: 0000000000000000 00000000665d18d1 0x00000000029ada30: 00000000029b6374 00000000029c23a8 0x00000000029ada40: 000000077cad5240 00000000029adab8 0x00000000029ada50: 00000000efa75065 00000000029c28d9 0x00000000029ada60: 000000077cad6eb0 00000000029adac8 0x00000000029ada70: 00000000efa75065 00000000029ada78 0x00000000029ada80: 0000000000000000 00000000029adae8 0x00000000029ada90: 000000077cad9230 0000000000000000 0x00000000029adaa0: 000000077cad5240 0000000000000000 0x00000000029adab0: 00000000029adad8 00000000029adb30 0x00000000029adac0: 00000000029b64f0 0000000000000000 0x00000000029adad0: 00000000029bf1ce 00000000493f5d40 0x00000000029adae0: 00000000493f5d40 00000007d5eb72e8 0x00000000029adaf0: 00000000029adaf0 000000077d3c45e1 0x00000000029adb00: 00000000029adb58 000000077d3e2c10

Instructions: (pc=0x00000000665d3d86) 0x00000000665d3d66: 18 04 00 c7 83 50 02 00 00 06 00 00 00 8b 0d 5f 0x00000000665d3d76: 3e 4d 00 ff 15 29 e6 35 00 c6 80 74 02 00 00 01 0x00000000665d3d86: 0f b6 3f c6 80 74 02 00 00 00 48 8b 73 48 48 8b 0x00000000665d3d96: 4e 10 48 8b 6e 08 48 83 39 00 74 05 e8 e9 6f ef

RAX=0x00000000025ae800 is a thread RBX=0x00000000025ae800 is a thread RCX=0x000000000000000c is an unknown value RDX=0x00000000029adae8 is pointing into the stack for thread: 0x00000000025ae800 RSP=0x00000000029ada10 is pointing into the stack for thread: 0x00000000025ae800 RBP=0x00000000029adab8 is pointing into the stack for thread: 0x00000000025ae800 RSI=0x00000000efa75065 is an unknown value RDI=0x00000000493f5d40 is an unknown value R8 =0x00000000493f5d40 is an unknown value R9 =0x00000007d730a128 is an oop java.lang.Class

klass: 'java/lang/Class' R10=0x00000000029c237c is an Interpreter codelet method entry point (kind = native) [0x00000000029c2100, 0x00000000029c2980] 2176 bytes R11=0x0000000066602040 is an unknown value R12=0x0000000000000000 is an unknown value R13=0x000000077cad5240 is an oop {method}
klass: {other class} R14=0x00000000029adae8 is pointing into the stack for thread: 0x00000000025ae800 R15=0x00000000025ae800 is a thread

Stack: [0x00000000028b0000,0x00000000029b0000], sp=0x00000000029ada10, free space=1014k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [jvm.dll+0x193d86] j net.openhft.lang.io.NativeBytes.load()Lnet/openhft/lang/io/Bytes;+25 j net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createMultiMap(J)Lnet/openhft/collections/IntIntMultiMap;+56 j net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createHashLookups(J)V+3 j net.openhft.collections.AbstractVanillaSharedHashMap$Segment.(Lnet/openhft/collections/AbstractVanillaSharedHashMap;Lnet/openhft/lang/io/NativeBytes;I)V+48 j net.openhft.collections.AbstractVanillaSharedHashMap.createSegment(Lnet/openhft/lang/io/NativeBytes;I)Lnet/openhft/collections/AbstractVanillaSharedHashMap$Segment;+7 j net.openhft.collections.AbstractVanillaSharedHashMap.createMappedStoreAndSegments(Lnet/openhft/lang/io/BytesStore;)J+58 j net.openhft.collections.VanillaSharedHashMap.(Lnet/openhft/collections/SharedHashMapBuilder;Ljava/io/File;Ljava/lang/Class;Ljava/lang/Class;)V+52 j net.openhft.collections.SharedHashMapBuilder.create()Lnet/openhft/collections/SharedHashMap;+80 j com.pivotal.rti.smartcities.TestHugeCollections.bigMap()V+66 v ~StubRoutines::call_stub V [jvm.dll+0x1ae7f4]

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) j sun.misc.Unsafe.getByte(J)B+0 j net.openhft.lang.io.NativeBytes.load()Lnet/openhft/lang/io/Bytes;+25 j net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createMultiMap(J)Lnet/openhft/collections/IntIntMultiMap;+56 j net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createHashLookups(J)V+3 j net.openhft.collections.AbstractVanillaSharedHashMap$Segment.(Lnet/openhft/collections/AbstractVanillaSharedHashMap;Lnet/openhft/lang/io/NativeBytes;I)V+48 j net.openhft.collections.AbstractVanillaSharedHashMap.createSegment(Lnet/openhft/lang/io/NativeBytes;I)Lnet/openhft/collections/AbstractVanillaSharedHashMap$Segment;+7 j net.openhft.collections.AbstractVanillaSharedHashMap.createMappedStoreAndSegments(Lnet/openhft/lang/io/BytesStore;)J+58 j net.openhft.collections.VanillaSharedHashMap.(Lnet/openhft/collections/SharedHashMapBuilder;Ljava/io/File;Ljava/lang/Class;Ljava/lang/Class;)V+52 j net.openhft.collections.SharedHashMapBuilder.create()Lnet/openhft/collections/SharedHashMap;+80 j com.pivotal.rti.smartcities.TestHugeCollections.bigMap()V+66 v ~StubRoutines::call_stub j sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+0 j sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+87 j sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+6 j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+57 j org.testng.internal.MethodInvocationHelper.invokeMethod(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+242 j org.testng.internal.Invoker.invokeMethod([Ljava/lang/Object;ILorg/testng/ITestNGMethod;[Ljava/lang/Object;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/ITestClass;[Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;Lorg/testng/internal/ConfigurationGroupMethods;)Lorg/testng/ITestResult;+292 j org.testng.internal.Invoker.invokeTestMethod([Ljava/lang/Object;Lorg/testng/ITestNGMethod;[Ljava/lang/Object;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/ITestClass;[Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;Lorg/testng/internal/ConfigurationGroupMethods;)Ljava/util/List;+46 j org.testng.internal.Invoker.invokeTestMethods(Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/internal/ConfigurationGroupMethods;[Ljava/lang/Object;Lorg/testng/ITestContext;)Ljava/util/List;+762 j org.testng.internal.TestMethodWorker.invokeTestMethods(Lorg/testng/ITestNGMethod;[Ljava/lang/Object;Lorg/testng/ITestContext;)V+32 j org.testng.internal.TestMethodWorker.run()V+60 j org.testng.TestRunner.privateRun(Lorg/testng/xml/XmlTest;)V+356 j org.testng.TestRunner.run()V+26 j org.testng.SuiteRunner.runTest(Lorg/testng/TestRunner;)V+1 j org.testng.SuiteRunner.runSequentially()V+31 j org.testng.SuiteRunner.privateRun()V+281 j org.testng.SuiteRunner.run()V+6 j org.testng.SuiteRunnerWorker.runSuite(Lorg/testng/internal/SuiteRunnerMap;Lorg/testng/xml/XmlSuite;)V+89 j org.testng.SuiteRunnerWorker.run()V+12 j org.testng.TestNG.runSuitesSequentially(Lorg/testng/xml/XmlSuite;Lorg/testng/internal/SuiteRunnerMap;ILjava/lang/String;)V+66 j org.testng.TestNG.runSuitesLocally()Ljava/util/List;+143 j org.testng.TestNG.run()V+77 j org.testng.remote.RemoteTestNG.run()V+204 j org.testng.remote.RemoteTestNG.initAndRun([Ljava/lang/String;Lorg/testng/CommandLineArgs;Lorg/testng/remote/RemoteArgs;)V+171 j org.testng.remote.RemoteTestNG.main([Ljava/lang/String;)V+106 v ~StubRoutines::call_stub

--------------- P R O C E S S ---------------

Java Threads: ( => current thread ) 0x000000000dc41800 JavaThread "ReaderThread" [_thread_in_native, id=3816, stack(0x000000000e260000,0x000000000e360000)] 0x000000000be33000 JavaThread "Service Thread" daemon [_thread_blocked, id=5136, stack(0x000000000d5a0000,0x000000000d6a0000)] 0x000000000be32800 JavaThread "C2 CompilerThread1" daemon [_thread_blocked, id=6632, stack(0x000000000d6e0000,0x000000000d7e0000)] 0x000000000be2c800 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=7400, stack(0x000000000d470000,0x000000000d570000)] 0x000000000be2b800 JavaThread "Attach Listener" daemon [_thread_blocked, id=6820, stack(0x000000000d2a0000,0x000000000d3a0000)] 0x000000000be22800 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=5124, stack(0x000000000cc80000,0x000000000cd80000)] 0x00000000026ab000 JavaThread "Finalizer" daemon [_thread_blocked, id=5712, stack(0x000000000d130000,0x000000000d230000)] 0x00000000026a4000 JavaThread "Reference Handler" daemon [_thread_blocked, id=3736, stack(0x000000000cf50000,0x000000000d050000)] =>0x00000000025ae800 JavaThread "main" [_thread_in_vm, id=2744, stack(0x00000000028b0000,0x00000000029b0000)]

Other Threads: 0x000000000bda2000 VMThread [stack: 0x000000000ce30000,0x000000000cf30000] [id=3608] 0x000000000be44000 WatcherThread [stack: 0x000000000d8b0000,0x000000000d9b0000] [id=7264]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap PSYoungGen total 37696K, used 21562K [0x00000007d5eb0000, 0x00000007d88c0000, 0x0000000800000000) eden space 32320K, 66% used [0x00000007d5eb0000,0x00000007d73bea30,0x00000007d7e40000) from space 5376K, 0% used [0x00000007d8380000,0x00000007d8380000,0x00000007d88c0000) to space 5376K, 0% used [0x00000007d7e40000,0x00000007d7e40000,0x00000007d8380000) ParOldGen total 86144K, used 0K [0x0000000781c00000, 0x0000000787020000, 0x00000007d5eb0000) object space 86144K, 0% used [0x0000000781c00000,0x0000000781c00000,0x0000000787020000) PSPermGen total 21248K, used 10190K [0x000000077ca00000, 0x000000077dec0000, 0x0000000781c00000) object space 21248K, 47% used [0x000000077ca00000,0x000000077d3f3b28,0x000000077dec0000)

Card table byte_map: [0x00000000059b0000,0x0000000005dd0000] byte_map_base: 0x0000000001dcb000

Polling page: 0x0000000000320000

Code Cache [0x00000000029b0000, 0x0000000002c20000, 0x00000000059b0000) total_blobs=350 nmethods=59 adapters=242 free_code_cache=48567Kb largest_free_block=49725568

Compilation events (10 events): Event: 0.624 Thread 0x000000000be2c800 nmethod 53 0x0000000002a340d0 code [0x0000000002a34200, 0x0000000002a34278] Event: 0.624 Thread 0x000000000be2c800 54 java.lang.reflect.Method::getName (5 bytes) Event: 0.624 Thread 0x000000000be2c800 nmethod 54 0x0000000002a33ed0 code [0x0000000002a34000, 0x0000000002a34078] Event: 0.624 Thread 0x000000000be2c800 55 java.util.HashMap::get (29 bytes) Event: 0.627 Thread 0x000000000be2c800 nmethod 55 0x0000000002a338d0 code [0x0000000002a33a40, 0x0000000002a33c78] Event: 0.627 Thread 0x000000000be2c800 56 java.lang.StringBuilder::append (8 bytes) Event: 0.630 Thread 0x000000000be2c800 nmethod 56 0x0000000002a33310 code [0x0000000002a33460, 0x0000000002a33608] Event: 0.639 Thread 0x000000000be32800 nmethod 51 0x0000000002a3d7d0 code [0x0000000002a3dce0, 0x0000000002a40290] Event: 0.675 Thread 0x000000000be2c800 57 java.util.Arrays::copyOf (19 bytes) Event: 0.677 Thread 0x000000000be2c800 nmethod 57 0x0000000002a34f10 code [0x0000000002a35060, 0x0000000002a35238]

GC Heap History (0 events): No events

Deoptimization events (1 events): Event: 0.258 Thread 0x00000000025ae800 Uncommon trap -12 fr.pc 0x0000000002a16db8

Internal exceptions (10 events): Event: 0.690 Thread 0x00000000025ae800 Threw 0x00000007d72cc740 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.692 Thread 0x00000000025ae800 Threw 0x00000007d72d3650 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.693 Thread 0x00000000025ae800 Threw 0x00000007d72d9c18 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.694 Thread 0x00000000025ae800 Threw 0x00000007d72e91a8 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.696 Thread 0x00000000025ae800 Threw 0x00000007d730a830 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.697 Thread 0x00000000025ae800 Threw 0x00000007d731fc00 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.699 Thread 0x00000000025ae800 Threw 0x00000007d7329688 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.700 Thread 0x00000000025ae800 Threw 0x00000007d732ff38 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.700 Thread 0x00000000025ae800 Threw 0x00000007d7336810 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.702 Thread 0x00000000025ae800 Threw 0x00000007d734b650 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166

Events (10 events): Event: 0.697 loading class 0x0000000002691e30 Event: 0.697 loading class 0x0000000002691e30 done Event: 0.699 loading class 0x000000000eb44440 Event: 0.699 loading class 0x000000000eb44440 done Event: 0.700 loading class 0x000000000ef2c5f0 Event: 0.700 loading class 0x000000000ef2c5f0 done Event: 0.700 loading class 0x000000000eb44b00 Event: 0.700 loading class 0x000000000eb44b00 done Event: 0.702 loading class 0x000000000ef2c460 Event: 0.702 loading class 0x000000000ef2c460 done

Dynamic libraries: 0x000000013f8b0000 - 0x000000013f8e4000 C:\devs\Java\jdk1.7.0_07\bin\javaw.exe 0x0000000077310000 - 0x00000000774b9000 C:\Windows\SYSTEM32\ntdll.dll 0x00000000770f0000 - 0x000000007720f000 C:\Windows\system32\kernel32.dll 0x000007fefd4e0000 - 0x000007fefd54c000 C:\Windows\system32\KERNELBASE.dll 0x000007fefda40000 - 0x000007fefdb1b000 C:\Windows\system32\ADVAPI32.dll 0x000007fefd800000 - 0x000007fefd89f000 C:\Windows\system32\msvcrt.dll 0x000007fefdb20000 - 0x000007fefdb3f000 C:\Windows\SYSTEM32\sechost.dll 0x000007fefe9f0000 - 0x000007fefeb1d000 C:\Windows\system32\RPCRT4.dll 0x0000000077210000 - 0x000000007730a000 C:\Windows\system32\USER32.dll 0x000007fefeb20000 - 0x000007fefeb87000 C:\Windows\system32\GDI32.dll 0x000007fefda20000 - 0x000007fefda2e000 C:\Windows\system32\LPK.dll 0x000007fefecd0000 - 0x000007fefed99000 C:\Windows\system32\USP10.dll 0x000007fefbe60000 - 0x000007fefc054000 C:\Windows\WinSxS\amd64_microsoft.windows.common-controls_6595b64144ccf1df_6.0.7601.17514_none_fa396087175ac9ac\COMCTL32.dll 0x000007fefdb40000 - 0x000007fefdbb1000 C:\Windows\system32\SHLWAPI.dll 0x000007fefeca0000 - 0x000007fefecce000 C:\Windows\system32\IMM32.DLL 0x000007fefeb90000 - 0x000007fefec99000 C:\Windows\system32\MSCTF.dll 0x000007fefd220000 - 0x000007fefd25c000 C:\Windows\system32\nvinitx.dll 0x000000000f000000 - 0x000000000f006000 C:\Program Files\NVIDIA Corporation\CoProcManager_etoured.dll 0x000007fef7db0000 - 0x000007fef7df4000 C:\Program Files\NVIDIA Corporation\CoProcManager\nvd3d9wrapx.dll 0x000007feff3d0000 - 0x000007feff5a7000 C:\Windows\system32\SETUPAPI.dll 0x000007fefd480000 - 0x000007fefd4b6000 C:\Windows\system32\CFGMGR32.dll 0x000007fefeda0000 - 0x000007fefee77000 C:\Windows\system32\OLEAUT32.dll 0x000007fefee80000 - 0x000007feff083000 C:\Windows\system32\ole32.dll 0x000007fefd4c0000 - 0x000007fefd4da000 C:\Windows\system32\DEVOBJ.dll 0x000007fef7d60000 - 0x000007fef7da2000 C:\Program Files\NVIDIA Corporation\CoProcManager\nvdxgiwrapx.dll 0x000000006a4e0000 - 0x000000006a5b1000 C:\devs\Java\jdk1.7.0_07\jre\bin\msvcr100.dll 0x0000000066440000 - 0x0000000066b5f000 C:\devs\Java\jdk1.7.0_07\jre\bin\server\jvm.dll 0x000007fef93d0000 - 0x000007fef93d9000 C:\Windows\system32\WSOCK32.dll 0x000007feff5b0000 - 0x000007feff5fd000 C:\Windows\system32\WS2_32.dll 0x000007fefda30000 - 0x000007fefda38000 C:\Windows\system32\NSI.dll 0x000007fefa240000 - 0x000007fefa27b000 C:\Windows\system32\WINMM.dll 0x00000000774d0000 - 0x00000000774d7000 C:\Windows\system32\PSAPI.DLL 0x000000006a4d0000 - 0x000000006a4df000 C:\devs\Java\jdk1.7.0_07\jre\bin\verify.dll 0x000000006a4a0000 - 0x000000006a4c8000 C:\devs\Java\jdk1.7.0_07\jre\bin\java.dll 0x000000006a300000 - 0x000000006a315000 C:\devs\Java\jdk1.7.0_07\jre\bin\zip.dll 0x00000000702c0000 - 0x00000000702d9000 C:\devs\Java\jdk1.7.0_07\jre\bin\net.dll 0x000007fefca90000 - 0x000007fefcae5000 C:\Windows\system32\mswsock.dll 0x000007fefca80000 - 0x000007fefca87000 C:\Windows\System32\wship6.dll 0x000007fefc420000 - 0x000007fefc427000 C:\Windows\System32\wshtcpip.dll 0x000007fefc910000 - 0x000007fefc96b000 C:\Windows\system32\DNSAPI.dll 0x000007fefaac0000 - 0x000007fefaae7000 C:\Windows\system32\IPHLPAPI.DLL 0x000007fefaab0000 - 0x000007fefaabb000 C:\Windows\system32\WINNSI.DLL 0x000007fef9320000 - 0x000007fef9328000 C:\Windows\system32\rasadhlp.dll 0x000007fefa800000 - 0x000007fefa853000 C:\Windows\System32\fwpuclnt.dll 0x000007fefcaf0000 - 0x000007fefcb07000 C:\Windows\system32\CRYPTSP.dll 0x000007fefc7f0000 - 0x000007fefc837000 C:\Windows\system32\rsaenh.dll 0x000007fefc550000 - 0x000007fefc56e000 C:\Windows\system32\USERENV.dll 0x000007fefd260000 - 0x000007fefd26f000 C:\Windows\system32\profapi.dll 0x000007fefd150000 - 0x000007fefd15f000 C:\Windows\system32\CRYPTBASE.dll 0x000007fefad40000 - 0x000007fefad55000 C:\Windows\system32\NLAapi.dll 0x000007fef9430000 - 0x000007fef9445000 C:\Windows\system32\napinsp.dll 0x000007fef9410000 - 0x000007fef9429000 C:\Windows\system32\pnrpnsp.dll 0x000007fef93e0000 - 0x000007fef93eb000 C:\Windows\System32\winrnr.dll 0x000000006b2e0000 - 0x000000006b2f1000 C:\devs\Java\jdk1.7.0_07\jre\bin\nio.dll 0x000007fef8d50000 - 0x000007fef8e75000 C:\Windows\system32\dbghelp.dll

VM Arguments: jvm_args: -ea -Dfile.encoding=Cp1252 java_command: org.testng.remote.RemoteTestNG -serport 42246 -d C:\devs\workspaces\use-case\smartcities-postprocess\test-output C:\Users\meyerm4\AppData\Local\Temp\testng-eclipse-1428714906\testng-customsuite.xml Launcher Type: SUN_STANDARD

Environment Variables: JAVA_HOME=C:\devs\Java\jdk1.7.0_07 CLASSPATH=.;C:\Program Files (x86)\Java\jre6\lib\ext\QTJava.zip PATH=C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;"C:\Program Files (x86)\Common Files\EMC";C:\devs\apache-maven-3.2.1\bin;C:\devs\Groovy\Groovy-2.3.3\bin;C:\devs\Subversion\bin;C:\devs\Pivotal_GemFire_702_b45797\bin;C:\Program Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\Nmap USERNAME=meyerm4 OS=Windows_NT PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 42 Stepping 7, GenuineIntel

--------------- S Y S T E M ---------------

OS: Windows 7 , 64 bit Build 7601 Service Pack 1

CPU:total 4 (2 cores per cpu, 2 threads per core) family 6 model 42 stepping 7, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, ht, tsc, tscinvbit

Memory: 4k page, physical 8269012k(4172292k free), swap 16536160k(11979168k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (23.3-b01) for windows-amd64 JRE (1.7.0_07-b11), built on Sep 7 2012 01:19:25 by "java_re" with unknown MS VC++:1600

time: Wed Sep 17 15:29:56 2014 elapsed time: 0 seconds

On Wed, Sep 17, 2014 at 4:13 PM, Roman Leventov notifications@github.com wrote:

@ManuelPivotal https://github.com/ManuelPivotal your test performs equally uninteresting on my Windows machine: fail on map creation or success, depending on the map size. When I configured NO_ALIGNMENT and entrySize = 18 the map started to consume really not very much memory and the test finishes successfully even with map size = 10_000_000.

I don't see your attachment on github.

Here is my precise config from one of the crashed vm reports, if it is meaningful: --------------- S Y S T E M ---------------

OS: Windows 8.1 , 64 bit Build 9600

CPU:total 6 (6 cores per cpu, 1 threads per core) family 16 model 10 stepping 0, cmov, cx8, fxsr, mmx, sse, sse2, sse3, popcnt, mmxext, 3dnowpref, lzcnt, sse4a, tsc, tscinvbit

Memory: 4k page, physical 8386100k(4133016k free), swap 8386100k(2447272k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (25.5-b02) for windows-amd64 JRE (1.8.0_05-b13), built on Mar 18 2014 01:08:39 by "java_re" with MS VC++ 10.0 (VS2010)

— Reply to this email directly or view it on GitHub https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55908842 .

@ManuelPivotal you have the same crash reason as me -- lack of memory. Just configure entrySize and alignment and it should disappear. Or use a machine with more memory :) Jaromirs's case is more puzzling....

@Roman Thanks, I set your parameters and could run the test with 30_000_000 ! Very promising :-)

Thanks a lot for your help

Manuel

On Wed, Sep 17, 2014 at 4:47 PM, Roman Leventov notifications@github.com wrote:

@ManuelPivotal https://github.com/ManuelPivotal you have the same crash reason as me -- lack of memory. Just configure entrySize and alignment and it should disappear. Or use a machine with more memory :) Jaromirs's case is more puzzling....

— Reply to this email directly or view it on GitHub https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55914224 .

JRE version: 7.0_07-b11

I would suggest updating this version of Java 7 update 67 as update 7 is pretty old. (If not Java 8) I don't think it would make any difference to your problem, but there have been a lot of bugs fixed since then.

On 17 September 2014 16:41, ManuelPivotal notifications@github.com wrote:

@Roman Here is the dump, I suppose github get rid of it :-)

#

A fatal error has been detected by the Java Runtime Environment:

#

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000665d3d86,

pid=7196, tid=2744 #

JRE version: 7.0_07-b11

Java VM: Java HotSpot(TM) 64-Bit Server VM (23.3-b01 mixed mode

windows-amd64 compressed oops)

Problematic frame:

V [jvm.dll+0x193d86]

#

Failed to write core dump. Minidumps are not enabled by default on

client versions of Windows #

If you would like to submit a bug report, please visit:

http://bugreport.sun.com/bugreport/crash.jsp

#

--------------- T H R E A D ---------------

Current thread (0x00000000025ae800): JavaThread "main" [_thread_in_vm, id=2744, stack(0x00000000028b0000,0x00000000029b0000)]

siginfo: ExceptionCode=0xc0000005, reading address 0x00000000493f5d40

Registers: RAX=0x00000000025ae800, RBX=0x00000000025ae800, RCX=0x000000000000000c, RDX=0x00000000029adae8 RSP=0x00000000029ada10, RBP=0x00000000029adab8, RSI=0x00000000efa75065, RDI=0x00000000493f5d40 R8 =0x00000000493f5d40, R9 =0x00000007d730a128, R10=0x00000000029c237c, R11=0x0000000066602040 R12=0x0000000000000000, R13=0x000000077cad5240, R14=0x00000000029adae8, R15=0x00000000025ae800 RIP=0x00000000665d3d86, EFLAGS=0x0000000000010246

Top of Stack: (sp=0x00000000029ada10) 0x00000000029ada10: 00000000029ada60 000000077d3e0830 0x00000000029ada20: 0000000000000000 00000000665d18d1 0x00000000029ada30: 00000000029b6374 00000000029c23a8 0x00000000029ada40: 000000077cad5240 00000000029adab8 0x00000000029ada50: 00000000efa75065 00000000029c28d9 0x00000000029ada60: 000000077cad6eb0 00000000029adac8 0x00000000029ada70: 00000000efa75065 00000000029ada78 0x00000000029ada80: 0000000000000000 00000000029adae8 0x00000000029ada90: 000000077cad9230 0000000000000000 0x00000000029adaa0: 000000077cad5240 0000000000000000 0x00000000029adab0: 00000000029adad8 00000000029adb30 0x00000000029adac0: 00000000029b64f0 0000000000000000 0x00000000029adad0: 00000000029bf1ce 00000000493f5d40 0x00000000029adae0: 00000000493f5d40 00000007d5eb72e8 0x00000000029adaf0: 00000000029adaf0 000000077d3c45e1 0x00000000029adb00: 00000000029adb58 000000077d3e2c10

Instructions: (pc=0x00000000665d3d86) 0x00000000665d3d66: 18 04 00 c7 83 50 02 00 00 06 00 00 00 8b 0d 5f 0x00000000665d3d76: 3e 4d 00 ff 15 29 e6 35 00 c6 80 74 02 00 00 01 0x00000000665d3d86: 0f b6 3f c6 80 74 02 00 00 00 48 8b 73 48 48 8b 0x00000000665d3d96: 4e 10 48 8b 6e 08 48 83 39 00 74 05 e8 e9 6f ef

Register to memory mapping:

RAX=0x00000000025ae800 is a thread RBX=0x00000000025ae800 is a thread RCX=0x000000000000000c is an unknown value RDX=0x00000000029adae8 is pointing into the stack for thread: 0x00000000025ae800 RSP=0x00000000029ada10 is pointing into the stack for thread: 0x00000000025ae800 RBP=0x00000000029adab8 is pointing into the stack for thread: 0x00000000025ae800 RSI=0x00000000efa75065 is an unknown value RDI=0x00000000493f5d40 is an unknown value R8 =0x00000000493f5d40 is an unknown value R9 =0x00000007d730a128 is an oop java.lang.Class

klass: 'java/lang/Class' R10=0x00000000029c237c is an Interpreter codelet method entry point (kind = native) [0x00000000029c2100, 0x00000000029c2980] 2176 bytes R11=0x0000000066602040 is an unknown value R12=0x0000000000000000 is an unknown value R13=0x000000077cad5240 is an oop {method}

klass: {other class} R14=0x00000000029adae8 is pointing into the stack for thread: 0x00000000025ae800 R15=0x00000000025ae800 is a thread

Stack: [0x00000000028b0000,0x00000000029b0000], sp=0x00000000029ada10, free space=1014k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [jvm.dll+0x193d86] j net.openhft.lang.io.NativeBytes.load()Lnet/openhft/lang/io/Bytes;+25 j net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createMultiMap(J)Lnet/openhft/collections/IntIntMultiMap;+56

j net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createHashLookups(J)V+3

j net.openhft.collections.AbstractVanillaSharedHashMap$Segment.(Lnet/openhft/collections/AbstractVanillaSharedHashMap;Lnet/openhft/lang/io/NativeBytes;I)V+48

j net.openhft.collections.AbstractVanillaSharedHashMap.createSegment(Lnet/openhft/lang/io/NativeBytes;I)Lnet/openhft/collections/AbstractVanillaSharedHashMap$Segment;+7

j net.openhft.collections.AbstractVanillaSharedHashMap.createMappedStoreAndSegments(Lnet/openhft/lang/io/BytesStore;)J+58

j net.openhft.collections.VanillaSharedHashMap.(Lnet/openhft/collections/SharedHashMapBuilder;Ljava/io/File;Ljava/lang/Class;Ljava/lang/Class;)V+52

j net.openhft.collections.SharedHashMapBuilder.create()Lnet/openhft/collections/SharedHashMap;+80

j com.pivotal.rti.smartcities.TestHugeCollections.bigMap()V+66 v ~StubRoutines::call_stub V [jvm.dll+0x1ae7f4]

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) j sun.misc.Unsafe.getByte(J)B+0 j net.openhft.lang.io.NativeBytes.load()Lnet/openhft/lang/io/Bytes;+25 j net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createMultiMap(J)Lnet/openhft/collections/IntIntMultiMap;+56

j net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createHashLookups(J)V+3

j net.openhft.collections.AbstractVanillaSharedHashMap$Segment.(Lnet/openhft/collections/AbstractVanillaSharedHashMap;Lnet/openhft/lang/io/NativeBytes;I)V+48

j net.openhft.collections.AbstractVanillaSharedHashMap.createSegment(Lnet/openhft/lang/io/NativeBytes;I)Lnet/openhft/collections/AbstractVanillaSharedHashMap$Segment;+7

j net.openhft.collections.AbstractVanillaSharedHashMap.createMappedStoreAndSegments(Lnet/openhft/lang/io/BytesStore;)J+58

j net.openhft.collections.VanillaSharedHashMap.(Lnet/openhft/collections/SharedHashMapBuilder;Ljava/io/File;Ljava/lang/Class;Ljava/lang/Class;)V+52

j net.openhft.collections.SharedHashMapBuilder.create()Lnet/openhft/collections/SharedHashMap;+80

j com.pivotal.rti.smartcities.TestHugeCollections.bigMap()V+66 v ~StubRoutines::call_stub j sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+0

j sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+87

j sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+6

j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+57

j org.testng.internal.MethodInvocationHelper.invokeMethod(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+242

j org.testng.internal.Invoker.invokeMethod([Ljava/lang/Object;ILorg/testng/ITestNGMethod;[Ljava/lang/Object;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/ITestClass;[Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;Lorg/testng/internal/ConfigurationGroupMethods;)Lorg/testng/ITestResult;+292

j org.testng.internal.Invoker.invokeTestMethod([Ljava/lang/Object;Lorg/testng/ITestNGMethod;[Ljava/lang/Object;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/ITestClass;[Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;Lorg/testng/internal/ConfigurationGroupMethods;)Ljava/util/List;+46

j org.testng.internal.Invoker.invokeTestMethods(Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/internal/ConfigurationGroupMethods;[Ljava/lang/Object;Lorg/testng/ITestContext;)Ljava/util/List;+762

j org.testng.internal.TestMethodWorker.invokeTestMethods(Lorg/testng/ITestNGMethod;[Ljava/lang/Object;Lorg/testng/ITestContext;)V+32

j org.testng.internal.TestMethodWorker.run()V+60 j org.testng.TestRunner.privateRun(Lorg/testng/xml/XmlTest;)V+356 j org.testng.TestRunner.run()V+26 j org.testng.SuiteRunner.runTest(Lorg/testng/TestRunner;)V+1 j org.testng.SuiteRunner.runSequentially()V+31 j org.testng.SuiteRunner.privateRun()V+281 j org.testng.SuiteRunner.run()V+6 j org.testng.SuiteRunnerWorker.runSuite(Lorg/testng/internal/SuiteRunnerMap;Lorg/testng/xml/XmlSuite;)V+89

j org.testng.SuiteRunnerWorker.run()V+12 j org.testng.TestNG.runSuitesSequentially(Lorg/testng/xml/XmlSuite;Lorg/testng/internal/SuiteRunnerMap;ILjava/lang/String;)V+66

j org.testng.TestNG.runSuitesLocally()Ljava/util/List;+143 j org.testng.TestNG.run()V+77 j org.testng.remote.RemoteTestNG.run()V+204 j org.testng.remote.RemoteTestNG.initAndRun([Ljava/lang/String;Lorg/testng/CommandLineArgs;Lorg/testng/remote/RemoteArgs;)V+171

j org.testng.remote.RemoteTestNG.main([Ljava/lang/String;)V+106 v ~StubRoutines::call_stub

--------------- P R O C E S S ---------------

Java Threads: ( => current thread ) 0x000000000dc41800 JavaThread "ReaderThread" [_thread_in_native, id=3816, stack(0x000000000e260000,0x000000000e360000)] 0x000000000be33000 JavaThread "Service Thread" daemon [_thread_blocked, id=5136, stack(0x000000000d5a0000,0x000000000d6a0000)] 0x000000000be32800 JavaThread "C2 CompilerThread1" daemon [_thread_blocked, id=6632, stack(0x000000000d6e0000,0x000000000d7e0000)] 0x000000000be2c800 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=7400, stack(0x000000000d470000,0x000000000d570000)] 0x000000000be2b800 JavaThread "Attach Listener" daemon [_thread_blocked, id=6820, stack(0x000000000d2a0000,0x000000000d3a0000)] 0x000000000be22800 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=5124, stack(0x000000000cc80000,0x000000000cd80000)] 0x00000000026ab000 JavaThread "Finalizer" daemon [_thread_blocked, id=5712, stack(0x000000000d130000,0x000000000d230000)] 0x00000000026a4000 JavaThread "Reference Handler" daemon [_thread_blocked, id=3736, stack(0x000000000cf50000,0x000000000d050000)] =>0x00000000025ae800 JavaThread "main" [_thread_in_vm, id=2744, stack(0x00000000028b0000,0x00000000029b0000)]

Other Threads: 0x000000000bda2000 VMThread [stack: 0x000000000ce30000,0x000000000cf30000] [id=3608] 0x000000000be44000 WatcherThread [stack: 0x000000000d8b0000,0x000000000d9b0000] [id=7264]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap PSYoungGen total 37696K, used 21562K [0x00000007d5eb0000, 0x00000007d88c0000, 0x0000000800000000) eden space 32320K, 66% used [0x00000007d5eb0000,0x00000007d73bea30,0x00000007d7e40000) from space 5376K, 0% used [0x00000007d8380000,0x00000007d8380000,0x00000007d88c0000) to space 5376K, 0% used [0x00000007d7e40000,0x00000007d7e40000,0x00000007d8380000) ParOldGen total 86144K, used 0K [0x0000000781c00000, 0x0000000787020000, 0x00000007d5eb0000) object space 86144K, 0% used [0x0000000781c00000,0x0000000781c00000,0x0000000787020000) PSPermGen total 21248K, used 10190K [0x000000077ca00000, 0x000000077dec0000, 0x0000000781c00000) object space 21248K, 47% used [0x000000077ca00000,0x000000077d3f3b28,0x000000077dec0000)

Card table byte_map: [0x00000000059b0000,0x0000000005dd0000] byte_map_base: 0x0000000001dcb000

Polling page: 0x0000000000320000

Code Cache [0x00000000029b0000, 0x0000000002c20000, 0x00000000059b0000) total_blobs=350 nmethods=59 adapters=242 free_code_cache=48567Kb largest_free_block=49725568

Compilation events (10 events): Event: 0.624 Thread 0x000000000be2c800 nmethod 53 0x0000000002a340d0 code [0x0000000002a34200, 0x0000000002a34278] Event: 0.624 Thread 0x000000000be2c800 54 java.lang.reflect.Method::getName (5 bytes) Event: 0.624 Thread 0x000000000be2c800 nmethod 54 0x0000000002a33ed0 code [0x0000000002a34000, 0x0000000002a34078] Event: 0.624 Thread 0x000000000be2c800 55 java.util.HashMap::get (29 bytes) Event: 0.627 Thread 0x000000000be2c800 nmethod 55 0x0000000002a338d0 code [0x0000000002a33a40, 0x0000000002a33c78] Event: 0.627 Thread 0x000000000be2c800 56 java.lang.StringBuilder::append (8 bytes) Event: 0.630 Thread 0x000000000be2c800 nmethod 56 0x0000000002a33310 code [0x0000000002a33460, 0x0000000002a33608] Event: 0.639 Thread 0x000000000be32800 nmethod 51 0x0000000002a3d7d0 code [0x0000000002a3dce0, 0x0000000002a40290] Event: 0.675 Thread 0x000000000be2c800 57 java.util.Arrays::copyOf (19 bytes) Event: 0.677 Thread 0x000000000be2c800 nmethod 57 0x0000000002a34f10 code [0x0000000002a35060, 0x0000000002a35238]

GC Heap History (0 events): No events

Deoptimization events (1 events): Event: 0.258 Thread 0x00000000025ae800 Uncommon trap -12 fr.pc 0x0000000002a16db8

Internal exceptions (10 events): Event: 0.690 Thread 0x00000000025ae800 Threw 0x00000007d72cc740 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.692 Thread 0x00000000025ae800 Threw 0x00000007d72d3650 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.693 Thread 0x00000000025ae800 Threw 0x00000007d72d9c18 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.694 Thread 0x00000000025ae800 Threw 0x00000007d72e91a8 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.696 Thread 0x00000000025ae800 Threw 0x00000007d730a830 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.697 Thread 0x00000000025ae800 Threw 0x00000007d731fc00 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.699 Thread 0x00000000025ae800 Threw 0x00000007d7329688 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.700 Thread 0x00000000025ae800 Threw 0x00000007d732ff38 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.700 Thread 0x00000000025ae800 Threw 0x00000007d7336810 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.702 Thread 0x00000000025ae800 Threw 0x00000007d734b650 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166

Events (10 events): Event: 0.697 loading class 0x0000000002691e30 Event: 0.697 loading class 0x0000000002691e30 done Event: 0.699 loading class 0x000000000eb44440 Event: 0.699 loading class 0x000000000eb44440 done Event: 0.700 loading class 0x000000000ef2c5f0 Event: 0.700 loading class 0x000000000ef2c5f0 done Event: 0.700 loading class 0x000000000eb44b00 Event: 0.700 loading class 0x000000000eb44b00 done Event: 0.702 loading class 0x000000000ef2c460 Event: 0.702 loading class 0x000000000ef2c460 done

Dynamic libraries: 0x000000013f8b0000 - 0x000000013f8e4000 C:\devs\Java\jdk1.7.0_07\bin\javaw.exe 0x0000000077310000 - 0x00000000774b9000 C:\Windows\SYSTEM32\ntdll.dll 0x00000000770f0000 - 0x000000007720f000 C:\Windows\system32\kernel32.dll 0x000007fefd4e0000 - 0x000007fefd54c000 C:\Windows\system32\KERNELBASE.dll 0x000007fefda40000 - 0x000007fefdb1b000 C:\Windows\system32\ADVAPI32.dll 0x000007fefd800000 - 0x000007fefd89f000 C:\Windows\system32\msvcrt.dll 0x000007fefdb20000 - 0x000007fefdb3f000 C:\Windows\SYSTEM32\sechost.dll 0x000007fefe9f0000 - 0x000007fefeb1d000 C:\Windows\system32\RPCRT4.dll 0x0000000077210000 - 0x000000007730a000 C:\Windows\system32\USER32.dll 0x000007fefeb20000 - 0x000007fefeb87000 C:\Windows\system32\GDI32.dll 0x000007fefda20000 - 0x000007fefda2e000 C:\Windows\system32\LPK.dll 0x000007fefecd0000 - 0x000007fefed99000 C:\Windows\system32\USP10.dll 0x000007fefbe60000 - 0x000007fefc054000 C:\Windows\WinSxS\amd64_microsoft.windows.common-controls_6595b64144ccf1df_6.0.7601.17514_none_fa396087175ac9ac\COMCTL32.dll

0x000007fefdb40000 - 0x000007fefdbb1000 C:\Windows\system32\SHLWAPI.dll 0x000007fefeca0000 - 0x000007fefecce000 C:\Windows\system32\IMM32.DLL 0x000007fefeb90000 - 0x000007fefec99000 C:\Windows\system32\MSCTF.dll 0x000007fefd220000 - 0x000007fefd25c000 C:\Windows\system32\nvinitx.dll 0x000000000f000000 - 0x000000000f006000 C:\Program Files\NVIDIA Corporation\CoProcManager_etoured.dll 0x000007fef7db0000 - 0x000007fef7df4000 C:\Program Files\NVIDIA Corporation\CoProcManager\nvd3d9wrapx.dll 0x000007feff3d0000 - 0x000007feff5a7000 C:\Windows\system32\SETUPAPI.dll 0x000007fefd480000 - 0x000007fefd4b6000 C:\Windows\system32\CFGMGR32.dll 0x000007fefeda0000 - 0x000007fefee77000 C:\Windows\system32\OLEAUT32.dll 0x000007fefee80000 - 0x000007feff083000 C:\Windows\system32\ole32.dll 0x000007fefd4c0000 - 0x000007fefd4da000 C:\Windows\system32\DEVOBJ.dll 0x000007fef7d60000 - 0x000007fef7da2000 C:\Program Files\NVIDIA Corporation\CoProcManager\nvdxgiwrapx.dll 0x000000006a4e0000 - 0x000000006a5b1000 C:\devs\Java\jdk1.7.0_07\jre\bin\msvcr100.dll 0x0000000066440000 - 0x0000000066b5f000 C:\devs\Java\jdk1.7.0_07\jre\bin\server\jvm.dll 0x000007fef93d0000 - 0x000007fef93d9000 C:\Windows\system32\WSOCK32.dll 0x000007feff5b0000 - 0x000007feff5fd000 C:\Windows\system32\WS2_32.dll 0x000007fefda30000 - 0x000007fefda38000 C:\Windows\system32\NSI.dll 0x000007fefa240000 - 0x000007fefa27b000 C:\Windows\system32\WINMM.dll 0x00000000774d0000 - 0x00000000774d7000 C:\Windows\system32\PSAPI.DLL 0x000000006a4d0000 - 0x000000006a4df000 C:\devs\Java\jdk1.7.0_07\jre\bin\verify.dll 0x000000006a4a0000 - 0x000000006a4c8000 C:\devs\Java\jdk1.7.0_07\jre\bin\java.dll 0x000000006a300000 - 0x000000006a315000 C:\devs\Java\jdk1.7.0_07\jre\bin\zip.dll 0x00000000702c0000 - 0x00000000702d9000 C:\devs\Java\jdk1.7.0_07\jre\bin\net.dll 0x000007fefca90000 - 0x000007fefcae5000 C:\Windows\system32\mswsock.dll 0x000007fefca80000 - 0x000007fefca87000 C:\Windows\System32\wship6.dll 0x000007fefc420000 - 0x000007fefc427000 C:\Windows\System32\wshtcpip.dll 0x000007fefc910000 - 0x000007fefc96b000 C:\Windows\system32\DNSAPI.dll 0x000007fefaac0000 - 0x000007fefaae7000 C:\Windows\system32\IPHLPAPI.DLL 0x000007fefaab0000 - 0x000007fefaabb000 C:\Windows\system32\WINNSI.DLL 0x000007fef9320000 - 0x000007fef9328000 C:\Windows\system32\rasadhlp.dll 0x000007fefa800000 - 0x000007fefa853000 C:\Windows\System32\fwpuclnt.dll 0x000007fefcaf0000 - 0x000007fefcb07000 C:\Windows\system32\CRYPTSP.dll 0x000007fefc7f0000 - 0x000007fefc837000 C:\Windows\system32\rsaenh.dll 0x000007fefc550000 - 0x000007fefc56e000 C:\Windows\system32\USERENV.dll 0x000007fefd260000 - 0x000007fefd26f000 C:\Windows\system32\profapi.dll 0x000007fefd150000 - 0x000007fefd15f000 C:\Windows\system32\CRYPTBASE.dll 0x000007fefad40000 - 0x000007fefad55000 C:\Windows\system32\NLAapi.dll 0x000007fef9430000 - 0x000007fef9445000 C:\Windows\system32\napinsp.dll 0x000007fef9410000 - 0x000007fef9429000 C:\Windows\system32\pnrpnsp.dll 0x000007fef93e0000 - 0x000007fef93eb000 C:\Windows\System32\winrnr.dll 0x000000006b2e0000 - 0x000000006b2f1000 C:\devs\Java\jdk1.7.0_07\jre\bin\nio.dll 0x000007fef8d50000 - 0x000007fef8e75000 C:\Windows\system32\dbghelp.dll

VM Arguments: jvm_args: -ea -Dfile.encoding=Cp1252 java_command: org.testng.remote.RemoteTestNG -serport 42246 -d C:\devs\workspaces\use-case\smartcities-postprocess\test-output C:\Users\meyerm4\AppData\Local\Temp\testng-eclipse-1428714906\testng-customsuite.xml

Launcher Type: SUN_STANDARD

Environment Variables: JAVA_HOME=C:\devs\Java\jdk1.7.0_07 CLASSPATH=.;C:\Program Files (x86)\Java\jre6\lib\ext\QTJava.zip PATH=C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;"C:\Program

Files (x86)\Common Files\EMC";C:\devs\apache-maven-3.2.1\bin;C:\devs\Groovy\Groovy-2.3.3\bin;C:\devs\Subversion\bin;C:\devs\Pivotal_GemFire_702_b45797\bin;C:\Program

Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\Nmap USERNAME=meyerm4 OS=Windows_NT PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 42 Stepping 7, GenuineIntel

--------------- S Y S T E M ---------------

OS: Windows 7 , 64 bit Build 7601 Service Pack 1

CPU:total 4 (2 cores per cpu, 2 threads per core) family 6 model 42 stepping 7, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, ht, tsc, tscinvbit

Memory: 4k page, physical 8269012k(4172292k free), swap 16536160k(11979168k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (23.3-b01) for windows-amd64 JRE (1.7.0_07-b11), built on Sep 7 2012 01:19:25 by "java_re" with unknown MS VC++:1600

time: Wed Sep 17 15:29:56 2014 elapsed time: 0 seconds

On Wed, Sep 17, 2014 at 4:13 PM, Roman Leventov notifications@github.com

wrote:

@ManuelPivotal https://github.com/ManuelPivotal your test performs equally uninteresting on my Windows machine: fail on map creation or success, depending on the map size. When I configured NO_ALIGNMENT and entrySize = 18 the map started to consume really not very much memory and the test finishes successfully even with map size = 10_000_000.

I don't see your attachment on github.

Here is my precise config from one of the crashed vm reports, if it is meaningful: --------------- S Y S T E M ---------------

OS: Windows 8.1 , 64 bit Build 9600

CPU:total 6 (6 cores per cpu, 1 threads per core) family 16 model 10 stepping 0, cmov, cx8, fxsr, mmx, sse, sse2, sse3, popcnt, mmxext, 3dnowpref, lzcnt, sse4a, tsc, tscinvbit

Memory: 4k page, physical 8386100k(4133016k free), swap 8386100k(2447272k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (25.5-b02) for windows-amd64 JRE (1.8.0_05-b13), built on Mar 18 2014 01:08:39 by "java_re" with MS VC++ 10.0 (VS2010)

— Reply to this email directly or view it on GitHub < https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55908842>

.

— Reply to this email directly or view it on GitHub https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55913394 .

Hi Peter I agree but unfortunately the production target box is running this version... :-)

Regards, Manuel

On Wed, Sep 17, 2014 at 5:12 PM, Peter Lawrey notifications@github.com wrote:

JRE version: 7.0_07-b11

I would suggest updating this version of Java 7 update 67 as update 7 is pretty old. (If not Java 8) I don't think it would make any difference to your problem, but there have been a lot of bugs fixed since then.

On 17 September 2014 16:41, ManuelPivotal notifications@github.com wrote:

@Roman Here is the dump, I suppose github get rid of it :-)

#

A fatal error has been detected by the Java Runtime Environment:

#

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000665d3d86,

pid=7196, tid=2744 #

JRE version: 7.0_07-b11

Java VM: Java HotSpot(TM) 64-Bit Server VM (23.3-b01 mixed mode

windows-amd64 compressed oops)

Problematic frame:

V [jvm.dll+0x193d86]

#

Failed to write core dump. Minidumps are not enabled by default on

client versions of Windows #

If you would like to submit a bug report, please visit:

http://bugreport.sun.com/bugreport/crash.jsp

#

--------------- T H R E A D ---------------

Current thread (0x00000000025ae800): JavaThread "main" [_thread_in_vm, id=2744, stack(0x00000000028b0000,0x00000000029b0000)]

siginfo: ExceptionCode=0xc0000005, reading address 0x00000000493f5d40

Registers: RAX=0x00000000025ae800, RBX=0x00000000025ae800, RCX=0x000000000000000c, RDX=0x00000000029adae8 RSP=0x00000000029ada10, RBP=0x00000000029adab8, RSI=0x00000000efa75065, RDI=0x00000000493f5d40 R8 =0x00000000493f5d40, R9 =0x00000007d730a128, R10=0x00000000029c237c, R11=0x0000000066602040 R12=0x0000000000000000, R13=0x000000077cad5240, R14=0x00000000029adae8, R15=0x00000000025ae800 RIP=0x00000000665d3d86, EFLAGS=0x0000000000010246

Top of Stack: (sp=0x00000000029ada10) 0x00000000029ada10: 00000000029ada60 000000077d3e0830 0x00000000029ada20: 0000000000000000 00000000665d18d1 0x00000000029ada30: 00000000029b6374 00000000029c23a8 0x00000000029ada40: 000000077cad5240 00000000029adab8 0x00000000029ada50: 00000000efa75065 00000000029c28d9 0x00000000029ada60: 000000077cad6eb0 00000000029adac8 0x00000000029ada70: 00000000efa75065 00000000029ada78 0x00000000029ada80: 0000000000000000 00000000029adae8 0x00000000029ada90: 000000077cad9230 0000000000000000 0x00000000029adaa0: 000000077cad5240 0000000000000000 0x00000000029adab0: 00000000029adad8 00000000029adb30 0x00000000029adac0: 00000000029b64f0 0000000000000000 0x00000000029adad0: 00000000029bf1ce 00000000493f5d40 0x00000000029adae0: 00000000493f5d40 00000007d5eb72e8 0x00000000029adaf0: 00000000029adaf0 000000077d3c45e1 0x00000000029adb00: 00000000029adb58 000000077d3e2c10

Instructions: (pc=0x00000000665d3d86) 0x00000000665d3d66: 18 04 00 c7 83 50 02 00 00 06 00 00 00 8b 0d 5f 0x00000000665d3d76: 3e 4d 00 ff 15 29 e6 35 00 c6 80 74 02 00 00 01 0x00000000665d3d86: 0f b6 3f c6 80 74 02 00 00 00 48 8b 73 48 48 8b 0x00000000665d3d96: 4e 10 48 8b 6e 08 48 83 39 00 74 05 e8 e9 6f ef

Register to memory mapping:

RAX=0x00000000025ae800 is a thread RBX=0x00000000025ae800 is a thread RCX=0x000000000000000c is an unknown value RDX=0x00000000029adae8 is pointing into the stack for thread: 0x00000000025ae800 RSP=0x00000000029ada10 is pointing into the stack for thread: 0x00000000025ae800 RBP=0x00000000029adab8 is pointing into the stack for thread: 0x00000000025ae800 RSI=0x00000000efa75065 is an unknown value RDI=0x00000000493f5d40 is an unknown value R8 =0x00000000493f5d40 is an unknown value R9 =0x00000007d730a128 is an oop java.lang.Class

klass: 'java/lang/Class' R10=0x00000000029c237c is an Interpreter codelet method entry point (kind = native) [0x00000000029c2100, 0x00000000029c2980] 2176 bytes R11=0x0000000066602040 is an unknown value R12=0x0000000000000000 is an unknown value R13=0x000000077cad5240 is an oop {method}

klass: {other class} R14=0x00000000029adae8 is pointing into the stack for thread: 0x00000000025ae800 R15=0x00000000025ae800 is a thread

Stack: [0x00000000028b0000,0x00000000029b0000], sp=0x00000000029ada10, free space=1014k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code) V [jvm.dll+0x193d86] j net.openhft.lang.io.NativeBytes.load()Lnet/openhft/lang/io/Bytes;+25 j

net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createMultiMap(J)Lnet/openhft/collections/IntIntMultiMap;+56

j

net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createHashLookups(J)V+3

j

net.openhft.collections.AbstractVanillaSharedHashMap$Segment.(Lnet/openhft/collections/AbstractVanillaSharedHashMap;Lnet/openhft/lang/io/NativeBytes;I)V+48

j

net.openhft.collections.AbstractVanillaSharedHashMap.createSegment(Lnet/openhft/lang/io/NativeBytes;I)Lnet/openhft/collections/AbstractVanillaSharedHashMap$Segment;+7

j

net.openhft.collections.AbstractVanillaSharedHashMap.createMappedStoreAndSegments(Lnet/openhft/lang/io/BytesStore;)J+58

j

net.openhft.collections.VanillaSharedHashMap.(Lnet/openhft/collections/SharedHashMapBuilder;Ljava/io/File;Ljava/lang/Class;Ljava/lang/Class;)V+52

j

net.openhft.collections.SharedHashMapBuilder.create()Lnet/openhft/collections/SharedHashMap;+80

j com.pivotal.rti.smartcities.TestHugeCollections.bigMap()V+66 v ~StubRoutines::call_stub V [jvm.dll+0x1ae7f4]

Java frames: (J=compiled Java code, j=interpreted, Vv=VM code) j sun.misc.Unsafe.getByte(J)B+0 j net.openhft.lang.io.NativeBytes.load()Lnet/openhft/lang/io/Bytes;+25 j

net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createMultiMap(J)Lnet/openhft/collections/IntIntMultiMap;+56

j

net.openhft.collections.AbstractVanillaSharedHashMap$Segment.createHashLookups(J)V+3

j

net.openhft.collections.AbstractVanillaSharedHashMap$Segment.(Lnet/openhft/collections/AbstractVanillaSharedHashMap;Lnet/openhft/lang/io/NativeBytes;I)V+48

j

net.openhft.collections.AbstractVanillaSharedHashMap.createSegment(Lnet/openhft/lang/io/NativeBytes;I)Lnet/openhft/collections/AbstractVanillaSharedHashMap$Segment;+7

j

net.openhft.collections.AbstractVanillaSharedHashMap.createMappedStoreAndSegments(Lnet/openhft/lang/io/BytesStore;)J+58

j

net.openhft.collections.VanillaSharedHashMap.(Lnet/openhft/collections/SharedHashMapBuilder;Ljava/io/File;Ljava/lang/Class;Ljava/lang/Class;)V+52

j

net.openhft.collections.SharedHashMapBuilder.create()Lnet/openhft/collections/SharedHashMap;+80

j com.pivotal.rti.smartcities.TestHugeCollections.bigMap()V+66 v ~StubRoutines::call_stub j

sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+0

j

sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+87

j

sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+6

j

java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+57

j

org.testng.internal.MethodInvocationHelper.invokeMethod(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+242

j

org.testng.internal.Invoker.invokeMethod([Ljava/lang/Object;ILorg/testng/ITestNGMethod;[Ljava/lang/Object;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/ITestClass;[Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;Lorg/testng/internal/ConfigurationGroupMethods;)Lorg/testng/ITestResult;+292

j

org.testng.internal.Invoker.invokeTestMethod([Ljava/lang/Object;Lorg/testng/ITestNGMethod;[Ljava/lang/Object;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/ITestClass;[Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;Lorg/testng/internal/ConfigurationGroupMethods;)Ljava/util/List;+46

j

org.testng.internal.Invoker.invokeTestMethods(Lorg/testng/ITestNGMethod;[Lorg/testng/ITestNGMethod;ILorg/testng/xml/XmlSuite;Ljava/util/Map;Lorg/testng/internal/ConfigurationGroupMethods;[Ljava/lang/Object;Lorg/testng/ITestContext;)Ljava/util/List;+762

j

org.testng.internal.TestMethodWorker.invokeTestMethods(Lorg/testng/ITestNGMethod;[Ljava/lang/Object;Lorg/testng/ITestContext;)V+32

j org.testng.internal.TestMethodWorker.run()V+60 j org.testng.TestRunner.privateRun(Lorg/testng/xml/XmlTest;)V+356 j org.testng.TestRunner.run()V+26 j org.testng.SuiteRunner.runTest(Lorg/testng/TestRunner;)V+1 j org.testng.SuiteRunner.runSequentially()V+31 j org.testng.SuiteRunner.privateRun()V+281 j org.testng.SuiteRunner.run()V+6 j

org.testng.SuiteRunnerWorker.runSuite(Lorg/testng/internal/SuiteRunnerMap;Lorg/testng/xml/XmlSuite;)V+89

j org.testng.SuiteRunnerWorker.run()V+12 j

org.testng.TestNG.runSuitesSequentially(Lorg/testng/xml/XmlSuite;Lorg/testng/internal/SuiteRunnerMap;ILjava/lang/String;)V+66

j org.testng.TestNG.runSuitesLocally()Ljava/util/List;+143 j org.testng.TestNG.run()V+77 j org.testng.remote.RemoteTestNG.run()V+204 j

org.testng.remote.RemoteTestNG.initAndRun([Ljava/lang/String;Lorg/testng/CommandLineArgs;Lorg/testng/remote/RemoteArgs;)V+171

j org.testng.remote.RemoteTestNG.main([Ljava/lang/String;)V+106 v ~StubRoutines::call_stub

--------------- P R O C E S S ---------------

Java Threads: ( => current thread ) 0x000000000dc41800 JavaThread "ReaderThread" [_thread_in_native, id=3816, stack(0x000000000e260000,0x000000000e360000)] 0x000000000be33000 JavaThread "Service Thread" daemon [_thread_blocked, id=5136, stack(0x000000000d5a0000,0x000000000d6a0000)] 0x000000000be32800 JavaThread "C2 CompilerThread1" daemon [_thread_blocked, id=6632, stack(0x000000000d6e0000,0x000000000d7e0000)] 0x000000000be2c800 JavaThread "C2 CompilerThread0" daemon [_thread_blocked, id=7400, stack(0x000000000d470000,0x000000000d570000)] 0x000000000be2b800 JavaThread "Attach Listener" daemon [_thread_blocked, id=6820, stack(0x000000000d2a0000,0x000000000d3a0000)] 0x000000000be22800 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=5124, stack(0x000000000cc80000,0x000000000cd80000)] 0x00000000026ab000 JavaThread "Finalizer" daemon [_thread_blocked, id=5712, stack(0x000000000d130000,0x000000000d230000)] 0x00000000026a4000 JavaThread "Reference Handler" daemon [_thread_blocked, id=3736, stack(0x000000000cf50000,0x000000000d050000)] =>0x00000000025ae800 JavaThread "main" [_thread_in_vm, id=2744, stack(0x00000000028b0000,0x00000000029b0000)]

Other Threads: 0x000000000bda2000 VMThread [stack: 0x000000000ce30000,0x000000000cf30000] [id=3608] 0x000000000be44000 WatcherThread [stack: 0x000000000d8b0000,0x000000000d9b0000] [id=7264]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: None

Heap PSYoungGen total 37696K, used 21562K [0x00000007d5eb0000, 0x00000007d88c0000, 0x0000000800000000) eden space 32320K, 66% used [0x00000007d5eb0000,0x00000007d73bea30,0x00000007d7e40000) from space 5376K, 0% used [0x00000007d8380000,0x00000007d8380000,0x00000007d88c0000) to space 5376K, 0% used [0x00000007d7e40000,0x00000007d7e40000,0x00000007d8380000) ParOldGen total 86144K, used 0K [0x0000000781c00000, 0x0000000787020000, 0x00000007d5eb0000) object space 86144K, 0% used [0x0000000781c00000,0x0000000781c00000,0x0000000787020000) PSPermGen total 21248K, used 10190K [0x000000077ca00000, 0x000000077dec0000, 0x0000000781c00000) object space 21248K, 47% used [0x000000077ca00000,0x000000077d3f3b28,0x000000077dec0000)

Card table byte_map: [0x00000000059b0000,0x0000000005dd0000] byte_map_base: 0x0000000001dcb000

Polling page: 0x0000000000320000

Code Cache [0x00000000029b0000, 0x0000000002c20000, 0x00000000059b0000) total_blobs=350 nmethods=59 adapters=242 free_code_cache=48567Kb largest_free_block=49725568

Compilation events (10 events): Event: 0.624 Thread 0x000000000be2c800 nmethod 53 0x0000000002a340d0 code [0x0000000002a34200, 0x0000000002a34278] Event: 0.624 Thread 0x000000000be2c800 54 java.lang.reflect.Method::getName (5 bytes) Event: 0.624 Thread 0x000000000be2c800 nmethod 54 0x0000000002a33ed0 code [0x0000000002a34000, 0x0000000002a34078] Event: 0.624 Thread 0x000000000be2c800 55 java.util.HashMap::get (29 bytes) Event: 0.627 Thread 0x000000000be2c800 nmethod 55 0x0000000002a338d0 code [0x0000000002a33a40, 0x0000000002a33c78] Event: 0.627 Thread 0x000000000be2c800 56 java.lang.StringBuilder::append (8 bytes) Event: 0.630 Thread 0x000000000be2c800 nmethod 56 0x0000000002a33310 code [0x0000000002a33460, 0x0000000002a33608] Event: 0.639 Thread 0x000000000be32800 nmethod 51 0x0000000002a3d7d0 code [0x0000000002a3dce0, 0x0000000002a40290] Event: 0.675 Thread 0x000000000be2c800 57 java.util.Arrays::copyOf (19 bytes) Event: 0.677 Thread 0x000000000be2c800 nmethod 57 0x0000000002a34f10 code [0x0000000002a35060, 0x0000000002a35238]

GC Heap History (0 events): No events

Deoptimization events (1 events): Event: 0.258 Thread 0x00000000025ae800 Uncommon trap -12 fr.pc 0x0000000002a16db8

Internal exceptions (10 events): Event: 0.690 Thread 0x00000000025ae800 Threw 0x00000007d72cc740 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.692 Thread 0x00000000025ae800 Threw 0x00000007d72d3650 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.693 Thread 0x00000000025ae800 Threw 0x00000007d72d9c18 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.694 Thread 0x00000000025ae800 Threw 0x00000007d72e91a8 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.696 Thread 0x00000000025ae800 Threw 0x00000007d730a830 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.697 Thread 0x00000000025ae800 Threw 0x00000007d731fc00 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.699 Thread 0x00000000025ae800 Threw 0x00000007d7329688 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.700 Thread 0x00000000025ae800 Threw 0x00000007d732ff38 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.700 Thread 0x00000000025ae800 Threw 0x00000007d7336810 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166 Event: 0.702 Thread 0x00000000025ae800 Threw 0x00000007d734b650 at C:\jdk7u1_64p\jdk7u7\hotspot\src\share\vm\prims\jvm.cpp:1166

Events (10 events): Event: 0.697 loading class 0x0000000002691e30 Event: 0.697 loading class 0x0000000002691e30 done Event: 0.699 loading class 0x000000000eb44440 Event: 0.699 loading class 0x000000000eb44440 done Event: 0.700 loading class 0x000000000ef2c5f0 Event: 0.700 loading class 0x000000000ef2c5f0 done Event: 0.700 loading class 0x000000000eb44b00 Event: 0.700 loading class 0x000000000eb44b00 done Event: 0.702 loading class 0x000000000ef2c460 Event: 0.702 loading class 0x000000000ef2c460 done

Dynamic libraries: 0x000000013f8b0000 - 0x000000013f8e4000 C:\devs\Java\jdk1.7.0_07\bin\javaw.exe 0x0000000077310000 - 0x00000000774b9000 C:\Windows\SYSTEM32\ntdll.dll 0x00000000770f0000 - 0x000000007720f000 C:\Windows\system32\kernel32.dll 0x000007fefd4e0000 - 0x000007fefd54c000 C:\Windows\system32\KERNELBASE.dll 0x000007fefda40000 - 0x000007fefdb1b000 C:\Windows\system32\ADVAPI32.dll 0x000007fefd800000 - 0x000007fefd89f000 C:\Windows\system32\msvcrt.dll 0x000007fefdb20000 - 0x000007fefdb3f000 C:\Windows\SYSTEM32\sechost.dll 0x000007fefe9f0000 - 0x000007fefeb1d000 C:\Windows\system32\RPCRT4.dll 0x0000000077210000 - 0x000000007730a000 C:\Windows\system32\USER32.dll 0x000007fefeb20000 - 0x000007fefeb87000 C:\Windows\system32\GDI32.dll 0x000007fefda20000 - 0x000007fefda2e000 C:\Windows\system32\LPK.dll 0x000007fefecd0000 - 0x000007fefed99000 C:\Windows\system32\USP10.dll 0x000007fefbe60000 - 0x000007fefc054000

C:\Windows\WinSxS\amd64_microsoft.windows.common-controls_6595b64144ccf1df_6.0.7601.17514_none_fa396087175ac9ac\COMCTL32.dll

0x000007fefdb40000 - 0x000007fefdbb1000 C:\Windows\system32\SHLWAPI.dll 0x000007fefeca0000 - 0x000007fefecce000 C:\Windows\system32\IMM32.DLL 0x000007fefeb90000 - 0x000007fefec99000 C:\Windows\system32\MSCTF.dll 0x000007fefd220000 - 0x000007fefd25c000 C:\Windows\system32\nvinitx.dll 0x000000000f000000 - 0x000000000f006000 C:\Program Files\NVIDIA Corporation\CoProcManager_etoured.dll 0x000007fef7db0000 - 0x000007fef7df4000 C:\Program Files\NVIDIA Corporation\CoProcManager\nvd3d9wrapx.dll 0x000007feff3d0000 - 0x000007feff5a7000 C:\Windows\system32\SETUPAPI.dll 0x000007fefd480000 - 0x000007fefd4b6000 C:\Windows\system32\CFGMGR32.dll 0x000007fefeda0000 - 0x000007fefee77000 C:\Windows\system32\OLEAUT32.dll 0x000007fefee80000 - 0x000007feff083000 C:\Windows\system32\ole32.dll 0x000007fefd4c0000 - 0x000007fefd4da000 C:\Windows\system32\DEVOBJ.dll 0x000007fef7d60000 - 0x000007fef7da2000 C:\Program Files\NVIDIA Corporation\CoProcManager\nvdxgiwrapx.dll 0x000000006a4e0000 - 0x000000006a5b1000 C:\devs\Java\jdk1.7.0_07\jre\bin\msvcr100.dll 0x0000000066440000 - 0x0000000066b5f000 C:\devs\Java\jdk1.7.0_07\jre\bin\server\jvm.dll 0x000007fef93d0000 - 0x000007fef93d9000 C:\Windows\system32\WSOCK32.dll 0x000007feff5b0000 - 0x000007feff5fd000 C:\Windows\system32\WS2_32.dll 0x000007fefda30000 - 0x000007fefda38000 C:\Windows\system32\NSI.dll 0x000007fefa240000 - 0x000007fefa27b000 C:\Windows\system32\WINMM.dll 0x00000000774d0000 - 0x00000000774d7000 C:\Windows\system32\PSAPI.DLL 0x000000006a4d0000 - 0x000000006a4df000 C:\devs\Java\jdk1.7.0_07\jre\bin\verify.dll 0x000000006a4a0000 - 0x000000006a4c8000 C:\devs\Java\jdk1.7.0_07\jre\bin\java.dll 0x000000006a300000 - 0x000000006a315000 C:\devs\Java\jdk1.7.0_07\jre\bin\zip.dll 0x00000000702c0000 - 0x00000000702d9000 C:\devs\Java\jdk1.7.0_07\jre\bin\net.dll 0x000007fefca90000 - 0x000007fefcae5000 C:\Windows\system32\mswsock.dll 0x000007fefca80000 - 0x000007fefca87000 C:\Windows\System32\wship6.dll 0x000007fefc420000 - 0x000007fefc427000 C:\Windows\System32\wshtcpip.dll 0x000007fefc910000 - 0x000007fefc96b000 C:\Windows\system32\DNSAPI.dll 0x000007fefaac0000 - 0x000007fefaae7000 C:\Windows\system32\IPHLPAPI.DLL 0x000007fefaab0000 - 0x000007fefaabb000 C:\Windows\system32\WINNSI.DLL 0x000007fef9320000 - 0x000007fef9328000 C:\Windows\system32\rasadhlp.dll 0x000007fefa800000 - 0x000007fefa853000 C:\Windows\System32\fwpuclnt.dll 0x000007fefcaf0000 - 0x000007fefcb07000 C:\Windows\system32\CRYPTSP.dll 0x000007fefc7f0000 - 0x000007fefc837000 C:\Windows\system32\rsaenh.dll 0x000007fefc550000 - 0x000007fefc56e000 C:\Windows\system32\USERENV.dll 0x000007fefd260000 - 0x000007fefd26f000 C:\Windows\system32\profapi.dll 0x000007fefd150000 - 0x000007fefd15f000 C:\Windows\system32\CRYPTBASE.dll 0x000007fefad40000 - 0x000007fefad55000 C:\Windows\system32\NLAapi.dll 0x000007fef9430000 - 0x000007fef9445000 C:\Windows\system32\napinsp.dll 0x000007fef9410000 - 0x000007fef9429000 C:\Windows\system32\pnrpnsp.dll 0x000007fef93e0000 - 0x000007fef93eb000 C:\Windows\System32\winrnr.dll 0x000000006b2e0000 - 0x000000006b2f1000 C:\devs\Java\jdk1.7.0_07\jre\bin\nio.dll 0x000007fef8d50000 - 0x000007fef8e75000 C:\Windows\system32\dbghelp.dll

VM Arguments: jvm_args: -ea -Dfile.encoding=Cp1252 java_command: org.testng.remote.RemoteTestNG -serport 42246 -d C:\devs\workspaces\use-case\smartcities-postprocess\test-output

C:\Users\meyerm4\AppData\Local\Temp\testng-eclipse-1428714906\testng-customsuite.xml

Launcher Type: SUN_STANDARD

Environment Variables: JAVA_HOME=C:\devs\Java\jdk1.7.0_07 CLASSPATH=.;C:\Program Files (x86)\Java\jre6\lib\ext\QTJava.zip

PATH=C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;"C:\Program

Files (x86)\Common

Files\EMC";C:\devs\apache-maven-3.2.1\bin;C:\devs\Groovy\Groovy-2.3.3\bin;C:\devs\Subversion\bin;C:\devs\Pivotal_GemFire_702_b45797\bin;C:\Program

Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\Nmap USERNAME=meyerm4 OS=Windows_NT PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 42 Stepping 7, GenuineIntel

--------------- S Y S T E M ---------------

OS: Windows 7 , 64 bit Build 7601 Service Pack 1

CPU:total 4 (2 cores per cpu, 2 threads per core) family 6 model 42 stepping 7, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, ht, tsc, tscinvbit

Memory: 4k page, physical 8269012k(4172292k free), swap 16536160k(11979168k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (23.3-b01) for windows-amd64 JRE (1.7.0_07-b11), built on Sep 7 2012 01:19:25 by "java_re" with unknown MS VC++:1600

time: Wed Sep 17 15:29:56 2014 elapsed time: 0 seconds

On Wed, Sep 17, 2014 at 4:13 PM, Roman Leventov < notifications@github.com>

wrote:

@ManuelPivotal https://github.com/ManuelPivotal your test performs equally uninteresting on my Windows machine: fail on map creation or success, depending on the map size. When I configured NO_ALIGNMENT and entrySize = 18 the map started to consume really not very much memory and the test finishes successfully even with map size = 10_000_000.

I don't see your attachment on github.

Here is my precise config from one of the crashed vm reports, if it is meaningful: --------------- S Y S T E M ---------------

OS: Windows 8.1 , 64 bit Build 9600

CPU:total 6 (6 cores per cpu, 1 threads per core) family 16 model 10 stepping 0, cmov, cx8, fxsr, mmx, sse, sse2, sse3, popcnt, mmxext, 3dnowpref, lzcnt, sse4a, tsc, tscinvbit

Memory: 4k page, physical 8386100k(4133016k free), swap 8386100k(2447272k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (25.5-b02) for windows-amd64 JRE (1.8.0_05-b13), built on Mar 18 2014 01:08:39 by "java_re" with MS VC++ 10.0 (VS2010)

— Reply to this email directly or view it on GitHub <

https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55908842>

.

— Reply to this email directly or view it on GitHub < https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55913394>

.

— Reply to this email directly or view it on GitHub https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55918269 .

@ManuelPivotal if you outrun 10_000_000, your should configure 20-byte entries, because the assumption behind number 18 is that keys and values are strings representing at most 7-digit numbers. If you run the test with size 30_000_000, two-thirds of all entries cannot fit the entry size and take two entries, which is allowed, but lead to x2 mem waste, some slowdowns and risk of map overflow.

if I want to map a java class with a 15 character long string as a key and a class of let's say 1 string of 12 chars and 1 string of 64 what would be the entrySice? The key will have a 15 char long constantly and the value will be made of 2 strings, 1 of 12 chars and 1 of 64

On Wed, Sep 17, 2014 at 5:14 PM, Roman Leventov notifications@github.com wrote:

@ManuelPivotal https://github.com/ManuelPivotal if you outrun 10_000_000, your should configure 20-byte entries, because the assumption behind number 18 is that keys and values are strings representing at most 7-digit numbers. If you run the test with size 30_000_000, two-thirds of all entries cannot fit the entry size and take two entries, which is allowed, but lead to x2 mem waste, some slowdowns and risk of map overflow.

— Reply to this email directly or view it on GitHub https://github.com/OpenHFT/HugeCollections/issues/42#issuecomment-55918644 .

Hi Roman,

do you need any assistance from myself? I am busy at the moment but I can try to reproduce the issue again at the weekend.

Jaromir

@ManuelPivotal Ordinary object header in serialized form takes 6 bytes, string headers are 3 bytes.

1 : key length + (15 + 1 : key string repr) + 1 : value length + 6 : header + (3 + 12) + (3 + 64) = 106 bytes. + 0-7 bytes depending on aligning configuration, I would set 128 bytes for any case.

Plus 10 bytes if you are going to use replication.

@jaromirs If you could set the appropriate entrySize and try to rerun the test on your environment, that would be very helpful, thanks.

Hi Roman,

I've done that (decreased entry size) and it does not crash anymore. I think I have actually the same issue as Manual - lack of memory. I've tried various combinations of entrySize and entries parameters and the issue happens if entrySize * entries > X (I am not sure about accurate value of X). The question is why the callstack says that the JVM crashed in lock method.

One interesting observation: when I use entrySize=256 and entries=15,000,000 I get the crash with second put into the map and the callstack says the issue is in lock method. When I decreased number of entries to 10,000,000 the application crashes when it tries to create the map - that is odd.

Btw: would it be possible to check that the OS does not have enough resources to create such a big map and throw a standard java exception?

Thanks, Jaromir

Btw: would it be possible to check that the OS does not have enough resources to create such a big map and throw a standard java exception?

@jaromirs yes, we just discussed this privately. It is certaily worth to do this, we will try to investigate if it is possible and do if it is.

we have raised https://higherfrequencytrading.atlassian.net/browse/HCOLL-143

On 21 Sep 2014, at 20:39, Roman Leventov notifications@github.com wrote:

Btw: would it be possible to check that the OS does not have enough resources to create such a big map and throw a standard java exception?

@jaromirs yes, we just discussed this privately. It is certaily worth to do this, we will try to investigate if it is possible and do if it is.

— Reply to this email directly or view it on GitHub.

@jaromirs when you get this issue, are you running in windows ?

Yes, it only happens on Windows.

peter-lawrey / HugeCollections-OLD

SharedHashMap causing crash on Windows OS #42

A fatal error has been detected by the Java Runtime Environment:

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000665d3d86,

JRE version: 7.0_07-b11

Java VM: Java HotSpot(TM) 64-Bit Server VM (23.3-b01 mixed mode

Problematic frame:

V [jvm.dll+0x193d86]

Failed to write core dump. Minidumps are not enabled by default on client

If you would like to submit a bug report, please visit:

http://bugreport.sun.com/bugreport/crash.jsp

A fatal error has been detected by the Java Runtime Environment:

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000665d3d86,

JRE version: 7.0_07-b11

Java VM: Java HotSpot(TM) 64-Bit Server VM (23.3-b01 mixed mode

Problematic frame:

V [jvm.dll+0x193d86]

Failed to write core dump. Minidumps are not enabled by default on

If you would like to submit a bug report, please visit:

http://bugreport.sun.com/bugreport/crash.jsp

A fatal error has been detected by the Java Runtime Environment:

EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000665d3d86,

JRE version: 7.0_07-b11

Java VM: Java HotSpot(TM) 64-Bit Server VM (23.3-b01 mixed mode

Problematic frame:

V [jvm.dll+0x193d86]

Failed to write core dump. Minidumps are not enabled by default on

If you would like to submit a bug report, please visit:

http://bugreport.sun.com/bugreport/crash.jsp