search

yaobaiwei / GMiner

An efficient large-scale graph mining framework.
Apache License 2.0
63 stars 24 forks source link

OGBNPapers100M #9

Closed jeongminpark417 closed 5 months ago

jeongminpark417 commented 8 months ago

I am trying to run normal_bdg partitioning for ogbnpapers100M dataset. However, I am getting this error.

2024-04-05 02:07:14,842 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using bu
iltin-java classes where applicable                                               
[bafs-01:61282:0:61282] Caught signal 11 (Segmentation fault: address not mapped to object at address (nil))
BFD: DWARF error: section .debug_info is larger than its filesize! (0x93ef57 vs 0x530ea0)
BFD: DWARF error: section .debug_info is larger than its filesize! (0x93ef57 vs 0x530ea0)
BFD: DWARF error: section .debug_info is larger than its filesize! (0x93ef57 vs 0x530ea0)
BFD: DWARF error: section .debug_info is larger than its filesize! (0x93ef57 vs 0x530ea0)
==== backtrace (tid:  61282) ====                                                                                                                                   
 0 0x0000000000beb3d9 os::Linux::chained_handler()  ???:0                 
 1 0x0000000000bf10eb JVM_handle_linux_signal()  ???:0
 2 0x0000000000be3c8c signalHandler()  ???:0
 3 0x0000000000014420 __funlockfile()  :0 
 4 0x0000000000048b3a strtoul()  ???:0
 5 0x000000000001a9d5 normal_BDGPartitioner::to_vertex()  ???:0
 6 0x0000000000026593 Driver<normal_BDGPartVertex>::load_graph()  ???:0
 7 0x0000000000030ecf BPartitioner<normal_BDGPartVertex>::run()  ???:0
 8 0x000000000001b579 partitioner_exec()  ???:0
 9 0x000000000001608b main()  ???:0
10 0x0000000000024083 __libc_start_main()  ???:0
11 0x00000000000162be _start()  ???:0
=================================
[bafs-01:61282] *** Process received signal ***
[bafs-01:61282] Signal: Segmentation fault (11)
[bafs-01:61282] Signal code:  (-6)
[bafs-01:61282] Failing at address: 0xef62
[bafs-01:61282] [ 0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420)[0x7fb41d223420]
[bafs-01:61282] [ 1] /lib/x86_64-linux-gnu/libc.so.6(+0x48b3a)[0x7fb41cc8eb3a]
[bafs-01:61282] [ 2] /root/GMiner//release/partition(_ZN21normal_BDGPartitioner9to_vertexEPc+0xd5)[0x56156c3079d5]
[bafs-01:61282] [ 3] /root/GMiner//release/partition(_ZN6DriverI20normal_BDGPartVertexE10load_graphEPKc+0xb3)[0x56156c313593]
[bafs-01:61282] [ 4] /root/GMiner//release/partition(_ZN12BPartitionerI20normal_BDGPartVertexE3runERK12WorkerParams+0xbf)[0x56156c31decf]
[bafs-01:61282] [ 5] /root/GMiner//release/partition(_Z16partitioner_execiPPcRK12WorkerParams+0xf9)[0x56156c308579]
[bafs-01:61282] [ 6] /root/GMiner//release/partition(main+0xcb)[0x56156c30308b]
[bafs-01:61282] [ 7] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf3)[0x7fb41cc6a083]
[bafs-01:61282] [ 8] /root/GMiner//release/partition(_start+0x2e)[0x56156c3032be]
[bafs-01:61282] *** End of error message ***

I modified the normal sample file like

0       1 2 3 40
1       3 2 4 5
2       3 1 3 5
3       4 2 4 5 13
4       4 1 3 5 9
5       4 1 2 3 4
6       3 7 9 10
7       4 6 8 10 11
8       3 7 9 10
9       4 4 6 8 10
10      4 6 7 8 9
11      4 7 12 14 15
12      3 11 13 15
13      4 3 12 14 15
14      3 11 13 15
15      4 11 12 13 14 16
16      1
40      2 3 4

by adding nodes 16 and 40 in the graph. But this also gives the same error. Is there a requirement for the graph structure, if so is it possible to run on ogbnpapers100M dataset?