Exception in thread "main" java.lang.NullPointerException

[botpsv]

Hi there, When i run ./run_application_mode.sh , an error occurs as the output below:

root@homepc:~/athena/athena-tester# ./run_application_mode.sh
OpenJDK 64-Bit Server VM warning: INFO: os::commit_memory(0x00007fe3b3e00000, 17179869184, 0) failed; error='Cannot allocate memory' (errno=12)
#
# There is insufficient memory for the Java Runtime Environment to continue.
# Native memory allocation (mmap) failed to map 17179869184 bytes for committing reserved memory.
# An error report file with more information is saved as:
# /root/athena/athena-tester/hs_err_pid10793.log

Here is the content of the generated hs_err_pid10793.log file:

#
# There is insufficient memory for the Java Runtime Environment to continue.
# Native memory allocation (mmap) failed to map 17179869184 bytes for committing reserved memory.
# Possible reasons:
#   The system is out of physical RAM or swap space
# Possible solutions:
#   Reduce memory load on the system
#   Increase physical memory or swap space
#   Check if swap backing store is full
#   Decrease Java heap size (-Xmx/-Xms)
#   Decrease number of Java threads
#   Decrease Java thread stack sizes (-Xss)
#   Set larger code cache with -XX:ReservedCodeCacheSize=
# This output file may be truncated or incomplete.
#
#  Out of Memory Error (os_linux.cpp:2756), pid=10793, tid=0x00007fe7caa2d700
#
# JRE version:  (8.0_212-b03) (build )
# Java VM: OpenJDK 64-Bit Server VM (25.212-b03 mixed mode linux-amd64 )
# Failed to write core dump. Core dumps have been disabled. To enable core dumping, try "ulimit -c unlimited" before starting Java again
#

---------------  T H R E A D  ---------------

Current thread (0x00007fe7c400b000):  JavaThread "Unknown thread" [_thread_in_vm, id=10820, stack(0x00007fe7ca92d000,0x00007fe7caa2e000)]

Stack: [0x00007fe7ca92d000,0x00007fe7caa2e000],  sp=0x00007fe7caa2c670,  free space=1021k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V  [libjvm.so+0xa75a3b]
V  [libjvm.so+0x4c9e6c]
V  [libjvm.so+0x8c2798]
V  [libjvm.so+0x8b9dde]
V  [libjvm.so+0x937e46]
V  [libjvm.so+0x939e5d]
V  [libjvm.so+0x2b0a97]
V  [libjvm.so+0x8e7e79]
V  [libjvm.so+0xa38e49]
V  [libjvm.so+0xa39092]
V  [libjvm.so+0x614eef]
V  [libjvm.so+0xa1e4bb]
V  [libjvm.so+0x68ea32]  JNI_CreateJavaVM+0x62
C  [libjli.so+0x2ebf]
C  [libjli.so+0x737d]
C  [libpthread.so.0+0x76ba]  start_thread+0xca

---------------  P R O C E S S  ---------------

Java Threads: ( => current thread )

Other Threads:

=>0x00007fe7c400b000 (exited) JavaThread "Unknown thread" [_thread_in_vm, id=10820, stack(0x00007fe7ca92d000,0x00007fe7caa2e000)]

VM state:not at safepoint (not fully initialized)

VM Mutex/Monitor currently owned by a thread: None

GC Heap History (0 events):
No events

Deoptimization events (0 events):
No events

Classes redefined (0 events):
No events

Internal exceptions (0 events):
No events

Events (0 events):
No events

Dynamic libraries:
00400000-00401000 r-xp 00000000 08:0c 3279636                            /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java
00600000-00601000 r--p 00000000 08:0c 3279636                            /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java
00601000-00602000 rw-p 00001000 08:0c 3279636                            /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java
00ea5000-00ec6000 rw-p 00000000 00:00 0                                  [heap]
7fdbaddff000-7fdbb3dff000 ---p 00000000 00:00 0 
7fdbb3dff000-7fdbb3e00000 rw-p 00000000 00:00 0 
7fdbb3e00000-7fe3b3e00000 ---p 00000000 00:00 0 
7fe7b3fc9000-7fe7b3fd3000 rw-p 00000000 00:00 0 
7fe7b3fd3000-7fe7b4389000 ---p 00000000 00:00 0 
7fe7b4389000-7fe7b45f9000 rwxp 00000000 00:00 0 
7fe7b45f9000-7fe7c3389000 ---p 00000000 00:00 0 
7fe7c3389000-7fe7c3391000 r-xp 00000000 08:0c 3279697                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/libzip.so
7fe7c3391000-7fe7c3590000 ---p 00008000 08:0c 3279697                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/libzip.so
7fe7c3590000-7fe7c3591000 r--p 00007000 08:0c 3279697                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/libzip.so
7fe7c3591000-7fe7c3592000 rw-p 00008000 08:0c 3279697                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/libzip.so
7fe7c3592000-7fe7c359d000 r-xp 00000000 08:0c 2626579                    /lib/x86_64-linux-gnu/libnss_files-2.23.so
7fe7c359d000-7fe7c379c000 ---p 0000b000 08:0c 2626579                    /lib/x86_64-linux-gnu/libnss_files-2.23.so
7fe7c379c000-7fe7c379d000 r--p 0000a000 08:0c 2626579                    /lib/x86_64-linux-gnu/libnss_files-2.23.so
7fe7c379d000-7fe7c379e000 rw-p 0000b000 08:0c 2626579                    /lib/x86_64-linux-gnu/libnss_files-2.23.so
7fe7c379e000-7fe7c37a4000 rw-p 00000000 00:00 0 
7fe7c37a4000-7fe7c37af000 r-xp 00000000 08:0c 2626589                    /lib/x86_64-linux-gnu/libnss_nis-2.23.so
7fe7c37af000-7fe7c39ae000 ---p 0000b000 08:0c 2626589                    /lib/x86_64-linux-gnu/libnss_nis-2.23.so
7fe7c39ae000-7fe7c39af000 r--p 0000a000 08:0c 2626589                    /lib/x86_64-linux-gnu/libnss_nis-2.23.so
7fe7c39af000-7fe7c39b0000 rw-p 0000b000 08:0c 2626589                    /lib/x86_64-linux-gnu/libnss_nis-2.23.so
7fe7c39b0000-7fe7c39c6000 r-xp 00000000 08:0c 2626573                    /lib/x86_64-linux-gnu/libnsl-2.23.so
7fe7c39c6000-7fe7c3bc5000 ---p 00016000 08:0c 2626573                    /lib/x86_64-linux-gnu/libnsl-2.23.so
7fe7c3bc5000-7fe7c3bc6000 r--p 00015000 08:0c 2626573                    /lib/x86_64-linux-gnu/libnsl-2.23.so
7fe7c3bc6000-7fe7c3bc7000 rw-p 00016000 08:0c 2626573                    /lib/x86_64-linux-gnu/libnsl-2.23.so
7fe7c3bc7000-7fe7c3bc9000 rw-p 00000000 00:00 0 
7fe7c3bc9000-7fe7c3bd1000 r-xp 00000000 08:0c 2626575                    /lib/x86_64-linux-gnu/libnss_compat-2.23.so
7fe7c3bd1000-7fe7c3dd0000 ---p 00008000 08:0c 2626575                    /lib/x86_64-linux-gnu/libnss_compat-2.23.so
7fe7c3dd0000-7fe7c3dd1000 r--p 00007000 08:0c 2626575                    /lib/x86_64-linux-gnu/libnss_compat-2.23.so
7fe7c3dd1000-7fe7c3dd2000 rw-p 00008000 08:0c 2626575                    /lib/x86_64-linux-gnu/libnss_compat-2.23.so
7fe7c3dd2000-7fe7c3dfe000 r-xp 00000000 08:0c 3279678                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/libjava.so
7fe7c3dfe000-7fe7c3ffd000 ---p 0002c000 08:0c 3279678                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/libjava.so
7fe7c3ffd000-7fe7c3ffe000 r--p 0002b000 08:0c 3279678                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/libjava.so
7fe7c3ffe000-7fe7c4000000 rw-p 0002c000 08:0c 3279678                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/libjava.so
7fe7c4000000-7fe7c4032000 rw-p 00000000 00:00 0 
7fe7c4032000-7fe7c8000000 ---p 00000000 00:00 0 
7fe7c8009000-7fe7c8018000 r-xp 00000000 08:0c 3279666                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/libverify.so
7fe7c8018000-7fe7c8217000 ---p 0000f000 08:0c 3279666                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/libverify.so
7fe7c8217000-7fe7c8219000 r--p 0000e000 08:0c 3279666                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/libverify.so
7fe7c8219000-7fe7c821a000 rw-p 00010000 08:0c 3279666                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/libverify.so
7fe7c821a000-7fe7c8221000 r-xp 00000000 08:0c 2626634                    /lib/x86_64-linux-gnu/librt-2.23.so
7fe7c8221000-7fe7c8420000 ---p 00007000 08:0c 2626634                    /lib/x86_64-linux-gnu/librt-2.23.so
7fe7c8420000-7fe7c8421000 r--p 00006000 08:0c 2626634                    /lib/x86_64-linux-gnu/librt-2.23.so
7fe7c8421000-7fe7c8422000 rw-p 00007000 08:0c 2626634                    /lib/x86_64-linux-gnu/librt-2.23.so
7fe7c8422000-7fe7c8438000 r-xp 00000000 08:0c 2626518                    /lib/x86_64-linux-gnu/libgcc_s.so.1
7fe7c8438000-7fe7c8637000 ---p 00016000 08:0c 2626518                    /lib/x86_64-linux-gnu/libgcc_s.so.1
7fe7c8637000-7fe7c8638000 rw-p 00015000 08:0c 2626518                    /lib/x86_64-linux-gnu/libgcc_s.so.1
7fe7c8638000-7fe7c8740000 r-xp 00000000 08:0c 2626550                    /lib/x86_64-linux-gnu/libm-2.23.so
7fe7c8740000-7fe7c893f000 ---p 00108000 08:0c 2626550                    /lib/x86_64-linux-gnu/libm-2.23.so
7fe7c893f000-7fe7c8940000 r--p 00107000 08:0c 2626550                    /lib/x86_64-linux-gnu/libm-2.23.so
7fe7c8940000-7fe7c8941000 rw-p 00108000 08:0c 2626550                    /lib/x86_64-linux-gnu/libm-2.23.so
7fe7c8941000-7fe7c8ab3000 r-xp 00000000 08:0c 3286511                    /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21
7fe7c8ab3000-7fe7c8cb3000 ---p 00172000 08:0c 3286511                    /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21
7fe7c8cb3000-7fe7c8cbd000 r--p 00172000 08:0c 3286511                    /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21
7fe7c8cbd000-7fe7c8cbf000 rw-p 0017c000 08:0c 3286511                    /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.21
7fe7c8cbf000-7fe7c8cc3000 rw-p 00000000 00:00 0 
7fe7c8cc3000-7fe7c9927000 r-xp 00000000 08:0c 3279676                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so
7fe7c9927000-7fe7c9b26000 ---p 00c64000 08:0c 3279676                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so
7fe7c9b26000-7fe7c9bba000 r--p 00c63000 08:0c 3279676                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so
7fe7c9bba000-7fe7c9be3000 rw-p 00cf7000 08:0c 3279676                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/server/libjvm.so
7fe7c9be3000-7fe7c9c13000 rw-p 00000000 00:00 0 
7fe7c9c13000-7fe7c9c2b000 r-xp 00000000 08:0c 2626626                    /lib/x86_64-linux-gnu/libpthread-2.23.so
7fe7c9c2b000-7fe7c9e2a000 ---p 00018000 08:0c 2626626                    /lib/x86_64-linux-gnu/libpthread-2.23.so
7fe7c9e2a000-7fe7c9e2b000 r--p 00017000 08:0c 2626626                    /lib/x86_64-linux-gnu/libpthread-2.23.so
7fe7c9e2b000-7fe7c9e2c000 rw-p 00018000 08:0c 2626626                    /lib/x86_64-linux-gnu/libpthread-2.23.so
7fe7c9e2c000-7fe7c9e30000 rw-p 00000000 00:00 0 
7fe7c9e30000-7fe7c9e33000 r-xp 00000000 08:0c 2626504                    /lib/x86_64-linux-gnu/libdl-2.23.so
7fe7c9e33000-7fe7ca032000 ---p 00003000 08:0c 2626504                    /lib/x86_64-linux-gnu/libdl-2.23.so
7fe7ca032000-7fe7ca033000 r--p 00002000 08:0c 2626504                    /lib/x86_64-linux-gnu/libdl-2.23.so
7fe7ca033000-7fe7ca034000 rw-p 00003000 08:0c 2626504                    /lib/x86_64-linux-gnu/libdl-2.23.so
7fe7ca034000-7fe7ca04d000 r-xp 00000000 08:0c 2626671                    /lib/x86_64-linux-gnu/libz.so.1.2.8
7fe7ca04d000-7fe7ca24c000 ---p 00019000 08:0c 2626671                    /lib/x86_64-linux-gnu/libz.so.1.2.8
7fe7ca24c000-7fe7ca24d000 r--p 00018000 08:0c 2626671                    /lib/x86_64-linux-gnu/libz.so.1.2.8
7fe7ca24d000-7fe7ca24e000 rw-p 00019000 08:0c 2626671                    /lib/x86_64-linux-gnu/libz.so.1.2.8
7fe7ca24e000-7fe7ca40e000 r-xp 00000000 08:0c 2626480                    /lib/x86_64-linux-gnu/libc-2.23.so
7fe7ca40e000-7fe7ca60e000 ---p 001c0000 08:0c 2626480                    /lib/x86_64-linux-gnu/libc-2.23.so
7fe7ca60e000-7fe7ca612000 r--p 001c0000 08:0c 2626480                    /lib/x86_64-linux-gnu/libc-2.23.so
7fe7ca612000-7fe7ca614000 rw-p 001c4000 08:0c 2626480                    /lib/x86_64-linux-gnu/libc-2.23.so
7fe7ca614000-7fe7ca618000 rw-p 00000000 00:00 0 
7fe7ca618000-7fe7ca625000 r-xp 00000000 08:0c 3279696                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/jli/libjli.so
7fe7ca625000-7fe7ca824000 ---p 0000d000 08:0c 3279696                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/jli/libjli.so
7fe7ca824000-7fe7ca825000 r--p 0000c000 08:0c 3279696                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/jli/libjli.so
7fe7ca825000-7fe7ca826000 rw-p 0000d000 08:0c 3279696                    /usr/lib/jvm/java-8-openjdk-amd64/jre/lib/amd64/jli/libjli.so
7fe7ca826000-7fe7ca84c000 r-xp 00000000 08:0c 2626452                    /lib/x86_64-linux-gnu/ld-2.23.so
7fe7ca92d000-7fe7ca930000 ---p 00000000 00:00 0 
7fe7ca930000-7fe7caa32000 rw-p 00000000 00:00 0 
7fe7caa40000-7fe7caa48000 rw-s 00000000 08:0c 794249                     /tmp/hsperfdata_root/10793
7fe7caa48000-7fe7caa49000 rw-p 00000000 00:00 0 
7fe7caa49000-7fe7caa4a000 r--p 00000000 00:00 0 
7fe7caa4a000-7fe7caa4b000 rw-p 00000000 00:00 0 
7fe7caa4b000-7fe7caa4c000 r--p 00025000 08:0c 2626452                    /lib/x86_64-linux-gnu/ld-2.23.so
7fe7caa4c000-7fe7caa4d000 rw-p 00026000 08:0c 2626452                    /lib/x86_64-linux-gnu/ld-2.23.so
7fe7caa4d000-7fe7caa4e000 rw-p 00000000 00:00 0 
7fff3e46d000-7fff3e48f000 rw-p 00000000 00:00 0                          [stack]
7fff3e50f000-7fff3e512000 r--p 00000000 00:00 0                          [vvar]
7fff3e512000-7fff3e514000 r-xp 00000000 00:00 0                          [vdso]
ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]

VM Arguments:
jvm_args: -Xms48G -Xmx48G 
java_command: org.apache.spark.deploy.SparkSubmit --master spark://127.0.0.1:7077 --conf spark.driver.memory=48G --class athena.user.application.Main --executor-memory 48G target/athena-tester-1.6.0.jar
java_class_path (initial): /root/Applications/spark-1.6.1-bin-hadoop2.6/conf/:/root/Applications/spark-1.6.1-bin-hadoop2.6/lib/spark-assembly-1.6.1-hadoop2.6.0.jar:/root/Applications/spark-1.6.1-bin-hadoop2.6/lib/datanucleus-rdbms-3.2.9.jar:/root/Applications/spark-1.6.1-bin-hadoop2.6/lib/datanucleus-core-3.2.10.jar:/root/Applications/spark-1.6.1-bin-hadoop2.6/lib/datanucleus-api-jdo-3.2.6.jar
Launcher Type: SUN_STANDARD

Environment Variables:
JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
CLASSPATH=:/root/Applications/jfreechart/lib/servlet.jar
PATH=/root/Applications/spark-1.6.1-bin-hadoop2.6/bin:/root/Applications/spark-1.6.1-bin-hadoop2.6/bin:/root/Applications/spark-1.6.1-bin-hadoop2.6/bin:/root/Applications/spark-1.6.1-bin-hadoop2.6/bin:/root/Applications/spark-1.6.1-bin-hadoop2.6/bin:/root/Applications/spark-1.6.1-bin-hadoop2.6/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/root/onos/tools/dev/bin:/root/onos/tools/test/bin:/root/onos/tools/test/scenarios/bin:/root/onos/tools/build:/root/Applications/apache-maven-3.3.9/bin:/root/Applications/apache-karaf-3.0.5/bin:/root/onos/tools/dev/bin:/root/onos/tools/test/bin:/root/onos/tools/test/scenarios/bin:/root/onos/tools/build:/root/Applications/apache-maven-3.3.9/bin:/root/Applications/apache-karaf-3.0.5/bin:/root/onos/tools/dev/bin:/root/onos/tools/test/bin:/root/onos/tools/test/scenarios/bin:/root/onos/tools/build:/root/Applications/apache-maven-3.3.9/bin:/root/Applications/apache-karaf-3.0.5/bin:/root/onos/tools/dev/bin:/root/onos/tools/test/bin:/root/onos/tools/test/scenarios/bin:/root/onos/tools/build:/root/Applications/apache-maven-3.3.9/bin:/root/Applications/apache-karaf-3.0.5/bin:/root/onos/tools/dev/bin:/root/onos/tools/test/bin:/root/onos/tools/test/scenarios/bin:/root/onos/tools/build:/root/Applications/apache-maven-3.3.9/bin:/root/Applications/apache-karaf-3.0.5/bin:/root/onos/tools/dev/bin:/root/onos/tools/test/bin:/root/onos/tools/test/scenarios/bin:/root/onos/tools/build:/root/Applications/apache-maven-3.3.9/bin:/root/Applications/apache-karaf-3.0.5/bin
USERNAME=root
SHELL=/bin/bash
DISPLAY=:0

Signal Handlers:
SIGSEGV: [libjvm.so+0xa765a0], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGBUS: [libjvm.so+0xa765a0], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGFPE: [libjvm.so+0x8bd800], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGPIPE: [libjvm.so+0x8bd800], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGXFSZ: [libjvm.so+0x8bd800], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGILL: [libjvm.so+0x8bd800], sa_mask[0]=11111111011111111101111111111110, sa_flags=SA_RESTART|SA_SIGINFO
SIGUSR1: SIG_DFL, sa_mask[0]=00000000000000000000000000000000, sa_flags=none
SIGUSR2: [libjvm.so+0x8bd6b0], sa_mask[0]=00000000000000000000000000000000, sa_flags=SA_RESTART|SA_SIGINFO
SIGHUP: SIG_DFL, sa_mask[0]=00000000000000000000000000000000, sa_flags=none
SIGINT: SIG_DFL, sa_mask[0]=00000000000000000000000000000000, sa_flags=none
SIGTERM: SIG_DFL, sa_mask[0]=00000000000000000000000000000000, sa_flags=none
SIGQUIT: SIG_DFL, sa_mask[0]=00000000000000000000000000000000, sa_flags=none

---------------  S Y S T E M  ---------------

OS:DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=16.04
DISTRIB_CODENAME=xenial
DISTRIB_DESCRIPTION="Ubuntu 16.04.6 LTS"

uname:Linux 4.15.0-50-generic #54~16.04.1-Ubuntu SMP Wed May 8 15:55:19 UTC 2019 x86_64
libc:glibc 2.23 NPTL 2.23 
rlimit: STACK 8192k, CORE 0k, NPROC 30869, NOFILE 1048576, AS infinity
load average:1.79 1.93 2.05

/proc/meminfo:
MemTotal:        8064924 kB
MemFree:          610256 kB
MemAvailable:    1075608 kB
Buffers:           35264 kB
Cached:          1374292 kB
SwapCached:         1816 kB
Active:          5762068 kB
Inactive:        1244452 kB
Active(anon):    5420488 kB
Inactive(anon):   978516 kB
Active(file):     341580 kB
Inactive(file):   265936 kB
Unevictable:       34692 kB
Mlocked:           34692 kB
SwapTotal:       1952764 kB
SwapFree:        1900528 kB
Dirty:               624 kB
Writeback:             0 kB
AnonPages:       5629996 kB
Mapped:           638080 kB
Shmem:            794556 kB
Slab:             233888 kB
SReclaimable:     164708 kB
SUnreclaim:        69180 kB
KernelStack:       19220 kB
PageTables:        75216 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:     5985224 kB
Committed_AS:   14889156 kB
VmallocTotal:   34359738367 kB
VmallocUsed:           0 kB
VmallocChunk:          0 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
ShmemHugePages:        0 kB
ShmemPmdMapped:        0 kB
CmaTotal:              0 kB
CmaFree:               0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      384156 kB
DirectMap2M:     7901184 kB
DirectMap1G:           0 kB

container (cgroup) information:
container_type: cgroupv1
cpu_cpuset_cpus: 0-3
cpu_memory_nodes: 0
active_processor_count: 4
cpu_quota: -1
cpu_period: 100000
cpu_shares: -1
memory_limit_in_bytes: -1
memory_and_swap_limit_in_bytes: -2
memory_soft_limit_in_bytes: -1
memory_usage_in_bytes: 7210545152
memory_max_usage_in_bytes: 34762752

CPU:total 4 (initial active 4) (2 cores per cpu, 2 threads per core) family 6 model 142 stepping 9, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1, sse4.2, popcnt, avx, avx2, aes, clmul, erms, 3dnowpref, lzcnt, ht, tsc, tscinvbit, bmi1, bmi2, adx

/proc/cpuinfo:
processor   : 0
vendor_id   : GenuineIntel
cpu family  : 6
model       : 142
model name  : Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz
stepping    : 9
microcode   : 0xb4
cpu MHz     : 600.015
cache size  : 3072 KB
physical id : 0
siblings    : 4
core id     : 0
cpu cores   : 2
apicid      : 0
initial apicid  : 0
fpu     : yes
fpu_exception   : yes
cpuid level : 22
wp      : yes
flags       : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single pti ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx rdseed adx smap clflushopt intel_pt xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp md_clear flush_l1d
bugs        : cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds
bogomips    : 5424.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor   : 1
vendor_id   : GenuineIntel
cpu family  : 6
model       : 142
model name  : Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz
stepping    : 9
microcode   : 0xb4
cpu MHz     : 619.772
cache size  : 3072 KB
physical id : 0
siblings    : 4
core id     : 1
cpu cores   : 2
apicid      : 2
initial apicid  : 2
fpu     : yes
fpu_exception   : yes
cpuid level : 22
wp      : yes
flags       : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single pti ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx rdseed adx smap clflushopt intel_pt xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp md_clear flush_l1d
bugs        : cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds
bogomips    : 5424.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor   : 2
vendor_id   : GenuineIntel
cpu family  : 6
model       : 142
model name  : Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz
stepping    : 9
microcode   : 0xb4
cpu MHz     : 600.635
cache size  : 3072 KB
physical id : 0
siblings    : 4
core id     : 0
cpu cores   : 2
apicid      : 1
initial apicid  : 1
fpu     : yes
fpu_exception   : yes
cpuid level : 22
wp      : yes
flags       : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single pti ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx rdseed adx smap clflushopt intel_pt xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp md_clear flush_l1d
bugs        : cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds
bogomips    : 5424.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

processor   : 3
vendor_id   : GenuineIntel
cpu family  : 6
model       : 142
model name  : Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz
stepping    : 9
microcode   : 0xb4
cpu MHz     : 600.011
cache size  : 3072 KB
physical id : 0
siblings    : 4
core id     : 1
cpu cores   : 2
apicid      : 3
initial apicid  : 3
fpu     : yes
fpu_exception   : yes
cpuid level : 22
wp      : yes
flags       : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb invpcid_single pti ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid mpx rdseed adx smap clflushopt intel_pt xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp md_clear flush_l1d
bugs        : cpu_meltdown spectre_v1 spectre_v2 spec_store_bypass l1tf mds
bogomips    : 5424.00
clflush size    : 64
cache_alignment : 64
address sizes   : 39 bits physical, 48 bits virtual
power management:

Memory: 4k page, physical 8064924k(609760k free), swap 1952764k(1900528k free)

vm_info: OpenJDK 64-Bit Server VM (25.212-b03) for linux-amd64 JRE (1.8.0_212-8u212-b03-0ubuntu1.16.04.1-b03), built on Apr 26 2019 02:02:50 by "buildd" with gcc 5.4.0 20160609

time: Mon May 27 19:35:41 2019
timezone: WIB
elapsed time: 0 seconds (0d 0h 0m 0s)

This line from crash log seems interesting to me:

VM Arguments:
jvm_args: -Xms48G -Xmx48G 

and this one that I presume my own memory Memory: 4k page, physical 8064924k(609760k free), swap 1952764k(1900528k free)

Does it mean that the machine has memory but is running out of ram/swap space? How much ram/swap does it need to run Athena in 'batch mode'? Or Should i decrease java heap 'Xms Xmx' size?

Thanks in advance

[botpsv]

I've tried to decrease --driver-memory 48G --executor-memory 48GB from ./run_application_mode.sh to --driver-memory 8G --executor-memory 8GB

However I get these errors:

root@homepc:~/athena/athena-tester# ./run_application_mode.sh
Exception in thread "main" java.lang.NullPointerException
    at athena.northbound.impl.MachineLearningManagerImpl.<init>(MachineLearningManagerImpl.java:136)
    at athena.user.application.Main.<init>(Main.java:115)
    at athena.user.application.Main.main(Main.java:118)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
    at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
    at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
    at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
    at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

[benedhk]

I've tried to decrease --driver-memory 48G --executor-memory 48GB from ./run_application_mode.sh to --driver-memory 8G --executor-memory 8GB

However I get these errors:

root@homepc:~/athena/athena-tester# ./run_application_mode.sh
Exception in thread "main" java.lang.NullPointerException
  at athena.northbound.impl.MachineLearningManagerImpl.<init>(MachineLearningManagerImpl.java:136)
  at athena.user.application.Main.<init>(Main.java:115)
  at athena.user.application.Main.main(Main.java:118)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)
  at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
  at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
  at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
  at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
  at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

I assume that I'm experiencing the same issue. There might be some bug from the code you can found it in ~/athena/athena-tester/src/main/java/athena/user/application/

[botpsv]

Hey Ben, thanks for responding to my issues

After seeing the issues from #5 @shlee89 . I have analyzed the issues and concluded that every time you open a new terminal, the configuration like the exported environment variable will be lost. Therefore every time you open a new terminal you have to execute the bash script. In this case, all environment variables are located at athena / tools / dev / bash_profile.

Let's say we are all lazy folks haha, it would be better to copy the contents of Athena's bash_profile to the native bash script on the machine (that we called bashrc). By executing the source ~/.bashrc command every time you open a new terminal, it will save a lot of time. My previous mistake was because it wasn't an environment variable associated with Athena or every time I opened a new terminal the environment variable configuration was lost.

One more thing, just add these line below to your bash script. The last line depends on what you will configure (single or distributed) e.g mine -> single

export ATHENA_ROOT=~/athena
source $ATHENA_ROOT/athena-tool/config/athena-config-env-single

source: https://askubuntu.com/questions/395212/why-environment-variable-disappears-after-terminal-reopen https://unix.stackexchange.com/questions/102051/exported-variable-disappears-when-i-open-a-new-terminal

Thats all.

[shlee89]

Thank you for providing detailed instruction to resolve this issue.

On Wed, May 29, 2019, 12:48 PM Dave notifications@github.com wrote:

Closed #8 https://github.com/shlee89/athena/issues/8.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/shlee89/athena/issues/8?email_source=notifications&email_token=ABOCAGODNPIIAHROYXOOTM3PXX4IDA5CNFSM4HP3W442YY3PNVWWK3TUL52HS4DFWZEXG43VMVCXMZLOORHG65DJMZUWGYLUNFXW5KTDN5WW2ZLOORPWSZGORV6PSPI#event-2373777725, or mute the thread https://github.com/notifications/unsubscribe-auth/ABOCAGIIWQOLK2RD3QNGW3LPXX4IDANCNFSM4HP3W44Q .