zeroall commented 5 years ago

Please answer these questions before submitting your issue.

Why do you submit this issue?
[ ] Question or discussion
[ x] Bug
[ ] Requirement
[ ] Feature or performance improvement

Question

What do you want to know? When I use oapService Init.sh or oapService.sh to start skywalking-collector, the main thread will carton on the org.apache.skywalking.oap.server.core.annotation Annotation Scan.scan method. At this time, CPU, memory are constantly increasing, JVM continues to carry out Full GC, and finally outburst OutOfMemoryError exception. Moving - Xmx to 8G won't help. The error message is as follows: 2019-06-29 11:20:16,826 - org.apache.skywalking.oap.server.starter.OAPServerStartUp - 55 [main] ERROR [] - GC overhead limit exceeded java.lang.OutOfMemoryError: GC overhead limit exceeded at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:497) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?] at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) ~[guava-20.0.jar:?]

The complete stack information is as follows: "main" #1 prio=5 os_prio=0 tid=0x00002b0ad4014000 nid=0x536f runnable [0x00002b0acece4000] java.lang.Thread.State: RUNNABLE at java.io.UnixFileSystem.getBooleanAttributes0(Native Method) at java.io.UnixFileSystem.getBooleanAttributes(UnixFileSystem.java:242) at java.io.File.isDirectory(File.java:849) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:494) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:495) at com.google.common.reflect.ClassPath$DefaultScanner.scanDirectory(ClassPath.java:481) at com.google.common.reflect.ClassPath$Scanner.scanFrom(ClassPath.java:360) at com.google.common.reflect.ClassPath$Scanner.scan(ClassPath.java:345) at com.google.common.reflect.ClassPath$Scanner.scan(ClassPath.java:332) at com.google.common.reflect.ClassPath.from(ClassPath.java:97) at org.apache.skywalking.oap.server.core.annotation.AnnotationScan.scan(AnnotationScan.java:43) at org.apache.skywalking.oap.server.core.CoreModuleProvider.prepare(CoreModuleProvider.java:96) at org.apache.skywalking.oap.server.library.module.ModuleDefine.prepare(ModuleDefine.java:95) at org.apache.skywalking.oap.server.library.module.ModuleManager.init(ModuleManager.java:50) at org.apache.skywalking.oap.server.starter.OAPServerStartUp.main(OAPServerStartUp.java:43)

Bug

Which version of SkyWalking, OS and JRE? SkyWalking: 6.1.0 jdk: 1.8.0_161-b12 linux: Linux version 3.10.0-957.21.3.el7.x86_64
Which company or project?
What happen? If possible, provide a way for reproducing the error. e.g. demo application, component version.

system infos: abi.vsyscall32 = 1 crypto.fips_enabled = 0 debug.exception-trace = 1 debug.kprobes-optimization = 1 debug.panic_on_rcu_stall = 0 dev.cdrom.autoclose = 1 dev.cdrom.autoeject = 0 dev.cdrom.check_media = 0 dev.cdrom.debug = 0 dev.cdrom.info = CD-ROM information, Id: cdrom.c 3.20 2003/12/17 dev.cdrom.info = dev.cdrom.info = drive name: sr0 dev.cdrom.info = drive speed: 1 dev.cdrom.info = drive # of slots: 1 dev.cdrom.info = Can close tray: 1 dev.cdrom.info = Can open tray: 1 dev.cdrom.info = Can lock tray: 1 dev.cdrom.info = Can change speed: 1 dev.cdrom.info = Can select disk: 0 dev.cdrom.info = Can read multisession: 1 dev.cdrom.info = Can read MCN: 1 dev.cdrom.info = Reports media changed: 1 dev.cdrom.info = Can play audio: 1 dev.cdrom.info = Can write CD-R: 1 dev.cdrom.info = Can write CD-RW: 1 dev.cdrom.info = Can read DVD: 1 dev.cdrom.info = Can write DVD-R: 1 dev.cdrom.info = Can write DVD-RAM: 1 dev.cdrom.info = Can read MRW: 1 dev.cdrom.info = Can write MRW: 1 dev.cdrom.info = Can write RAM: 1 dev.cdrom.info = dev.cdrom.info = dev.cdrom.lock = 1 dev.hpet.max-user-freq = 64 dev.mac_hid.mouse_button2_keycode = 97 dev.mac_hid.mouse_button3_keycode = 100 dev.mac_hid.mouse_button_emulation = 0 dev.parport.default.spintime = 500 dev.parport.default.timeslice = 200 dev.raid.speed_limit_max = 200000 dev.raid.speed_limit_min = 1000 dev.scsi.logging_level = 0 fs.aio-max-nr = 65536 fs.aio-nr = 0 fs.binfmt_misc.status = enabled fs.dentry-state = 75299 55311 45 0 0 0 fs.dir-notify-enable = 1 fs.epoll.max_user_watches = 2514759 fs.file-max = 655360 fs.file-nr = 2016 0 655360 fs.inode-nr = 74224 343 fs.inode-state = 74224 343 0 0 0 0 0 fs.inotify.max_queued_events = 16384 fs.inotify.max_user_instances = 128 fs.inotify.max_user_watches = 8192 fs.lease-break-time = 45 fs.leases-enable = 1 fs.may_detach_mounts = 1 fs.mount-max = 100000 fs.mqueue.msg_default = 10 fs.mqueue.msg_max = 10 fs.mqueue.msgsize_default = 8192 fs.mqueue.msgsize_max = 8192 fs.mqueue.queues_max = 256 fs.nr_open = 1048576 fs.overflowgid = 65534 fs.overflowuid = 65534 fs.pipe-max-size = 1048576 fs.pipe-user-pages-hard = 0 fs.pipe-user-pages-soft = 16384 fs.protected_hardlinks = 1 fs.protected_symlinks = 1 fs.quota.allocated_dquots = 0 fs.quota.cache_hits = 0 fs.quota.drops = 0 fs.quota.free_dquots = 0 fs.quota.lookups = 0 fs.quota.reads = 0 fs.quota.syncs = 0 fs.quota.warnings = 1 fs.quota.writes = 0 fs.suid_dumpable = 0 fs.xfs.age_buffer_centisecs = 1500 fs.xfs.error_level = 3 fs.xfs.filestream_centisecs = 3000 fs.xfs.inherit_noatime = 1 fs.xfs.inherit_nodefrag = 1 fs.xfs.inherit_nodump = 1 fs.xfs.inherit_nosymlinks = 0 fs.xfs.inherit_sync = 1 fs.xfs.irix_sgid_inherit = 0 fs.xfs.irix_symlink_mode = 0 fs.xfs.panic_mask = 0 fs.xfs.rotorstep = 1 fs.xfs.speculative_prealloc_lifetime = 300 fs.xfs.stats_clear = 0 fs.xfs.xfsbufd_centisecs = 100 fs.xfs.xfssyncd_centisecs = 3000 kernel.acct = 4 2 30 kernel.acpi_video_flags = 0 kernel.auto_msgmni = 1 kernel.bootloader_type = 114 kernel.bootloader_version = 2 kernel.cad_pid = 1 kernel.cap_last_cap = 36 kernel.compat-log = 1 kernel.core_pattern = core kernel.core_pipe_limit = 0 kernel.core_uses_pid = 1 kernel.ctrl-alt-del = 0 kernel.dmesg_restrict = 0 kernel.domainname = (none) kernel.ftrace_dump_on_oops = 0 kernel.ftrace_enabled = 1 kernel.hardlockup_all_cpu_backtrace = 0 kernel.hardlockup_panic = 1 kernel.hostname = centos0 kernel.hotplug = kernel.hung_task_check_count = 4194304 kernel.hung_task_panic = 0 kernel.hung_task_timeout_secs = 120 kernel.hung_task_warnings = 10 kernel.io_delay_type = 0 kernel.kexec_load_disabled = 0 kernel.keys.gc_delay = 300 kernel.keys.maxbytes = 20000 kernel.keys.maxkeys = 200 kernel.keys.persistent_keyring_expiry = 259200 kernel.keys.root_maxbytes = 25000000 kernel.keys.root_maxkeys = 1000000 kernel.kptr_restrict = 0 kernel.max_lock_depth = 1024 kernel.modprobe = /sbin/modprobe kernel.modules_disabled = 0 kernel.msg_next_id = -1 kernel.msgmax = 65536 kernel.msgmnb = 65536 kernel.msgmni = 24029 kernel.ngroups_max = 65536 kernel.nmi_watchdog = 1 kernel.ns_last_pid = 15058 kernel.numa_balancing = 0 kernel.numa_balancing_scan_delay_ms = 1000 kernel.numa_balancing_scan_period_max_ms = 60000 kernel.numa_balancing_scan_period_min_ms = 1000 kernel.numa_balancing_scan_size_mb = 256 kernel.numa_balancing_settle_count = 4 kernel.osrelease = 3.10.0-957.21.3.el7.x86_64 kernel.ostype = Linux kernel.overflowgid = 65534 kernel.overflowuid = 65534 kernel.panic = 10 kernel.panic_on_io_nmi = 0 kernel.panic_on_oops = 1 kernel.panic_on_stackoverflow = 0 kernel.panic_on_unrecovered_nmi = 0 kernel.panic_on_warn = 0 kernel.perf_cpu_time_max_percent = 25 kernel.perf_event_max_sample_rate = 100000 kernel.perf_event_mlock_kb = 516 kernel.perf_event_paranoid = 2 kernel.pid_max = 32768 kernel.poweroff_cmd = /sbin/poweroff kernel.print-fatal-signals = 0 kernel.printk = 4 4 1 7 kernel.printk_delay = 0 kernel.printk_ratelimit = 5 kernel.printk_ratelimit_burst = 10 kernel.pty.max = 4096 kernel.pty.nr = 2 kernel.pty.reserve = 1024 kernel.random.boot_id = 4dbfdfd1-51c0-47d3-ac5a-317ba84494ee kernel.random.entropy_avail = 3484 kernel.random.poolsize = 4096 kernel.random.read_wakeup_threshold = 64 kernel.random.urandom_min_reseed_secs = 60 kernel.random.uuid = 6afdba8e-f8fd-49fc-8f21-90a302b2a529 kernel.random.write_wakeup_threshold = 896 kernel.randomize_va_space = 2 kernel.real-root-dev = 0 kernel.sched_autogroup_enabled = 0 kernel.sched_cfs_bandwidth_slice_us = 5000 kernel.sched_child_runs_first = 0 kernel.sched_domain.cpu0.domain0.busy_factor = 32 kernel.sched_domain.cpu0.domain0.busy_idx = 2 kernel.sched_domain.cpu0.domain0.cache_nice_tries = 1 kernel.sched_domain.cpu0.domain0.flags = 559 kernel.sched_domain.cpu0.domain0.forkexec_idx = 0 kernel.sched_domain.cpu0.domain0.idle_idx = 0 kernel.sched_domain.cpu0.domain0.imbalance_pct = 117 kernel.sched_domain.cpu0.domain0.max_interval = 4 kernel.sched_domain.cpu0.domain0.max_newidle_lb_cost = 9707 kernel.sched_domain.cpu0.domain0.min_interval = 2 kernel.sched_domain.cpu0.domain0.name = MC kernel.sched_domain.cpu0.domain0.newidle_idx = 0 kernel.sched_domain.cpu0.domain0.wake_idx = 0 kernel.sched_domain.cpu0.domain1.busy_factor = 32 kernel.sched_domain.cpu0.domain1.busy_idx = 2 kernel.sched_domain.cpu0.domain1.cache_nice_tries = 1 kernel.sched_domain.cpu0.domain1.flags = 4143 kernel.sched_domain.cpu0.domain1.forkexec_idx = 0 kernel.sched_domain.cpu0.domain1.idle_idx = 1 kernel.sched_domain.cpu0.domain1.imbalance_pct = 125 kernel.sched_domain.cpu0.domain1.max_interval = 8 kernel.sched_domain.cpu0.domain1.max_newidle_lb_cost = 7217 kernel.sched_domain.cpu0.domain1.min_interval = 4 kernel.sched_domain.cpu0.domain1.name = DIE kernel.sched_domain.cpu0.domain1.newidle_idx = 0 kernel.sched_domain.cpu0.domain1.wake_idx = 0 kernel.sched_domain.cpu1.domain0.busy_factor = 32 kernel.sched_domain.cpu1.domain0.busy_idx = 2 kernel.sched_domain.cpu1.domain0.cache_nice_tries = 1 kernel.sched_domain.cpu1.domain0.flags = 559 kernel.sched_domain.cpu1.domain0.forkexec_idx = 0 kernel.sched_domain.cpu1.domain0.idle_idx = 0 kernel.sched_domain.cpu1.domain0.imbalance_pct = 117 kernel.sched_domain.cpu1.domain0.max_interval = 4 kernel.sched_domain.cpu1.domain0.max_newidle_lb_cost = 11989 kernel.sched_domain.cpu1.domain0.min_interval = 2 kernel.sched_domain.cpu1.domain0.name = MC kernel.sched_domain.cpu1.domain0.newidle_idx = 0 kernel.sched_domain.cpu1.domain0.wake_idx = 0 kernel.sched_domain.cpu1.domain1.busy_factor = 32 kernel.sched_domain.cpu1.domain1.busy_idx = 2 kernel.sched_domain.cpu1.domain1.cache_nice_tries = 1 kernel.sched_domain.cpu1.domain1.flags = 4143 kernel.sched_domain.cpu1.domain1.forkexec_idx = 0 kernel.sched_domain.cpu1.domain1.idle_idx = 1 kernel.sched_domain.cpu1.domain1.imbalance_pct = 125 kernel.sched_domain.cpu1.domain1.max_interval = 8 kernel.sched_domain.cpu1.domain1.max_newidle_lb_cost = 8547 kernel.sched_domain.cpu1.domain1.min_interval = 4 kernel.sched_domain.cpu1.domain1.name = DIE kernel.sched_domain.cpu1.domain1.newidle_idx = 0 kernel.sched_domain.cpu1.domain1.wake_idx = 0 kernel.sched_domain.cpu2.domain0.busy_factor = 32 kernel.sched_domain.cpu2.domain0.busy_idx = 2 kernel.sched_domain.cpu2.domain0.cache_nice_tries = 1 kernel.sched_domain.cpu2.domain0.flags = 559 kernel.sched_domain.cpu2.domain0.forkexec_idx = 0 kernel.sched_domain.cpu2.domain0.idle_idx = 0 kernel.sched_domain.cpu2.domain0.imbalance_pct = 117 kernel.sched_domain.cpu2.domain0.max_interval = 4 kernel.sched_domain.cpu2.domain0.max_newidle_lb_cost = 17313 kernel.sched_domain.cpu2.domain0.min_interval = 2 kernel.sched_domain.cpu2.domain0.name = MC kernel.sched_domain.cpu2.domain0.newidle_idx = 0 kernel.sched_domain.cpu2.domain0.wake_idx = 0 kernel.sched_domain.cpu2.domain1.busy_factor = 32 kernel.sched_domain.cpu2.domain1.busy_idx = 2 kernel.sched_domain.cpu2.domain1.cache_nice_tries = 1 kernel.sched_domain.cpu2.domain1.flags = 4143 kernel.sched_domain.cpu2.domain1.forkexec_idx = 0 kernel.sched_domain.cpu2.domain1.idle_idx = 1 kernel.sched_domain.cpu2.domain1.imbalance_pct = 125 kernel.sched_domain.cpu2.domain1.max_interval = 8 kernel.sched_domain.cpu2.domain1.max_newidle_lb_cost = 8334 kernel.sched_domain.cpu2.domain1.min_interval = 4 kernel.sched_domain.cpu2.domain1.name = DIE kernel.sched_domain.cpu2.domain1.newidle_idx = 0 kernel.sched_domain.cpu2.domain1.wake_idx = 0 kernel.sched_domain.cpu3.domain0.busy_factor = 32 kernel.sched_domain.cpu3.domain0.busy_idx = 2 kernel.sched_domain.cpu3.domain0.cache_nice_tries = 1 kernel.sched_domain.cpu3.domain0.flags = 559 kernel.sched_domain.cpu3.domain0.forkexec_idx = 0 kernel.sched_domain.cpu3.domain0.idle_idx = 0 kernel.sched_domain.cpu3.domain0.imbalance_pct = 117 kernel.sched_domain.cpu3.domain0.max_interval = 4 kernel.sched_domain.cpu3.domain0.max_newidle_lb_cost = 18967 kernel.sched_domain.cpu3.domain0.min_interval = 2 kernel.sched_domain.cpu3.domain0.name = MC kernel.sched_domain.cpu3.domain0.newidle_idx = 0 kernel.sched_domain.cpu3.domain0.wake_idx = 0 kernel.sched_domain.cpu3.domain1.busy_factor = 32 kernel.sched_domain.cpu3.domain1.busy_idx = 2 kernel.sched_domain.cpu3.domain1.cache_nice_tries = 1 kernel.sched_domain.cpu3.domain1.flags = 4143 kernel.sched_domain.cpu3.domain1.forkexec_idx = 0 kernel.sched_domain.cpu3.domain1.idle_idx = 1 kernel.sched_domain.cpu3.domain1.imbalance_pct = 125 kernel.sched_domain.cpu3.domain1.max_interval = 8 kernel.sched_domain.cpu3.domain1.max_newidle_lb_cost = 8388 kernel.sched_domain.cpu3.domain1.min_interval = 4 kernel.sched_domain.cpu3.domain1.name = DIE kernel.sched_domain.cpu3.domain1.newidle_idx = 0 kernel.sched_domain.cpu3.domain1.wake_idx = 0 kernel.sched_latency_ns = 18000000 kernel.sched_migration_cost_ns = 500000 kernel.sched_min_granularity_ns = 10000000 kernel.sched_nr_migrate = 32 kernel.sched_rr_timeslice_ms = 100 kernel.sched_rt_period_us = 1000000 kernel.sched_rt_runtime_us = 950000 kernel.sched_schedstats = 0 kernel.sched_shares_window_ns = 10000000 kernel.sched_time_avg_ms = 1000 kernel.sched_tunable_scaling = 1 kernel.sched_wakeup_granularity_ns = 15000000 kernel.seccomp.actions_avail = kill trap errno trace allow kernel.seccomp.actions_logged = kill trap errno trace kernel.sem = 250 32000 32 128 kernel.sem_next_id = -1 kernel.shm_next_id = -1 kernel.shm_rmid_forced = 0 kernel.shmall = 4294967296 kernel.shmmax = 68719476736 kernel.shmmni = 4096 kernel.softlockup_all_cpu_backtrace = 0 kernel.softlockup_panic = 0 kernel.stack_tracer_enabled = 0 kernel.sysctl_writes_strict = 1 kernel.sysrq = 0 kernel.tainted = 536870912 kernel.threads-max = 95930 kernel.timer_migration = 1 kernel.traceoff_on_warning = 0 kernel.unknown_nmi_panic = 0 kernel.usermodehelper.bset = 4294967295 31 kernel.usermodehelper.inheritable = 4294967295 31 kernel.version = #1 SMP Tue Jun 18 16:35:19 UTC 2019 kernel.watchdog = 1 kernel.watchdog_cpumask = 0-3 kernel.watchdog_thresh = 10 kernel.yama.ptrace_scope = 0 net.bridge.bridge-nf-call-arptables = 1 net.bridge.bridge-nf-call-ip6tables = 1 net.bridge.bridge-nf-call-iptables = 1 net.bridge.bridge-nf-filter-pppoe-tagged = 0 net.bridge.bridge-nf-filter-vlan-tagged = 0 net.bridge.bridge-nf-pass-vlan-input-dev = 0 net.core.bpf_jit_enable = 1 net.core.bpf_jit_harden = 1 net.core.busy_poll = 0 net.core.busy_read = 0 net.core.default_qdisc = pfifo_fast net.core.dev_weight = 64 net.core.dev_weight_rx_bias = 1 net.core.dev_weight_tx_bias = 1 net.core.message_burst = 10 net.core.message_cost = 5 net.core.netdev_budget = 300 net.core.netdev_max_backlog = 262144 net.core.netdev_rss_key = 00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00 net.core.netdev_tstamp_prequeue = 1 net.core.optmem_max = 20480 net.core.rmem_default = 8388608 net.core.rmem_max = 16777216 net.core.rps_sock_flow_entries = 0 net.core.somaxconn = 128 net.core.warnings = 1 net.core.wmem_default = 8388608 net.core.wmem_max = 16777216 net.core.xfrm_acq_expires = 30 net.core.xfrm_aevent_etime = 10 net.core.xfrm_aevent_rseqth = 2 net.core.xfrm_larval_drop = 1 net.ipv4.cipso_cache_bucket_size = 10 net.ipv4.cipso_cache_enable = 1 net.ipv4.cipso_rbm_optfmt = 0 net.ipv4.cipso_rbm_strictvalid = 1 net.ipv4.conf.all.accept_local = 0 net.ipv4.conf.all.accept_redirects = 0 net.ipv4.conf.all.accept_source_route = 0 net.ipv4.conf.all.arp_accept = 0 net.ipv4.conf.all.arp_announce = 0 net.ipv4.conf.all.arp_filter = 0 net.ipv4.conf.all.arp_ignore = 0 net.ipv4.conf.all.arp_notify = 0 net.ipv4.conf.all.bootp_relay = 0 net.ipv4.conf.all.disable_policy = 0 net.ipv4.conf.all.disable_xfrm = 0 net.ipv4.conf.all.force_igmp_version = 0 net.ipv4.conf.all.forwarding = 0 net.ipv4.conf.all.igmpv2_unsolicited_report_interval = 10000 net.ipv4.conf.all.igmpv3_unsolicited_report_interval = 1000 net.ipv4.conf.all.log_martians = 0 net.ipv4.conf.all.mc_forwarding = 0 net.ipv4.conf.all.medium_id = 0 net.ipv4.conf.all.promote_secondaries = 1 net.ipv4.conf.all.proxy_arp = 0 net.ipv4.conf.all.proxy_arp_pvlan = 0 net.ipv4.conf.all.route_localnet = 1 net.ipv4.conf.all.rp_filter = 1 net.ipv4.conf.all.secure_redirects = 0 net.ipv4.conf.all.send_redirects = 0 net.ipv4.conf.all.shared_media = 1 net.ipv4.conf.all.src_valid_mark = 0 net.ipv4.conf.all.tag = 0 net.ipv4.conf.cni0.accept_local = 0 net.ipv4.conf.cni0.accept_redirects = 1 net.ipv4.conf.cni0.accept_source_route = 0 net.ipv4.conf.cni0.arp_accept = 0 net.ipv4.conf.cni0.arp_announce = 0 net.ipv4.conf.cni0.arp_filter = 0 net.ipv4.conf.cni0.arp_ignore = 0 net.ipv4.conf.cni0.arp_notify = 0 net.ipv4.conf.cni0.bootp_relay = 0 net.ipv4.conf.cni0.disable_policy = 0 net.ipv4.conf.cni0.disable_xfrm = 0 net.ipv4.conf.cni0.force_igmp_version = 0 net.ipv4.conf.cni0.forwarding = 0 net.ipv4.conf.cni0.igmpv2_unsolicited_report_interval = 10000 net.ipv4.conf.cni0.igmpv3_unsolicited_report_interval = 1000 net.ipv4.conf.cni0.log_martians = 0 net.ipv4.conf.cni0.mc_forwarding = 0 net.ipv4.conf.cni0.medium_id = 0 net.ipv4.conf.cni0.promote_secondaries = 1 net.ipv4.conf.cni0.proxy_arp = 0 net.ipv4.conf.cni0.proxy_arp_pvlan = 0 net.ipv4.conf.cni0.route_localnet = 0 net.ipv4.conf.cni0.rp_filter = 1 net.ipv4.conf.cni0.secure_redirects = 1 net.ipv4.conf.cni0.send_redirects = 1 net.ipv4.conf.cni0.shared_media = 1 net.ipv4.conf.cni0.src_valid_mark = 0 net.ipv4.conf.cni0.tag = 0 net.ipv4.conf.default.accept_local = 0 net.ipv4.conf.default.accept_redirects = 0 net.ipv4.conf.default.accept_source_route = 0 net.ipv4.conf.default.arp_accept = 0 net.ipv4.conf.default.arp_announce = 0 net.ipv4.conf.default.arp_filter = 0 net.ipv4.conf.default.arp_ignore = 0 net.ipv4.conf.default.arp_notify = 0 net.ipv4.conf.default.bootp_relay = 0 net.ipv4.conf.default.disable_policy = 0 net.ipv4.conf.default.disable_xfrm = 0 net.ipv4.conf.default.force_igmp_version = 0 net.ipv4.conf.default.forwarding = 0 net.ipv4.conf.default.igmpv2_unsolicited_report_interval = 10000 net.ipv4.conf.default.igmpv3_unsolicited_report_interval = 1000 net.ipv4.conf.default.log_martians = 0 net.ipv4.conf.default.mc_forwarding = 0 net.ipv4.conf.default.medium_id = 0 net.ipv4.conf.default.promote_secondaries = 1 net.ipv4.conf.default.proxy_arp = 0 net.ipv4.conf.default.proxy_arp_pvlan = 0 net.ipv4.conf.default.route_localnet = 0 net.ipv4.conf.default.rp_filter = 1 net.ipv4.conf.default.secure_redirects = 0 net.ipv4.conf.default.send_redirects = 0 net.ipv4.conf.default.shared_media = 1 net.ipv4.conf.default.src_valid_mark = 0 net.ipv4.conf.default.tag = 0 net.ipv4.conf.docker0.accept_local = 0 net.ipv4.conf.docker0.accept_redirects = 1 net.ipv4.conf.docker0.accept_source_route = 0 net.ipv4.conf.docker0.arp_accept = 0 net.ipv4.conf.docker0.arp_announce = 0 net.ipv4.conf.docker0.arp_filter = 0 net.ipv4.conf.docker0.arp_ignore = 0 net.ipv4.conf.docker0.arp_notify = 0 net.ipv4.conf.docker0.bootp_relay = 0 net.ipv4.conf.docker0.disable_policy = 0 net.ipv4.conf.docker0.disable_xfrm = 0 net.ipv4.conf.docker0.force_igmp_version = 0 net.ipv4.conf.docker0.forwarding = 0 net.ipv4.conf.docker0.igmpv2_unsolicited_report_interval = 10000 net.ipv4.conf.docker0.igmpv3_unsolicited_report_interval = 1000 net.ipv4.conf.docker0.log_martians = 0 net.ipv4.conf.docker0.mc_forwarding = 0 net.ipv4.conf.docker0.medium_id = 0 net.ipv4.conf.docker0.promote_secondaries = 1 net.ipv4.conf.docker0.proxy_arp = 0 net.ipv4.conf.docker0.proxy_arp_pvlan = 0 net.ipv4.conf.docker0.route_localnet = 0 net.ipv4.conf.docker0.rp_filter = 1 net.ipv4.conf.docker0.secure_redirects = 1 net.ipv4.conf.docker0.send_redirects = 1 net.ipv4.conf.docker0.shared_media = 1 net.ipv4.conf.docker0.src_valid_mark = 0 net.ipv4.conf.docker0.tag = 0 net.ipv4.conf.ens160.accept_local = 0 net.ipv4.conf.ens160.accept_redirects = 1 net.ipv4.conf.ens160.accept_source_route = 0 net.ipv4.conf.ens160.arp_accept = 0 net.ipv4.conf.ens160.arp_announce = 0 net.ipv4.conf.ens160.arp_filter = 0 net.ipv4.conf.ens160.arp_ignore = 0 net.ipv4.conf.ens160.arp_notify = 0 net.ipv4.conf.ens160.bootp_relay = 0 net.ipv4.conf.ens160.disable_policy = 0 net.ipv4.conf.ens160.disable_xfrm = 0 net.ipv4.conf.ens160.force_igmp_version = 0 net.ipv4.conf.ens160.forwarding = 0 net.ipv4.conf.ens160.igmpv2_unsolicited_report_interval = 10000 net.ipv4.conf.ens160.igmpv3_unsolicited_report_interval = 1000 net.ipv4.conf.ens160.log_martians = 0 net.ipv4.conf.ens160.mc_forwarding = 0 net.ipv4.conf.ens160.medium_id = 0 net.ipv4.conf.ens160.promote_secondaries = 1 net.ipv4.conf.ens160.proxy_arp = 0 net.ipv4.conf.ens160.proxy_arp_pvlan = 0 net.ipv4.conf.ens160.route_localnet = 0 net.ipv4.conf.ens160.rp_filter = 1 net.ipv4.conf.ens160.secure_redirects = 1 net.ipv4.conf.ens160.send_redirects = 1 net.ipv4.conf.ens160.shared_media = 1 net.ipv4.conf.ens160.src_valid_mark = 0 net.ipv4.conf.ens160.tag = 0 net.ipv4.conf.flannel/1.accept_local = 0 net.ipv4.conf.flannel/1.accept_redirects = 1 net.ipv4.conf.flannel/1.accept_source_route = 0 net.ipv4.conf.flannel/1.arp_accept = 0 net.ipv4.conf.flannel/1.arp_announce = 0 net.ipv4.conf.flannel/1.arp_filter = 0 net.ipv4.conf.flannel/1.arp_ignore = 0 net.ipv4.conf.flannel/1.arp_notify = 0 net.ipv4.conf.flannel/1.bootp_relay = 0 net.ipv4.conf.flannel/1.disable_policy = 0 net.ipv4.conf.flannel/1.disable_xfrm = 0 net.ipv4.conf.flannel/1.force_igmp_version = 0 net.ipv4.conf.flannel/1.forwarding = 0 net.ipv4.conf.flannel/1.igmpv2_unsolicited_report_interval = 10000 net.ipv4.conf.flannel/1.igmpv3_unsolicited_report_interval = 1000 net.ipv4.conf.flannel/1.log_martians = 0 net.ipv4.conf.flannel/1.mc_forwarding = 0 net.ipv4.conf.flannel/1.medium_id = 0 net.ipv4.conf.flannel/1.promote_secondaries = 1 net.ipv4.conf.flannel/1.proxy_arp = 0 net.ipv4.conf.flannel/1.proxy_arp_pvlan = 0 net.ipv4.conf.flannel/1.route_localnet = 0 net.ipv4.conf.flannel/1.rp_filter = 1 net.ipv4.conf.flannel/1.secure_redirects = 1 net.ipv4.conf.flannel/1.send_redirects = 1 net.ipv4.conf.flannel/1.shared_media = 1 net.ipv4.conf.flannel/1.src_valid_mark = 0 net.ipv4.conf.flannel/1.tag = 0 net.ipv4.conf.lo.accept_local = 0 net.ipv4.conf.lo.accept_redirects = 1 net.ipv4.conf.lo.accept_source_route = 1 net.ipv4.conf.lo.arp_accept = 0 net.ipv4.conf.lo.arp_announce = 0 net.ipv4.conf.lo.arp_filter = 0 net.ipv4.conf.lo.arp_ignore = 0 net.ipv4.conf.lo.arp_notify = 0 net.ipv4.conf.lo.bootp_relay = 0 net.ipv4.conf.lo.disable_policy = 1 net.ipv4.conf.lo.disable_xfrm = 1 net.ipv4.conf.lo.force_igmp_version = 0 net.ipv4.conf.lo.forwarding = 0 net.ipv4.conf.lo.igmpv2_unsolicited_report_interval = 10000 net.ipv4.conf.lo.igmpv3_unsolicited_report_interval = 1000 net.ipv4.conf.lo.log_martians = 0 net.ipv4.conf.lo.mc_forwarding = 0 net.ipv4.conf.lo.medium_id = 0 net.ipv4.conf.lo.promote_secondaries = 0 net.ipv4.conf.lo.proxy_arp = 0 net.ipv4.conf.lo.proxy_arp_pvlan = 0 net.ipv4.conf.lo.route_localnet = 0 net.ipv4.conf.lo.rp_filter = 0 net.ipv4.conf.lo.secure_redirects = 1 net.ipv4.conf.lo.send_redirects = 1 net.ipv4.conf.lo.shared_media = 1 net.ipv4.conf.lo.src_valid_mark = 0 net.ipv4.conf.lo.tag = 0 net.ipv4.fib_multipath_hash_policy = 0 net.ipv4.fwmark_reflect = 0 net.ipv4.icmp_echo_ignore_all = 0 net.ipv4.icmp_echo_ignore_broadcasts = 1 net.ipv4.icmp_errors_use_inbound_ifaddr = 0 net.ipv4.icmp_ignore_bogus_error_responses = 1 net.ipv4.icmp_msgs_burst = 50 net.ipv4.icmp_msgs_per_sec = 1000 net.ipv4.icmp_ratelimit = 1000 net.ipv4.icmp_ratemask = 6168 net.ipv4.igmp_max_memberships = 20 net.ipv4.igmp_max_msf = 10 net.ipv4.igmp_qrv = 2 net.ipv4.inet_peer_maxttl = 600 net.ipv4.inet_peer_minttl = 120 net.ipv4.inet_peer_threshold = 65664 net.ipv4.ip_default_ttl = 64 net.ipv4.ip_dynaddr = 0 net.ipv4.ip_early_demux = 1 net.ipv4.ip_forward = 0 net.ipv4.ip_forward_use_pmtu = 0 net.ipv4.ip_local_port_range = 1024 65000 net.ipv4.ip_local_reserved_ports = net.ipv4.ip_no_pmtu_disc = 0 net.ipv4.ip_nonlocal_bind = 0 net.ipv4.ipfrag_high_thresh = 4194304 net.ipv4.ipfrag_low_thresh = 3145728 net.ipv4.ipfrag_max_dist = 64 net.ipv4.ipfrag_secret_interval = 600 net.ipv4.ipfrag_time = 30 net.ipv4.neigh.cni0.anycast_delay = 100 net.ipv4.neigh.cni0.app_solicit = 0 net.ipv4.neigh.cni0.base_reachable_time_ms = 30000 net.ipv4.neigh.cni0.delay_first_probe_time = 5 net.ipv4.neigh.cni0.gc_stale_time = 60 net.ipv4.neigh.cni0.locktime = 100 net.ipv4.neigh.cni0.mcast_solicit = 3 net.ipv4.neigh.cni0.proxy_delay = 80 net.ipv4.neigh.cni0.proxy_qlen = 64 net.ipv4.neigh.cni0.retrans_time_ms = 1000 net.ipv4.neigh.cni0.ucast_solicit = 3 net.ipv4.neigh.cni0.unres_qlen = 31 net.ipv4.neigh.cni0.unres_qlen_bytes = 65536 net.ipv4.neigh.default.anycast_delay = 100 net.ipv4.neigh.default.app_solicit = 0 net.ipv4.neigh.default.base_reachable_time_ms = 30000 net.ipv4.neigh.default.delay_first_probe_time = 5 net.ipv4.neigh.default.gc_interval = 30 net.ipv4.neigh.default.gc_stale_time = 60 net.ipv4.neigh.default.gc_thresh1 = 128 net.ipv4.neigh.default.gc_thresh2 = 512 net.ipv4.neigh.default.gc_thresh3 = 1024 net.ipv4.neigh.default.locktime = 100 net.ipv4.neigh.default.mcast_solicit = 3 net.ipv4.neigh.default.proxy_delay = 80 net.ipv4.neigh.default.proxy_qlen = 64 net.ipv4.neigh.default.retrans_time_ms = 1000 net.ipv4.neigh.default.ucast_solicit = 3 net.ipv4.neigh.default.unres_qlen = 31 net.ipv4.neigh.default.unres_qlen_bytes = 65536 net.ipv4.neigh.docker0.anycast_delay = 100 net.ipv4.neigh.docker0.app_solicit = 0 net.ipv4.neigh.docker0.base_reachable_time_ms = 30000 net.ipv4.neigh.docker0.delay_first_probe_time = 5 net.ipv4.neigh.docker0.gc_stale_time = 60 net.ipv4.neigh.docker0.locktime = 100 net.ipv4.neigh.docker0.mcast_solicit = 3 net.ipv4.neigh.docker0.proxy_delay = 80 net.ipv4.neigh.docker0.proxy_qlen = 64 net.ipv4.neigh.docker0.retrans_time_ms = 1000 net.ipv4.neigh.docker0.ucast_solicit = 3 net.ipv4.neigh.docker0.unres_qlen = 31 net.ipv4.neigh.docker0.unres_qlen_bytes = 65536 net.ipv4.neigh.ens160.anycast_delay = 100 net.ipv4.neigh.ens160.app_solicit = 0 net.ipv4.neigh.ens160.base_reachable_time_ms = 30000 net.ipv4.neigh.ens160.delay_first_probe_time = 5 net.ipv4.neigh.ens160.gc_stale_time = 60 net.ipv4.neigh.ens160.locktime = 100 net.ipv4.neigh.ens160.mcast_solicit = 3 net.ipv4.neigh.ens160.proxy_delay = 80 net.ipv4.neigh.ens160.proxy_qlen = 64 net.ipv4.neigh.ens160.retrans_time_ms = 1000 net.ipv4.neigh.ens160.ucast_solicit = 3 net.ipv4.neigh.ens160.unres_qlen = 31 net.ipv4.neigh.ens160.unres_qlen_bytes = 65536 net.ipv4.neigh.flannel/1.anycast_delay = 100 net.ipv4.neigh.flannel/1.app_solicit = 0 net.ipv4.neigh.flannel/1.base_reachable_time_ms = 30000 net.ipv4.neigh.flannel/1.delay_first_probe_time = 5 net.ipv4.neigh.flannel/1.gc_stale_time = 60 net.ipv4.neigh.flannel/1.locktime = 100 net.ipv4.neigh.flannel/1.mcast_solicit = 3 net.ipv4.neigh.flannel/1.proxy_delay = 80 net.ipv4.neigh.flannel/1.proxy_qlen = 64 net.ipv4.neigh.flannel/1.retrans_time_ms = 1000 net.ipv4.neigh.flannel/1.ucast_solicit = 3 net.ipv4.neigh.flannel/1.unres_qlen = 31 net.ipv4.neigh.flannel/1.unres_qlen_bytes = 65536 net.ipv4.neigh.lo.anycast_delay = 100 net.ipv4.neigh.lo.app_solicit = 0 net.ipv4.neigh.lo.base_reachable_time_ms = 30000 net.ipv4.neigh.lo.delay_first_probe_time = 5 net.ipv4.neigh.lo.gc_stale_time = 60 net.ipv4.neigh.lo.locktime = 100 net.ipv4.neigh.lo.mcast_solicit = 3 net.ipv4.neigh.lo.proxy_delay = 80 net.ipv4.neigh.lo.proxy_qlen = 64 net.ipv4.neigh.lo.retrans_time_ms = 1000 net.ipv4.neigh.lo.ucast_solicit = 3 net.ipv4.neigh.lo.unres_qlen = 31 net.ipv4.neigh.lo.unres_qlen_bytes = 65536 net.ipv4.ping_group_range = 1 0 net.ipv4.route.error_burst = 5000 net.ipv4.route.error_cost = 1000 net.ipv4.route.gc_elasticity = 8 net.ipv4.route.gc_interval = 60 net.ipv4.route.gc_min_interval = 0 net.ipv4.route.gc_min_interval_ms = 500 net.ipv4.route.gc_thresh = -1 net.ipv4.route.gc_timeout = 300 net.ipv4.route.max_size = 2147483647 net.ipv4.route.min_adv_mss = 256 net.ipv4.route.min_pmtu = 552 net.ipv4.route.mtu_expires = 600 net.ipv4.route.redirect_load = 20 net.ipv4.route.redirect_number = 9 net.ipv4.route.redirect_silence = 20480 net.ipv4.tcp_abort_on_overflow = 0 net.ipv4.tcp_adv_win_scale = 1 net.ipv4.tcp_allowed_congestion_control = cubic reno net.ipv4.tcp_app_win = 31 net.ipv4.tcp_autocorking = 1 net.ipv4.tcp_available_congestion_control = cubic reno net.ipv4.tcp_base_mss = 512 net.ipv4.tcp_challenge_ack_limit = 1000 net.ipv4.tcp_congestion_control = cubic net.ipv4.tcp_dsack = 1 net.ipv4.tcp_early_retrans = 3 net.ipv4.tcp_ecn = 2 net.ipv4.tcp_fack = 1 net.ipv4.tcp_fastopen = 0 net.ipv4.tcp_fastopen_key = 00000000-00000000-00000000-00000000 net.ipv4.tcp_fin_timeout = 1 net.ipv4.tcp_frto = 2 net.ipv4.tcp_invalid_ratelimit = 500 net.ipv4.tcp_keepalive_intvl = 75 net.ipv4.tcp_keepalive_probes = 9 net.ipv4.tcp_keepalive_time = 30 net.ipv4.tcp_limit_output_bytes = 262144 net.ipv4.tcp_low_latency = 0 net.ipv4.tcp_max_orphans = 3276800 net.ipv4.tcp_max_ssthresh = 0 net.ipv4.tcp_max_syn_backlog = 262144 net.ipv4.tcp_max_tw_buckets = 6000 net.ipv4.tcp_mem = 94500000 915000000 927000000 net.ipv4.tcp_min_snd_mss = 48 net.ipv4.tcp_min_tso_segs = 2 net.ipv4.tcp_moderate_rcvbuf = 1 net.ipv4.tcp_mtu_probing = 0 net.ipv4.tcp_no_metrics_save = 0 net.ipv4.tcp_notsent_lowat = -1 net.ipv4.tcp_orphan_retries = 0 net.ipv4.tcp_reordering = 3 net.ipv4.tcp_retrans_collapse = 1 net.ipv4.tcp_retries1 = 3 net.ipv4.tcp_retries2 = 15 net.ipv4.tcp_rfc1337 = 0 net.ipv4.tcp_rmem = 4096 87380 4194304 net.ipv4.tcp_sack = 1 net.ipv4.tcp_slow_start_after_idle = 1 net.ipv4.tcp_stdurg = 0 net.ipv4.tcp_syn_retries = 1 net.ipv4.tcp_synack_retries = 1 net.ipv4.tcp_syncookies = 1 net.ipv4.tcp_thin_dupack = 0 net.ipv4.tcp_thin_linear_timeouts = 0 net.ipv4.tcp_timestamps = 0 net.ipv4.tcp_tso_win_divisor = 3 net.ipv4.tcp_tw_recycle = 1 net.ipv4.tcp_tw_reuse = 1 net.ipv4.tcp_window_scaling = 1 net.ipv4.tcp_wmem = 4096 16384 4194304 net.ipv4.tcp_workaround_signed_windows = 0 net.ipv4.udp_mem = 287790 383721 575580 net.ipv4.udp_rmem_min = 4096 net.ipv4.udp_wmem_min = 4096 net.ipv4.vs.am_droprate = 10 net.ipv4.vs.amemthresh = 1024 net.ipv4.vs.backup_only = 0 net.ipv4.vs.cache_bypass = 0 net.ipv4.vs.conn_reuse_mode = 1 net.ipv4.vs.conntrack = 0 net.ipv4.vs.drop_entry = 0 net.ipv4.vs.drop_packet = 0 net.ipv4.vs.expire_nodest_conn = 0 net.ipv4.vs.expire_quiescent_template = 0 net.ipv4.vs.nat_icmp_send = 0 net.ipv4.vs.pmtu_disc = 1 net.ipv4.vs.secure_tcp = 0 net.ipv4.vs.snat_reroute = 1 net.ipv4.vs.sync_ports = 1 net.ipv4.vs.sync_qlen_max = 95324 net.ipv4.vs.sync_refresh_period = 0 net.ipv4.vs.sync_retries = 0 net.ipv4.vs.sync_sock_size = 0 net.ipv4.vs.sync_threshold = 3 50 net.ipv4.vs.sync_version = 1 net.ipv4.xfrm4_gc_thresh = 32768 net.ipv6.anycast_src_echo_reply = 0 net.ipv6.bindv6only = 0 net.ipv6.conf.all.accept_dad = 0 net.ipv6.conf.all.accept_ra = 1 net.ipv6.conf.all.accept_ra_defrtr = 1 net.ipv6.conf.all.accept_ra_pinfo = 1 net.ipv6.conf.all.accept_ra_rt_info_max_plen = 0 net.ipv6.conf.all.accept_ra_rtr_pref = 1 net.ipv6.conf.all.accept_redirects = 1 net.ipv6.conf.all.accept_source_route = 0 net.ipv6.conf.all.autoconf = 1 net.ipv6.conf.all.dad_transmits = 1 net.ipv6.conf.all.disable_ipv6 = 1 net.ipv6.conf.all.enhanced_dad = 1 net.ipv6.conf.all.force_mld_version = 0 net.ipv6.conf.all.force_tllao = 0 net.ipv6.conf.all.forwarding = 0 net.ipv6.conf.all.hop_limit = 64 net.ipv6.conf.all.keep_addr_on_down = 0 net.ipv6.conf.all.max_addresses = 16 net.ipv6.conf.all.max_desync_factor = 600 net.ipv6.conf.all.mc_forwarding = 0 net.ipv6.conf.all.mldv1_unsolicited_report_interval = 10000 net.ipv6.conf.all.mldv2_unsolicited_report_interval = 1000 net.ipv6.conf.all.mtu = 1280 net.ipv6.conf.all.ndisc_notify = 0 net.ipv6.conf.all.optimistic_dad = 0 net.ipv6.conf.all.proxy_ndp = 0 net.ipv6.conf.all.regen_max_retry = 3 net.ipv6.conf.all.router_probe_interval = 60 net.ipv6.conf.all.router_solicitation_delay = 1 net.ipv6.conf.all.router_solicitation_interval = 4 net.ipv6.conf.all.router_solicitations = 3 net.ipv6.conf.all.temp_prefered_lft = 86400 net.ipv6.conf.all.temp_valid_lft = 604800 net.ipv6.conf.all.use_optimistic = 0 net.ipv6.conf.all.use_tempaddr = 0 net.ipv6.conf.cni0.accept_dad = 1 net.ipv6.conf.cni0.accept_ra = 1 net.ipv6.conf.cni0.accept_ra_defrtr = 1 net.ipv6.conf.cni0.accept_ra_pinfo = 1 net.ipv6.conf.cni0.accept_ra_rt_info_max_plen = 0 net.ipv6.conf.cni0.accept_ra_rtr_pref = 1 net.ipv6.conf.cni0.accept_redirects = 1 net.ipv6.conf.cni0.accept_source_route = 0 net.ipv6.conf.cni0.autoconf = 1 net.ipv6.conf.cni0.dad_transmits = 1 net.ipv6.conf.cni0.disable_ipv6 = 1 net.ipv6.conf.cni0.enhanced_dad = 1 net.ipv6.conf.cni0.force_mld_version = 0 net.ipv6.conf.cni0.force_tllao = 0 net.ipv6.conf.cni0.forwarding = 0 net.ipv6.conf.cni0.hop_limit = 64 net.ipv6.conf.cni0.keep_addr_on_down = 0 net.ipv6.conf.cni0.max_addresses = 16 net.ipv6.conf.cni0.max_desync_factor = 600 net.ipv6.conf.cni0.mc_forwarding = 0 net.ipv6.conf.cni0.mldv1_unsolicited_report_interval = 10000 net.ipv6.conf.cni0.mldv2_unsolicited_report_interval = 1000 net.ipv6.conf.cni0.mtu = 1500 net.ipv6.conf.cni0.ndisc_notify = 0 net.ipv6.conf.cni0.optimistic_dad = 0 net.ipv6.conf.cni0.proxy_ndp = 0 net.ipv6.conf.cni0.regen_max_retry = 3 net.ipv6.conf.cni0.router_probe_interval = 60 net.ipv6.conf.cni0.router_solicitation_delay = 1 net.ipv6.conf.cni0.router_solicitation_interval = 4 net.ipv6.conf.cni0.router_solicitations = 3 net.ipv6.conf.cni0.temp_prefered_lft = 86400 net.ipv6.conf.cni0.temp_valid_lft = 604800 net.ipv6.conf.cni0.use_optimistic = 0 net.ipv6.conf.cni0.use_tempaddr = 0 net.ipv6.conf.default.accept_dad = 1 net.ipv6.conf.default.accept_ra = 1 net.ipv6.conf.default.accept_ra_defrtr = 1 net.ipv6.conf.default.accept_ra_pinfo = 1 net.ipv6.conf.default.accept_ra_rt_info_max_plen = 0 net.ipv6.conf.default.accept_ra_rtr_pref = 1 net.ipv6.conf.default.accept_redirects = 1 net.ipv6.conf.default.accept_source_route = 0 net.ipv6.conf.default.autoconf = 1 net.ipv6.conf.default.dad_transmits = 1 net.ipv6.conf.default.disable_ipv6 = 1 net.ipv6.conf.default.enhanced_dad = 1 net.ipv6.conf.default.force_mld_version = 0 net.ipv6.conf.default.force_tllao = 0 net.ipv6.conf.default.forwarding = 0 net.ipv6.conf.default.hop_limit = 64 net.ipv6.conf.default.keep_addr_on_down = 0 net.ipv6.conf.default.max_addresses = 16 net.ipv6.conf.default.max_desync_factor = 600 net.ipv6.conf.default.mc_forwarding = 0 net.ipv6.conf.default.mldv1_unsolicited_report_interval = 10000 net.ipv6.conf.default.mldv2_unsolicited_report_interval = 1000 net.ipv6.conf.default.mtu = 1280 net.ipv6.conf.default.ndisc_notify = 0 net.ipv6.conf.default.optimistic_dad = 0 net.ipv6.conf.default.proxy_ndp = 0 net.ipv6.conf.default.regen_max_retry = 3 net.ipv6.conf.default.router_probe_interval = 60 net.ipv6.conf.default.router_solicitation_delay = 1 net.ipv6.conf.default.router_solicitation_interval = 4 net.ipv6.conf.default.router_solicitations = 3 net.ipv6.conf.default.temp_prefered_lft = 86400 net.ipv6.conf.default.temp_valid_lft = 604800 net.ipv6.conf.default.use_optimistic = 0 net.ipv6.conf.default.use_tempaddr = 0 net.ipv6.conf.docker0.accept_dad = 1 net.ipv6.conf.docker0.accept_ra = 1 net.ipv6.conf.docker0.accept_ra_defrtr = 1 net.ipv6.conf.docker0.accept_ra_pinfo = 1 net.ipv6.conf.docker0.accept_ra_rt_info_max_plen = 0 net.ipv6.conf.docker0.accept_ra_rtr_pref = 1 net.ipv6.conf.docker0.accept_redirects = 1 net.ipv6.conf.docker0.accept_source_route = 0 net.ipv6.conf.docker0.autoconf = 1 net.ipv6.conf.docker0.dad_transmits = 1 net.ipv6.conf.docker0.disable_ipv6 = 1 net.ipv6.conf.docker0.enhanced_dad = 1 net.ipv6.conf.docker0.force_mld_version = 0 net.ipv6.conf.docker0.force_tllao = 0 net.ipv6.conf.docker0.forwarding = 0 net.ipv6.conf.docker0.hop_limit = 64 net.ipv6.conf.docker0.keep_addr_on_down = 0 net.ipv6.conf.docker0.max_addresses = 16 net.ipv6.conf.docker0.max_desync_factor = 600 net.ipv6.conf.docker0.mc_forwarding = 0 net.ipv6.conf.docker0.mldv1_unsolicited_report_interval = 10000 net.ipv6.conf.docker0.mldv2_unsolicited_report_interval = 1000 net.ipv6.conf.docker0.mtu = 1500 net.ipv6.conf.docker0.ndisc_notify = 0 net.ipv6.conf.docker0.optimistic_dad = 0 net.ipv6.conf.docker0.proxy_ndp = 0 net.ipv6.conf.docker0.regen_max_retry = 3 net.ipv6.conf.docker0.router_probe_interval = 60 net.ipv6.conf.docker0.router_solicitation_delay = 1 net.ipv6.conf.docker0.router_solicitation_interval = 4 net.ipv6.conf.docker0.router_solicitations = 3 net.ipv6.conf.docker0.temp_prefered_lft = 86400 net.ipv6.conf.docker0.temp_valid_lft = 604800 net.ipv6.conf.docker0.use_optimistic = 0 net.ipv6.conf.docker0.use_tempaddr = 0 net.ipv6.conf.ens160.accept_dad = 1 net.ipv6.conf.ens160.accept_ra = 1 net.ipv6.conf.ens160.accept_ra_defrtr = 0 net.ipv6.conf.ens160.accept_ra_pinfo = 0 net.ipv6.conf.ens160.accept_ra_rt_info_max_plen = 0 net.ipv6.conf.ens160.accept_ra_rtr_pref = 0 net.ipv6.conf.ens160.accept_redirects = 1 net.ipv6.conf.ens160.accept_source_route = 0 net.ipv6.conf.ens160.autoconf = 1 net.ipv6.conf.ens160.dad_transmits = 1 net.ipv6.conf.ens160.disable_ipv6 = 1 net.ipv6.conf.ens160.enhanced_dad = 1 net.ipv6.conf.ens160.force_mld_version = 0 net.ipv6.conf.ens160.force_tllao = 0 net.ipv6.conf.ens160.forwarding = 0 net.ipv6.conf.ens160.hop_limit = 64 net.ipv6.conf.ens160.keep_addr_on_down = 0 net.ipv6.conf.ens160.max_addresses = 16 net.ipv6.conf.ens160.max_desync_factor = 600 net.ipv6.conf.ens160.mc_forwarding = 0 net.ipv6.conf.ens160.mldv1_unsolicited_report_interval = 10000 net.ipv6.conf.ens160.mldv2_unsolicited_report_interval = 1000 net.ipv6.conf.ens160.mtu = 1500 net.ipv6.conf.ens160.ndisc_notify = 0 net.ipv6.conf.ens160.optimistic_dad = 0 net.ipv6.conf.ens160.proxy_ndp = 0 net.ipv6.conf.ens160.regen_max_retry = 3 net.ipv6.conf.ens160.router_probe_interval = 60 net.ipv6.conf.ens160.router_solicitation_delay = 1 net.ipv6.conf.ens160.router_solicitation_interval = 4 net.ipv6.conf.ens160.router_solicitations = 3 net.ipv6.conf.ens160.temp_prefered_lft = 86400 net.ipv6.conf.ens160.temp_valid_lft = 604800 net.ipv6.conf.ens160.use_optimistic = 0 net.ipv6.conf.ens160.use_tempaddr = 0 net.ipv6.conf.flannel/1.accept_dad = 1 net.ipv6.conf.flannel/1.accept_ra = 1 net.ipv6.conf.flannel/1.accept_ra_defrtr = 1 net.ipv6.conf.flannel/1.accept_ra_pinfo = 1 net.ipv6.conf.flannel/1.accept_ra_rt_info_max_plen = 0 net.ipv6.conf.flannel/1.accept_ra_rtr_pref = 1 net.ipv6.conf.flannel/1.accept_redirects = 1 net.ipv6.conf.flannel/1.accept_source_route = 0 net.ipv6.conf.flannel/1.autoconf = 1 net.ipv6.conf.flannel/1.dad_transmits = 1 net.ipv6.conf.flannel/1.disable_ipv6 = 1 net.ipv6.conf.flannel/1.enhanced_dad = 1 net.ipv6.conf.flannel/1.force_mld_version = 0 net.ipv6.conf.flannel/1.force_tllao = 0 net.ipv6.conf.flannel/1.forwarding = 0 net.ipv6.conf.flannel/1.hop_limit = 64 net.ipv6.conf.flannel/1.keep_addr_on_down = 0 net.ipv6.conf.flannel/1.max_addresses = 16 net.ipv6.conf.flannel/1.max_desync_factor = 600 net.ipv6.conf.flannel/1.mc_forwarding = 0 net.ipv6.conf.flannel/1.mldv1_unsolicited_report_interval = 10000 net.ipv6.conf.flannel/1.mldv2_unsolicited_report_interval = 1000 net.ipv6.conf.flannel/1.mtu = 1450 net.ipv6.conf.flannel/1.ndisc_notify = 0 net.ipv6.conf.flannel/1.optimistic_dad = 0 net.ipv6.conf.flannel/1.proxy_ndp = 0 net.ipv6.conf.flannel/1.regen_max_retry = 3 net.ipv6.conf.flannel/1.router_probe_interval = 60 net.ipv6.conf.flannel/1.router_solicitation_delay = 1 net.ipv6.conf.flannel/1.router_solicitation_interval = 4 net.ipv6.conf.flannel/1.router_solicitations = 3 net.ipv6.conf.flannel/1.temp_prefered_lft = 86400 net.ipv6.conf.flannel/1.temp_valid_lft = 604800 net.ipv6.conf.flannel/1.use_optimistic = 0 net.ipv6.conf.flannel/1.use_tempaddr = 0 net.ipv6.conf.lo.accept_dad = -1 net.ipv6.conf.lo.accept_ra = 1 net.ipv6.conf.lo.accept_ra_defrtr = 1 net.ipv6.conf.lo.accept_ra_pinfo = 1 net.ipv6.conf.lo.accept_ra_rt_info_max_plen = 0 net.ipv6.conf.lo.accept_ra_rtr_pref = 1 net.ipv6.conf.lo.accept_redirects = 1 net.ipv6.conf.lo.accept_source_route = 0 net.ipv6.conf.lo.autoconf = 1 net.ipv6.conf.lo.dad_transmits = 1 net.ipv6.conf.lo.disable_ipv6 = 1 net.ipv6.conf.lo.enhanced_dad = 1 net.ipv6.conf.lo.force_mld_version = 0 net.ipv6.conf.lo.force_tllao = 0 net.ipv6.conf.lo.forwarding = 0 net.ipv6.conf.lo.hop_limit = 64 net.ipv6.conf.lo.keep_addr_on_down = 0 net.ipv6.conf.lo.max_addresses = 16 net.ipv6.conf.lo.max_desync_factor = 600 net.ipv6.conf.lo.mc_forwarding = 0 net.ipv6.conf.lo.mldv1_unsolicited_report_interval = 10000 net.ipv6.conf.lo.mldv2_unsolicited_report_interval = 1000 net.ipv6.conf.lo.mtu = 65536 net.ipv6.conf.lo.ndisc_notify = 0 net.ipv6.conf.lo.optimistic_dad = 0 net.ipv6.conf.lo.proxy_ndp = 0 net.ipv6.conf.lo.regen_max_retry = 3 net.ipv6.conf.lo.router_probe_interval = 60 net.ipv6.conf.lo.router_solicitation_delay = 1 net.ipv6.conf.lo.router_solicitation_interval = 4 net.ipv6.conf.lo.router_solicitations = 3 net.ipv6.conf.lo.temp_prefered_lft = 86400 net.ipv6.conf.lo.temp_valid_lft = 604800 net.ipv6.conf.lo.use_optimistic = 0 net.ipv6.conf.lo.use_tempaddr = -1 net.ipv6.fwmark_reflect = 0 net.ipv6.icmp.ratelimit = 1000 net.ipv6.idgen_delay = 1 net.ipv6.idgen_retries = 3 net.ipv6.ip6frag_high_thresh = 4194304 net.ipv6.ip6frag_low_thresh = 3145728 net.ipv6.ip6frag_secret_interval = 600 net.ipv6.ip6frag_time = 60 net.ipv6.ip_nonlocal_bind = 0 net.ipv6.mld_max_msf = 64 net.ipv6.mld_qrv = 2 net.ipv6.neigh.cni0.anycast_delay = 100 net.ipv6.neigh.cni0.app_solicit = 0 net.ipv6.neigh.cni0.base_reachable_time_ms = 30000 net.ipv6.neigh.cni0.delay_first_probe_time = 5 net.ipv6.neigh.cni0.gc_stale_time = 60 net.ipv6.neigh.cni0.locktime = 0 net.ipv6.neigh.cni0.mcast_solicit = 3 net.ipv6.neigh.cni0.proxy_delay = 80 net.ipv6.neigh.cni0.proxy_qlen = 64 net.ipv6.neigh.cni0.retrans_time_ms = 1000 net.ipv6.neigh.cni0.ucast_solicit = 3 net.ipv6.neigh.cni0.unres_qlen = 31 net.ipv6.neigh.cni0.unres_qlen_bytes = 65536 net.ipv6.neigh.default.anycast_delay = 100 net.ipv6.neigh.default.app_solicit = 0 net.ipv6.neigh.default.base_reachable_time_ms = 30000 net.ipv6.neigh.default.delay_first_probe_time = 5 net.ipv6.neigh.default.gc_interval = 30 net.ipv6.neigh.default.gc_stale_time = 60 net.ipv6.neigh.default.gc_thresh1 = 128 net.ipv6.neigh.default.gc_thresh2 = 512 net.ipv6.neigh.default.gc_thresh3 = 1024 net.ipv6.neigh.default.locktime = 0 net.ipv6.neigh.default.mcast_solicit = 3 net.ipv6.neigh.default.proxy_delay = 80 net.ipv6.neigh.default.proxy_qlen = 64 net.ipv6.neigh.default.retrans_time_ms = 1000 net.ipv6.neigh.default.ucast_solicit = 3 net.ipv6.neigh.default.unres_qlen = 31 net.ipv6.neigh.default.unres_qlen_bytes = 65536 net.ipv6.neigh.docker0.anycast_delay = 100 net.ipv6.neigh.docker0.app_solicit = 0 net.ipv6.neigh.docker0.base_reachable_time_ms = 30000 net.ipv6.neigh.docker0.delay_first_probe_time = 5 net.ipv6.neigh.docker0.gc_stale_time = 60 net.ipv6.neigh.docker0.locktime = 0 net.ipv6.neigh.docker0.mcast_solicit = 3 net.ipv6.neigh.docker0.proxy_delay = 80 net.ipv6.neigh.docker0.proxy_qlen = 64 net.ipv6.neigh.docker0.retrans_time_ms = 1000 net.ipv6.neigh.docker0.ucast_solicit = 3 net.ipv6.neigh.docker0.unres_qlen = 31 net.ipv6.neigh.docker0.unres_qlen_bytes = 65536 net.ipv6.neigh.ens160.anycast_delay = 100 net.ipv6.neigh.ens160.app_solicit = 0 net.ipv6.neigh.ens160.base_reachable_time_ms = 30000 net.ipv6.neigh.ens160.delay_first_probe_time = 5 net.ipv6.neigh.ens160.gc_stale_time = 60 net.ipv6.neigh.ens160.locktime = 0 net.ipv6.neigh.ens160.mcast_solicit = 3 net.ipv6.neigh.ens160.proxy_delay = 80 net.ipv6.neigh.ens160.proxy_qlen = 64 net.ipv6.neigh.ens160.retrans_time_ms = 1000 net.ipv6.neigh.ens160.ucast_solicit = 3 net.ipv6.neigh.ens160.unres_qlen = 31 net.ipv6.neigh.ens160.unres_qlen_bytes = 65536 net.ipv6.neigh.flannel/1.anycast_delay = 100 net.ipv6.neigh.flannel/1.app_solicit = 0 net.ipv6.neigh.flannel/1.base_reachable_time_ms = 30000 net.ipv6.neigh.flannel/1.delay_first_probe_time = 5 net.ipv6.neigh.flannel/1.gc_stale_time = 60 net.ipv6.neigh.flannel/1.locktime = 0 net.ipv6.neigh.flannel/1.mcast_solicit = 3 net.ipv6.neigh.flannel/1.proxy_delay = 80 net.ipv6.neigh.flannel/1.proxy_qlen = 64 net.ipv6.neigh.flannel/1.retrans_time_ms = 1000 net.ipv6.neigh.flannel/1.ucast_solicit = 3 net.ipv6.neigh.flannel/1.unres_qlen = 31 net.ipv6.neigh.flannel/1.unres_qlen_bytes = 65536 net.ipv6.neigh.lo.anycast_delay = 100 net.ipv6.neigh.lo.app_solicit = 0 net.ipv6.neigh.lo.base_reachable_time_ms = 30000 net.ipv6.neigh.lo.delay_first_probe_time = 5 net.ipv6.neigh.lo.gc_stale_time = 60 net.ipv6.neigh.lo.locktime = 0 net.ipv6.neigh.lo.mcast_solicit = 3 net.ipv6.neigh.lo.proxy_delay = 80 net.ipv6.neigh.lo.proxy_qlen = 64 net.ipv6.neigh.lo.retrans_time_ms = 1000 net.ipv6.neigh.lo.ucast_solicit = 3 net.ipv6.neigh.lo.unres_qlen = 31 net.ipv6.neigh.lo.unres_qlen_bytes = 65536 net.ipv6.route.gc_elasticity = 9 net.ipv6.route.gc_interval = 30 net.ipv6.route.gc_min_interval = 0 net.ipv6.route.gc_min_interval_ms = 500 net.ipv6.route.gc_thresh = 1024 net.ipv6.route.gc_timeout = 60 net.ipv6.route.max_size = 16384 net.ipv6.route.min_adv_mss = 1220 net.ipv6.route.mtu_expires = 600 net.ipv6.xfrm6_gc_thresh = 32768 net.netfilter.nf_conntrack_acct = 0 net.netfilter.nf_conntrack_buckets = 65536 net.netfilter.nf_conntrack_checksum = 1 net.netfilter.nf_conntrack_count = 224 net.netfilter.nf_conntrack_dccp_loose = 1 net.netfilter.nf_conntrack_dccp_timeout_closereq = 64 net.netfilter.nf_conntrack_dccp_timeout_closing = 64 net.netfilter.nf_conntrack_dccp_timeout_open = 43200 net.netfilter.nf_conntrack_dccp_timeout_partopen = 480 net.netfilter.nf_conntrack_dccp_timeout_request = 240 net.netfilter.nf_conntrack_dccp_timeout_respond = 480 net.netfilter.nf_conntrack_dccp_timeout_timewait = 240 net.netfilter.nf_conntrack_events = 1 net.netfilter.nf_conntrack_events_retry_timeout = 15 net.netfilter.nf_conntrack_expect_max = 1024 net.netfilter.nf_conntrack_frag6_high_thresh = 4194304 net.netfilter.nf_conntrack_frag6_low_thresh = 3145728 net.netfilter.nf_conntrack_frag6_timeout = 60 net.netfilter.nf_conntrack_generic_timeout = 600 net.netfilter.nf_conntrack_helper = 1 net.netfilter.nf_conntrack_icmp_timeout = 30 net.netfilter.nf_conntrack_icmpv6_timeout = 30 net.netfilter.nf_conntrack_log_invalid = 0 net.netfilter.nf_conntrack_max = 655350 net.netfilter.nf_conntrack_sctp_timeout_closed = 10 net.netfilter.nf_conntrack_sctp_timeout_cookie_echoed = 3 net.netfilter.nf_conntrack_sctp_timeout_cookie_wait = 3 net.netfilter.nf_conntrack_sctp_timeout_established = 432000 net.netfilter.nf_conntrack_sctp_timeout_heartbeat_acked = 210 net.netfilter.nf_conntrack_sctp_timeout_heartbeat_sent = 30 net.netfilter.nf_conntrack_sctp_timeout_shutdown_ack_sent = 3 net.netfilter.nf_conntrack_sctp_timeout_shutdown_recd = 0 net.netfilter.nf_conntrack_sctp_timeout_shutdown_sent = 0 net.netfilter.nf_conntrack_tcp_be_liberal = 0 net.netfilter.nf_conntrack_tcp_loose = 1 net.netfilter.nf_conntrack_tcp_max_retrans = 3 net.netfilter.nf_conntrack_tcp_timeout_close = 10 net.netfilter.nf_conntrack_tcp_timeout_close_wait = 3600 net.netfilter.nf_conntrack_tcp_timeout_established = 1200 net.netfilter.nf_conntrack_tcp_timeout_fin_wait = 120 net.netfilter.nf_conntrack_tcp_timeout_last_ack = 30 net.netfilter.nf_conntrack_tcp_timeout_max_retrans = 300 net.netfilter.nf_conntrack_tcp_timeout_syn_recv = 60 net.netfilter.nf_conntrack_tcp_timeout_syn_sent = 120 net.netfilter.nf_conntrack_tcp_timeout_time_wait = 120 net.netfilter.nf_conntrack_tcp_timeout_unacknowledged = 300 net.netfilter.nf_conntrack_timestamp = 0 net.netfilter.nf_conntrack_udp_timeout = 30 net.netfilter.nf_conntrack_udp_timeout_stream = 180 net.netfilter.nf_log.0 = NONE net.netfilter.nf_log.1 = NONE net.netfilter.nf_log.10 = NONE net.netfilter.nf_log.11 = NONE net.netfilter.nf_log.12 = NONE net.netfilter.nf_log.2 = NONE net.netfilter.nf_log.3 = NONE net.netfilter.nf_log.4 = NONE net.netfilter.nf_log.5 = NONE net.netfilter.nf_log.6 = NONE net.netfilter.nf_log.7 = NONE net.netfilter.nf_log.8 = NONE net.netfilter.nf_log.9 = NONE net.netfilter.nf_log_all_netns = 0 net.nf_conntrack_max = 655350 net.unix.max_dgram_qlen = 512 user.max_ipc_namespaces = 47965 user.max_mnt_namespaces = 47965 user.max_net_namespaces = 47965 user.max_pid_namespaces = 47965 user.max_user_namespaces = 0 user.max_uts_namespaces = 47965 vm.admin_reserve_kbytes = 8192 vm.block_dump = 0 vm.dirty_background_bytes = 0 vm.dirty_background_ratio = 10 vm.dirty_bytes = 0 vm.dirty_expire_centisecs = 3000 vm.dirty_ratio = 30 vm.dirty_writeback_centisecs = 500 vm.drop_caches = 0 vm.extfrag_threshold = 500 vm.hugepages_treat_as_movable = 0 vm.hugetlb_shm_group = 0 vm.laptop_mode = 0 vm.legacy_va_layout = 0 vm.lowmem_reserve_ratio = 256 256 32 vm.max_map_count = 655360 vm.memory_failure_early_kill = 0 vm.memory_failure_recovery = 1 vm.min_free_kbytes = 67584 vm.min_slab_ratio = 5 vm.min_unmapped_ratio = 1 vm.mmap_min_addr = 4096 vm.mmap_rnd_bits = 28 vm.mmap_rnd_compat_bits = 8 vm.nr_hugepages = 0 vm.nr_hugepages_mempolicy = 0 vm.nr_overcommit_hugepages = 0 vm.nr_pdflush_threads = 0 vm.numa_zonelist_order = default vm.oom_dump_tasks = 1 vm.oom_kill_allocating_task = 0 vm.overcommit_kbytes = 0 vm.overcommit_memory = 1 vm.overcommit_ratio = 50 vm.page-cluster = 3 vm.panic_on_oom = 0 vm.percpu_pagelist_fraction = 0 vm.stat_interval = 1 vm.swappiness = 0 vm.user_reserve_kbytes = 131072 vm.vfs_cache_pressure = 100 vm.zone_reclaim_mode = 0

Requirement or improvement

Please describe about your requirements or improvement suggestions.

wu-sheng commented 5 years ago

This is new to me. We have just tested the features in different env and passed. Have you tested on other JVM? This is my local JVM

java version "1.8.0_91"
Java(TM) SE Runtime Environment (build 1.8.0_91-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.91-b14, mixed mode)

zeroall commented 5 years ago

Hi Wu Sheng: Thank you for your reply. I can run normally on my laptop. My laptop is OS Windows and the JDK version is: java version "1.8.0_201" Java(TM) SE Runtime Environment (build 1.8.0_201-b09) Java HotSpot(TM) 64-Bit Server VM (build 25.201-b09, mixed mode)

------------------ 原始邮件 ------------------ 发件人: "吴晟 Wu Sheng"notifications@github.com; 发送时间: 2019年6月29日(星期六) 中午11:33 收件人: "apache/skywalking"skywalking@noreply.github.com; 抄送: "mbaight"mbaight@foxmail.com;"Author"author@noreply.github.com; 主题: Re: [apache/skywalking] OutOfMemoryError bycom.google.common.reflect.ClassPath.from (#2969)

This is new to me. We have just tested the features in different env and passed. Have you tested on other JVM? This is my local JVM java version "1.8.0_91" Java(TM) SE Runtime Environment (build 1.8.0_91-b14) Java HotSpot(TM) 64-Bit Server VM (build 25.91-b14, mixed mode)
— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or mute the thread.

kezhenxu94 commented 5 years ago

This is new to me. We have just tested the features in different env and passed. Have you tested on other JVM? This is my local JVM
java version "1.8.0_91"
Java(TM) SE Runtime Environment (build 1.8.0_91-b14)
Java HotSpot(TM) 64-Bit Server VM (build 25.91-b14, mixed mode)

@wu-sheng I've encountered this issue once in the docker container, @zeroall can you elaborate more on what you modified/change? including the directory structure/hierarchy (perhaps)

wu-sheng commented 5 years ago

I agree this may lead to a bug, which hasn't be reported and addressed. We need more details to find out.

zeroall commented 5 years ago

Hi Wu Sheng: I ran skywalking in another linux environment, and it worked. Jdk: java version "1.8.0_201" Java(TM) SE Runtime Environment (build 1.8.0_201-b09) Java HotSpot(TM) 64-Bit Server VM (build 25.201-b09, mixed mode)

But when using the same JDK to run in the faulty machine, it will not work. It should be a problem of the OS system.

I unzipped skywalking to the directory /root/data/skywalking/apache-skywalking-apm-bin/， and changed the following file: application.yml log4j2.xml

I put the document in the attachment.

mbaight@foxmail.com

From: 吴晟 Wu Sheng Date: 2019-06-29 11:33 To: apache/skywalking CC: zeroall; Author Subject: Re: [apache/skywalking] OutOfMemoryError by com.google.common.reflect.ClassPath.from (#2969) This is new to me. We have just tested the features in different env and passed. Have you tested on other JVM? This is my local JVM java version "1.8.0_91" Java(TM) SE Runtime Environment (build 1.8.0_91-b14) Java HotSpot(TM) 64-Bit Server VM (build 25.91-b14, mixed mode)

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub, or mute the thread.

zeroall commented 5 years ago

Hi Wu Sheng, I took a look at Skywalking with the Arthas tool and got some information:

$ dashboard ID NAME GROUP PRIORITY STATE %CPU TIME INTERRUPTED DAEMON
1 main main 5 RUNNABLE 98 0:33 false false
17 AsyncAppender-Worker-arthas-cache.result.A system 9 WAITING 0 0:0 false true
15 Attach Listener system 9 RUNNABLE 0 0:0 false true
11 Curator-ConnectionStateManager-0 main 5 TIMED_WAITING 0 0:0 false true
14 Curator-Framework-0 main 5 WAITING 0 0:0 false true
3 Finalizer system 8 WAITING 0 0:0 false true
2 Reference Handler system 10 WAITING 0 0:0 false true
4 Signal Dispatcher system 9 RUNNABLE 0 0:0 false true
26 Timer-for-arthas-dashboard-4a94f150-5fea-4 system 10 RUNNABLE 0 0:0 false true
25 as-command-execute-daemon system 10 TIMED_WAITING 0 0:0 false true
19 job-timeout system 9 TIMED_WAITING 0 0:0 false true
13 main-EventThread main 5 WAITING 0 0:0 false true
12 main-SendThread(192.168.1.214:2181) main 5 RUNNABLE 0 0:0 false true
20 nioEventLoopGroup-2-1 system 10 RUNNABLE 0 0:0 false false

Memory used total max usage GC
heap 677M 954M 954M 70.97% gc.ps_scavenge.count 29
ps_eden_space 33M 205M 212M 16.01% gc.ps_scavenge.time(ms) 788
ps_survivor_space 0K 67584K 67584K 0.00% gc.ps_marksweep.count 2
ps_old_gen 647M 683M 683M 94.78% gc.ps_marksweep.time(ms) 554
nonheap 31M 32M -1 97.82%
code_cache 5M 5M 240M 2.46%
metaspace 22M 23M -1 96.89%
Runtime
os.name Linux
os.version 3.10.0-957.21.3.el7.x86_64
java.version 1.8.0_201
java.home /opt/jdk1.8.0_201/jre
systemload.average 0.38
processors 4
uptime 35s
ID NAME GROUP PRIORITY STATE %CPU TIME INTERRUPTED DAEMON
1 main main 5 RUNNABLE 97 0:37 false false
26 Timer-for-arthas-dashboard-4a94f150-5fea-4 system 10 RUNNABLE 1 0:0 false true
17 AsyncAppender-Worker-arthas-cache.result.A system 9 WAITING 0 0:0 false true
15 Attach Listener system 9 RUNNABLE 0 0:0 false true
11 Curator-ConnectionStateManager-0 main 5 TIMED_WAITING 0 0:0 false true
14 Curator-Framework-0 main 5 WAITING 0 0:0 false true
3 Finalizer system 8 WAITING 0 0:0 false true
2 Reference Handler system 10 WAITING 0 0:0 false true
4 Signal Dispatcher system 9 RUNNABLE 0 0:0 false true
25 as-command-execute-daemon system 10 TIMED_WAITING 0 0:0 false true
19 job-timeout system 9 TIMED_WAITING 0 0:0 false true
13 main-EventThread main 5 WAITING 0 0:0 false true
12 main-SendThread(192.168.1.214:2181) main 5 RUNNABLE 0 0:0 false true
20 nioEventLoopGroup-2-1 system 10 RUNNABLE 0 0:0 false false
Memory used total max usage GC
heap 755M 954M 954M 79.19% gc.ps_scavenge.count 29
ps_eden_space 73M 205M 212M 34.48% gc.ps_scavenge.time(ms) 788
ps_survivor_space 0K 67584K 67584K 0.00% gc.ps_marksweep.count 6
ps_old_gen 682M 683M 683M 99.97% gc.ps_marksweep.time(ms) 1778
nonheap 31M 32M -1 98.05%
code_cache 6M 6M 240M 2.54%
metaspace 22M 23M -1 98.00%
Runtime
os.name Linux
os.version 3.10.0-957.21.3.el7.x86_64
java.version 1.8.0_201
java.home /opt/jdk1.8.0_201/jre
systemload.average 0.43
processors 4
uptime 40s
ID NAME GROUP PRIORITY STATE %CPU TIME INTERRUPTED DAEMON
1 main main 5 RUNNABLE 99 0:41 false false
17 AsyncAppender-Worker-arthas-cache.result.A system 9 WAITING 0 0:0 false true
15 Attach Listener system 9 RUNNABLE 0 0:0 false true
11 Curator-ConnectionStateManager-0 main 5 TIMED_WAITING 0 0:0 false true
14 Curator-Framework-0 main 5 WAITING 0 0:0 false true
3 Finalizer system 8 WAITING 0 0:0 false true
2 Reference Handler system 10 WAITING 0 0:0 false true
4 Signal Dispatcher system 9 RUNNABLE 0 0:0 false true
26 Timer-for-arthas-dashboard-4a94f150-5fea-4 system 10 RUNNABLE 0 0:0 false true
25 as-command-execute-daemon system 10 TIMED_WAITING 0 0:0 false true
19 job-timeout system 9 TIMED_WAITING 0 0:0 false true
13 main-EventThread main 5 WAITING 0 0:0 false true
12 main-SendThread(192.168.1.214:2181) main 5 RUNNABLE 0 0:0 false true
20 nioEventLoopGroup-2-1 system 10 RUNNABLE 0 0:0 false false
Memory used total max usage GC
heap 853M 954M 954M 89.40% gc.ps_scavenge.count 29
ps_eden_space 170M 205M 212M 80.43% gc.ps_scavenge.time(ms) 788
ps_survivor_space 0K 67584K 67584K 0.00% gc.ps_marksweep.count 12
ps_old_gen 682M 683M 683M 99.97% gc.ps_marksweep.time(ms) 3008
nonheap 31M 33M -1 95.90%
code_cache 5M 6M 240M 2.36%
metaspace 22M 23M -1 97.18%
Runtime
os.name Linux
os.version 3.10.0-957.21.3.el7.x86_64
java.version 1.8.0_201
java.home /opt/jdk1.8.0_201/jre
systemload.average 0.48
processors 4
uptime 45s
ID NAME GROUP PRIORITY STATE %CPU TIME INTERRUPTED DAEMON
1 main main 5 RUNNABLE 99 0:43 false false
17 AsyncAppender-Worker-arthas-cache.result.A system 9 WAITING 0 0:0 false true
15 Attach Listener system 9 RUNNABLE 0 0:0 false true
11 Curator-ConnectionStateManager-0 main 5 TIMED_WAITING 0 0:0 false true
14 Curator-Framework-0 main 5 WAITING 0 0:0 false true
3 Finalizer system 8 WAITING 0 0:0 false true
2 Reference Handler system 10 WAITING 0 0:0 false true
4 Signal Dispatcher system 9 RUNNABLE 0 0:0 false true
26 Timer-for-arthas-dashboard-4a94f150-5fea-4 system 10 RUNNABLE 0 0:0 false true
25 as-command-execute-daemon system 10 TIMED_WAITING 0 0:0 false true
19 job-timeout system 9 TIMED_WAITING 0 0:0 false true
13 main-EventThread main 5 WAITING 0 0:0 false true
12 main-SendThread(192.168.1.214:2181) main 5 TIMED_WAITING 0 0:0 false true
20 nioEventLoopGroup-2-1 system 10 RUNNABLE 0 0:0 false false
Memory used total max usage GC
heap 881M 954M 954M 92.35% gc.ps_scavenge.count 29
ps_eden_space 198M 205M 212M 93.73% gc.ps_scavenge.time(ms) 788
ps_survivor_space 0K 67584K 67584K 0.00% gc.ps_marksweep.count 25
ps_old_gen 682M 683M 683M 99.97% gc.ps_marksweep.time(ms) 5618
nonheap 31M 33M -1 95.69%
code_cache 5M 6M 240M 2.33%
metaspace 22M 23M -1 97.33%
Runtime
os.name Linux
os.version 3.10.0-957.21.3.el7.x86_64
java.version 1.8.0_201
java.home /opt/jdk1.8.0_201/jre
systemload.average 1.00
processors 4
uptime 50s

jvm

RUNTIME

MACHINE-NAME 12887@centos0
JVM-START-TIME 2019-06-29 12:56:05
MANAGEMENT-SPEC-VERSION 1.2
SPEC-NAME Java Virtual Machine Specification
SPEC-VENDOR Oracle Corporation
SPEC-VERSION 1.8
VM-NAME Java HotSpot(TM) 64-Bit Server VM
VM-VENDOR Oracle Corporation
VM-VERSION 25.201-b09
INPUT-ARGUMENTS -Xms1G
-Xmx1G
-Doap.logDir=/root/data/skywalking/apache-skywalking-apm-bin/logs

CLASS-PATH /root/data/skywalking/apache-skywalking-apm-bin/oap-libs/zookeeper-3.4.10.jar:/root/data/skywalking/apache-skywalking-ap m-bin/oap-libs/zipkin-receiver-plugin-6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/zipkin-2.9.1.ja r:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/telemetry-prometheus-6.1.0.jar:/root/data/skywalking/apache-s kywalking-apm-bin/oap-libs/telemetry-api-6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/t-digest-3.2 .jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/swagger-annotations-1.5.12.jar:/root/data/skywalking/apach e-skywalking-apm-bin/oap-libs/storage-zipkin-plugin-6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/s torage-jdbc-hikaricp-plugin-6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/storage-jaeger-plugin-6.1 .0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/storage-elasticsearch-plugin-6.1.0.jar:/root/data/skywal king/apache-skywalking-apm-bin/oap-libs/snakeyaml-1.18.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/slf4 j-api-1.7.25.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/skywalking-trace-receiver-plugin-6.1.0.jar:/ro ot/data/skywalking/apache-skywalking-apm-bin/oap-libs/skywalking-sharing-server-plugin-6.1.0.jar:/root/data/skywalking/a pache-skywalking-apm-bin/oap-libs/skywalking-register-receiver-plugin-6.1.0.jar:/root/data/skywalking/apache-skywalking- apm-bin/oap-libs/skywalking-mesh-receiver-plugin-6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/skyw alking-jvm-receiver-plugin-6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/skywalking-clr-receiver-pl ugin-6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/simpleclient_httpserver-0.6.0.jar:/root/data/sky walking/apache-skywalking-apm-bin/oap-libs/simpleclient_hotspot-0.6.0.jar:/root/data/skywalking/apache-skywalking-apm-bi n/oap-libs/simpleclient_common-0.6.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/simpleclient-0.6.0.jar :/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/sharding-jdbc-core-2.0.3.jar:/root/data/skywalking/apache-skyw alking-apm-bin/oap-libs/server-starter-6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/server-core-6. 1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/server-alarm-plugin-6.1.0.jar:/root/data/skywalking/apa che-skywalking-apm-bin/oap-libs/retrofit-2.3.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/reflectasm-1 .11.7.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/receiver-proto-6.1.0.jar:/root/data/skywalking/apache -skywalking-apm-bin/oap-libs/reactive-streams-1.0.2.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/rank-ev al-client-6.3.2.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/query-graphql-plugin-6.1.0.jar:/root/data/s kywalking/apache-skywalking-apm-bin/oap-libs/proto-google-common-protos-1.0.0.jar:/root/data/skywalking/apache-skywalkin g-apm-bin/oap-libs/protobuf-java-3.4.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/parent-join-client-6 .3.2.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/opencensus-contrib-grpc-metrics-0.12.3.jar:/root/data/ skywalking/apache-skywalking-apm-bin/oap-libs/opencensus-api-0.12.3.jar:/root/data/skywalking/apache-skywalking-apm-bin/ oap-libs/okio-1.13.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/okhttp-ws-2.7.5.jar:/root/data/skywalk ing/apache-skywalking-apm-bin/oap-libs/okhttp-3.9.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/okhttp- 2.7.5.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/netty-transport-4.1.27.Final.jar:/root/data/skywalkin g/apache-skywalking-apm-bin/oap-libs/netty-tcnative-boringssl-static-2.0.7.Final.jar:/root/data/skywalking/apache-skywal king-apm-bin/oap-libs/netty-resolver-4.1.27.Final.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/netty-han dler-proxy-4.1.27.Final.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/netty-handler-4.1.27.Final.jar:/roo t/data/skywalking/apache-skywalking-apm-bin/oap-libs/netty-common-4.1.27.Final.jar:/root/data/skywalking/apache-skywalki ng-apm-bin/oap-libs/netty-codec-socks-4.1.27.Final.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/netty-co dec-http-4.1.27.Final.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/netty-codec-http2-4.1.27.Final.jar:/r oot/data/skywalking/apache-skywalking-apm-bin/oap-libs/netty-codec-4.1.27.Final.jar:/root/data/skywalking/apache-skywalk ing-apm-bin/oap-libs/netty-buffer-4.1.27.Final.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/netty-3.10.5 .Final.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/mysql-connector-java-5.1.47.jar:/root/data/skywalkin g/apache-skywalking-apm-bin/oap-libs/lucene-suggest-7.3.1.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/l ucene-spatial-extras-7.3.1.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/lucene-spatial-7.3.1.jar:/root/d ata/skywalking/apache-skywalking-apm-bin/oap-libs/lucene-spatial3d-7.3.1.jar:/root/data/skywalking/apache-skywalking-apm -bin/oap-libs/lucene-sandbox-7.3.1.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/lucene-queryparser-7.3.1 .jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/lucene-queries-7.3.1.jar:/root/data/skywalking/apache-skyw alking-apm-bin/oap-libs/lucene-misc-7.3.1.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/lucene-memory-7.3 .1.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/lucene-join-7.3.1.jar:/root/data/skywalking/apache-skywa lking-apm-bin/oap-libs/lucene-highlighter-7.3.1.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/lucene-grou ping-7.3.1.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/lucene-core-7.3.1.jar:/root/data/skywalking/apac he-skywalking-apm-bin/oap-libs/lucene-backward-codecs-7.3.1.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs /lucene-analyzers-common-7.3.1.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/logging-interceptor-2.7.5.ja r:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/log4j-slf4j-impl-2.9.0.jar:/root/data/skywalking/apache-skywa lking-apm-bin/oap-libs/log4j-over-slf4j-1.7.25.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/log4j-core-2 .9.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/log4j-api-2.9.0.jar:/root/data/skywalking/apache-skywa lking-apm-bin/oap-libs/log4j-1.2.16.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/library-util-6.1.0.jar: /root/data/skywalking/apache-skywalking-apm-bin/oap-libs/library-server-6.1.0.jar:/root/data/skywalking/apache-skywalkin g-apm-bin/oap-libs/library-module-6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/library-client-6.1. 0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/library-buffer-6.1.0.jar:/root/data/skywalking/apache-sky walking-apm-bin/oap-libs/kotlin-stdlib-1.1.60.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/kotlin-reflec t-1.1.1.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/jsr305-1.3.9.jar:/root/data/skywalking/apache-skywa lking-apm-bin/oap-libs/jopt-simple-4.6.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/joda-time-2.9.9.jar: /root/data/skywalking/apache-skywalking-apm-bin/oap-libs/jna-4.5.1.jar:/root/data/skywalking/apache-skywalking-apm-bin/o ap-libs/jline-0.9.94.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/jetty-util-9.4.2.v20170220.jar:/root/d ata/skywalking/apache-skywalking-apm-bin/oap-libs/jetty-servlet-9.4.2.v20170220.jar:/root/data/skywalking/apache-skywalk ing-apm-bin/oap-libs/jetty-server-9.4.2.v20170220.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/jetty-sec urity-9.4.2.v20170220.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/jetty-io-9.4.2.v20170220.jar:/root/da ta/skywalking/apache-skywalking-apm-bin/oap-libs/jetty-http-9.4.2.v20170220.jar:/root/data/skywalking/apache-skywalking- apm-bin/oap-libs/jcl-over-slf4j-1.7.25.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/javax.servlet-api-3. 1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/java-dataloader-2.0.2.jar:/root/data/skywalking/apache- skywalking-apm-bin/oap-libs/jaeger-receiver-plugin-6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/ja ckson-module-kotlin-2.8.8.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/jackson-mapper-asl-1.9.13.jar:/ro ot/data/skywalking/apache-skywalking-apm-bin/oap-libs/jackson-datatype-jdk8-2.9.5.jar:/root/data/skywalking/apache-skywa lking-apm-bin/oap-libs/jackson-datatype-guava-2.9.5.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/jackson -dataformat-yaml-2.8.10.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/jackson-dataformat-smile-2.8.10.jar :/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/jackson-dataformat-cbor-2.8.10.jar:/root/data/skywalking/apach e-skywalking-apm-bin/oap-libs/jackson-databind-2.9.5.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/jackso n-core-asl-1.9.13.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/jackson-core-2.9.5.jar:/root/data/skywalk ing/apache-skywalking-apm-bin/oap-libs/jackson-annotations-2.9.5.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap -libs/httpcore-nio-4.4.5.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/httpcore-4.4.5.jar:/root/data/skyw alking/apache-skywalking-apm-bin/oap-libs/httpclient-4.5.2.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/ httpasyncclient-4.1.2.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/hppc-0.7.1.jar:/root/data/skywalking/ apache-skywalking-apm-bin/oap-libs/HikariCP-3.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/HdrHistog ram-2.1.9.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/guava-20.0.jar:/root/data/skywalking/apache-skywa lking-apm-bin/oap-libs/gson-2.8.1.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/grpc-stub-1.15.1.jar:/roo t/data/skywalking/apache-skywalking-apm-bin/oap-libs/grpc-protobuf-lite-1.15.1.jar:/root/data/skywalking/apache-skywalki ng-apm-bin/oap-libs/grpc-protobuf-1.15.1.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/grpc-netty-1.15.1. jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/grpc-core-1.15.1.jar:/root/data/skywalking/apache-skywalkin g-apm-bin/oap-libs/grpc-context-1.15.1.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/groovy-2.4.5-indy.ja r:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/graphql-java-tools-5.2.3.jar:/root/data/skywalking/apache-sky walking-apm-bin/oap-libs/graphql-java-8.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/generated-analysi s-6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/exporter-6.1.0.jar:/root/data/skywalking/apache-sky walking-apm-bin/oap-libs/error_prone_annotations-2.2.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/envo y-metrics-receiver-plugin-6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/elasticsearch-x-content-6.3 .2.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/elasticsearch-secure-sm-6.3.2.jar:/root/data/skywalking/ apache-skywalking-apm-bin/oap-libs/elasticsearch-rest-high-level-client-6.3.2.jar:/root/data/skywalking/apache-skywalkin g-apm-bin/oap-libs/elasticsearch-rest-client-6.3.2.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/elastics earch-core-6.3.2.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/elasticsearch-cli-6.3.2.jar:/root/data/sky walking/apache-skywalking-apm-bin/oap-libs/elasticsearch-6.3.2.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-l ibs/curator-x-discovery-4.0.1.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/curator-recipes-4.0.1.jar:/ro ot/data/skywalking/apache-skywalking-apm-bin/oap-libs/curator-framework-4.0.1.jar:/root/data/skywalking/apache-skywalkin g-apm-bin/oap-libs/curator-client-4.0.1.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/converter-jackson-2 .3.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/consul-client-1.2.6.jar:/root/data/skywalking/apache-s kywalking-apm-bin/oap-libs/commons-pool-1.5.4.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/commons-lang3 -3.7.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/commons-io-2.6.jar:/root/data/skywalking/apache-skywal king-apm-bin/oap-libs/commons-dbcp-1.4.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/commons-codec-1.11.j ar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/cluster-zookeeper-plugin-6.1.0.jar:/root/data/skywalking/apa che-skywalking-apm-bin/oap-libs/cluster-standalone-plugin-6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap- libs/cluster-kubernetes-plugin-6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/cluster-consul-plugin- 6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/client-java-proto-2.0.0.jar:/root/data/skywalking/apa che-skywalking-apm-bin/oap-libs/client-java-api-2.0.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/clien t-java-2.0.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/caffeine-2.6.2.jar:/root/data/skywalking/apach e-skywalking-apm-bin/oap-libs/bcprov-jdk15on-1.59.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/bcprov-ex t-jdk15on-1.59.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/bcpkix-jdk15on-1.59.jar:/root/data/skywalkin g/apache-skywalking-apm-bin/oap-libs/apm-util-6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/apm-net work-6.1.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/apm-datacarrier-6.1.0.jar:/root/data/skywalking/ apache-skywalking-apm-bin/oap-libs/antlr4-runtime-4.7.1.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/ann otations-13.0.jar:/root/data/skywalking/apache-skywalking-apm-bin/oap-libs/animal-sniffer-annotations-1.17.jar:/root/dat a/skywalking/apache-skywalking-apm-bin/oap-libs/aggs-matrix-stats-client-6.3.2.jar:/root/data/skywalking/apache-skywalki ng-apm-bin/config:.:/opt/java/lib/dt.jar:/opt/java/lib/tools.jar
BOOT-CLASS-PATH /opt/jdk1.8.0_201/jre/lib/resources.jar:/opt/jdk1.8.0_201/jre/lib/rt.jar:/opt/jdk1.8.0_201/jre/lib/sunrsasign.jar:/opt/j dk1.8.0_201/jre/lib/jsse.jar:/opt/jdk1.8.0_201/jre/lib/jce.jar:/opt/jdk1.8.0_201/jre/lib/charsets.jar:/opt/jdk1.8.0_201/ jre/lib/jfr.jar:/opt/jdk1.8.0_201/jre/classes
LIBRARY-PATH /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib

CLASS-LOADING

LOADED-CLASS-COUNT 4478
TOTAL-LOADED-CLASS-COUNT 4478
UNLOADED-CLASS-COUNT 0
IS-VERBOSE false

COMPILATION

NAME HotSpot 64-Bit Tiered Compilers
TOTAL-COMPILE-TIME 8097(ms)

GARBAGE-COLLECTORS

PS Scavenge 29/788(ms)
[count/time]
PS MarkSweep 301/49445(ms)
[count/time]

MEMORY-MANAGERS

CodeCacheManager Code Cache

Metaspace Manager Metaspace
Compressed Class Space

PS Scavenge PS Eden Space
PS Survivor Space

PS MarkSweep PS Eden Space
PS Survivor Space
PS Old Gen

MEMORY

HEAP-MEMORY-USAGE 1000865792(954.50 MiB)/1073741824(1.00 GiB)/1000865792(954.50 MiB)/930960160(887.83 MiB)
[committed/init/max/used]
NO-HEAP-MEMORY-USAGE 34603008(33.00 MiB)/2555904(2.44 MiB)/-1(-1 B)/33061200(31.53 MiB)
[committed/init/max/used]
PENDING-FINALIZE-COUNT 0

OPERATING-SYSTEM

OS Linux
ARCH amd64
PROCESSORS-COUNT 4
LOAD-AVERAGE 4.47
VERSION 3.10.0-957.21.3.el7.x86_64

THREAD

COUNT 18
DAEMON-COUNT 12
PEAK-COUNT 20
STARTED-COUNT 23
DEADLOCK-COUNT 0

FILE-DESCRIPTOR

MAX-FILE-DESCRIPTOR-COUNT 65536
OPEN-FILE-DESCRIPTOR-COUNT 244
Affect(row-cnt:0) cost in 55728 ms. $ $ Connection closed by foreign host.

Then I looked at the oap-lib directory, which contains the following files:

root @ centos0 in ~/data/skywalking/apache-skywalking-apm-bin/oap-libs [13:10:10]

$ ls aggs-matrix-stats-client-6.3.2.jar animal-sniffer-annotations-1.17.jar annotations-13.0.jar antlr4-runtime-4.7.1.jar apm-datacarrier-6.1.0.jar apm-network-6.1.0.jar apm-util-6.1.0.jar bcpkix-jdk15on-1.59.jar bcprov-ext-jdk15on-1.59.jar bcprov-jdk15on-1.59.jar caffeine-2.6.2.jar client-java-2.0.0.jar client-java-api-2.0.0.jar client-java-proto-2.0.0.jar cluster-consul-plugin-6.1.0.jar cluster-kubernetes-plugin-6.1.0.jar cluster-standalone-plugin-6.1.0.jar cluster-zookeeper-plugin-6.1.0.jar commons-codec-1.11.jar commons-dbcp-1.4.jar commons-io-2.6.jar commons-lang3-3.7.jar commons-pool-1.5.4.jar consul-client-1.2.6.jar converter-jackson-2.3.0.jar curator-client-4.0.1.jar curator-framework-4.0.1.jar curator-recipes-4.0.1.jar curator-x-discovery-4.0.1.jar elasticsearch-6.3.2.jar elasticsearch-cli-6.3.2.jar elasticsearch-core-6.3.2.jar elasticsearch-rest-client-6.3.2.jar elasticsearch-rest-high-l elasticsearch-secure-sm-6.3.2.jar elasticsearch-x-content-6.3.2.jar envoy-metrics-receiver-pl error_prone_annotations-2.2.0.jar exporter-6.1.0.jar generated-analysis-6.1.0.jar graphql-java-8.0.jar graphql-java-tools-5.2.3.jar groovy-2.4.5-indy.jar grpc-context-1.15.1.jar grpc-core-1.15.1.jar grpc-netty-1.15.1.jar grpc-protobuf-1.15.1.jar grpc-protobuf-lite-1.15.1.jar grpc-stub-1.15.1.jar gson-2.8.1.jar guava-20.0.jar HdrHistogram-2.1.9.jar HikariCP-3.1.0.jar hppc-0.7.1.jar httpasyncclient-4.1.2.jar httpclient-4.5.2.jar httpcore-4.4.5.jar mysql-connector-java-5.1.47.jar httpcore-nio-4.4.5.jar netty-3.10.5.Final.jar jackson-annotations-2.9.5.jar netty-buffer-4.1.27.Final.jar jackson-core-2.9.5.jar netty-codec-4.1.27.Final.jar jackson-core-asl-1.9.13.jar netty-codec-http2-4.1.27.Final.jar jackson-databind-2.9.5.jar netty-codec-http-4.1.27.Final.jar jackson-dataformat-cbor-2.8.10.jar netty-codec-socks-4.1.27.Final.jar jackson-dataformat-smile-2.8.10.jar netty-common-4.1.27.Final.jar jackson-dataformat-yaml-2.8.10.jar netty-handler-4.1.27.Final.jar jackson-datatype-guava-2.9.5.jar netty-handler-proxy-4.1.27.Final.jar jackson-datatype-jdk8-2.9.5.jar netty-resolver-4.1.27.Final.jar jackson-mapper-asl-1.9.13.jar netty-tcnative-boringssl-static-2.0.7.Final.jar jackson-module-kotlin-2.8.8.jar netty-transport-4.1.27.Final.jar jaeger-receiver-plugin-6.1.0.jar okhttp-2.7.5.jar java-dataloader-2.0.2.jar okhttp-3.9.0.jar javax.servlet-api-3.1.0.jar okhttp-ws-2.7.5.jar jcl-over-slf4j-1.7.25.jar okio-1.13.0.jar jetty-http-9.4.2.v20170220.jar opencensus-api-0.12.3.jar jetty-io-9.4.2.v20170220.jar opencensus-contrib-grpc-metrics-0.12.3.jar jetty-security-9.4.2.v20170220.jar parent-join-client-6.3.2.jar jetty-server-9.4.2.v20170220.jar protobuf-java-3.4.0.jar jetty-servlet-9.4.2.v20170220.jar proto-google-common-protos-1.0.0.jar jetty-util-9.4.2.v20170220.jar query-graphql-plugin-6.1.0.jar jline-0.9.94.jar rank-eval-client-6.3.2.jar jna-4.5.1.jar reactive-streams-1.0.2.jar joda-time-2.9.9.jar receiver-proto-6.1.0.jar jopt-simple-4.6.jar reflectasm-1.11.7.jar jsr305-1.3.9.jar retrofit-2.3.0.jar kotlin-reflect-1.1.1.jar server-alarm-plugin-6.1.0.jar kotlin-stdlib-1.1.60.jar server-core-6.1.0.jar library-buffer-6.1.0.jar server-starter-6.1.0.jar library-client-6.1.0.jar sharding-jdbc-core-2.0.3.jar library-module-6.1.0.jar simpleclient-0.6.0.jar evel-client-6.3.2.jar library-server-6.1.0.jar simpleclient_common-0.6.0.jar library-util-6.1.0.jar simpleclient_hotspot-0.6.0.jar log4j-1.2.16.jar simpleclient_httpserver-0.6.0.jar ugin-6.1.0.jar log4j-api-2.9.0.jar skywalking-clr-receiver-plugin-6.1.0.jar log4j-core-2.9.0.jar skywalking-jvm-receiver-plugin-6.1.0.jar log4j-over-slf4j-1.7.25.jar skywalking-mesh-receiver-plugin-6.1.0.jar log4j-slf4j-impl-2.9.0.jar skywalking-register-receiver-plugin-6.1.0.jar logging-interceptor-2.7.5.jar skywalking-sharing-server-plugin-6.1.0.jar lucene-analyzers-common-7.3.1.jar skywalking-trace-receiver-plugin-6.1.0.jar lucene-backward-codecs-7.3.1.jar slf4j-api-1.7.25.jar lucene-core-7.3.1.jar snakeyaml-1.18.jar lucene-grouping-7.3.1.jar storage-elasticsearch-plugin-6.1.0.jar lucene-highlighter-7.3.1.jar storage-jaeger-plugin-6.1.0.jar lucene-join-7.3.1.jar storage-jdbc-hikaricp-plugin-6.1.0.jar lucene-memory-7.3.1.jar storage-zipkin-plugin-6.1.0.jar lucene-misc-7.3.1.jar swagger-annotations-1.5.12.jar lucene-queries-7.3.1.jar t-digest-3.2.jar lucene-queryparser-7.3.1.jar telemetry-api-6.1.0.jar lucene-sandbox-7.3.1.jar telemetry-prometheus-6.1.0.jar lucene-spatial3d-7.3.1.jar zipkin-2.9.1.jar lucene-spatial-7.3.1.jar zipkin-receiver-plugin-6.1.0.jar lucene-spatial-extras-7.3.1.jar zookeeper-3.4.10.jar lucene-suggest-7.3.1.jar

mbaight@foxmail.com

From: mbaight@foxmail.com Date: 2019-06-29 12:02 To: reply+abtzq63yj4gngmgzzia6r753eqhh3evbnhhbxdmihi Subject: Re: Re: [apache/skywalking] OutOfMemoryError by com.google.common.reflect.ClassPath.from (#2969) Hi Wu Sheng: I ran skywalking in another linux environment, and it worked. Jdk: java version "1.8.0_201" Java(TM) SE Runtime Environment (build 1.8.0_201-b09) Java HotSpot(TM) 64-Bit Server VM (build 25.201-b09, mixed mode)

But when using the same JDK to run in the faulty machine, it will not work. It should be a problem of the OS system.

I unzipped skywalking to the directory /root/data/skywalking/apache-skywalking-apm-bin/， and changed the following file: application.yml log4j2.xml

I put the document in the attachment.

mbaight@foxmail.com

From: 吴晟 Wu Sheng Date: 2019-06-29 11:33 To: apache/skywalking CC: zeroall; Author Subject: Re: [apache/skywalking] OutOfMemoryError by com.google.common.reflect.ClassPath.from (#2969) This is new to me. We have just tested the features in different

wu-sheng commented 5 years ago

@zeroall Have you increased the perm size or metadata size? Look like OOM from nonheap memory.

zeroall commented 5 years ago

I adjusted Xmx and set it to 1G. The GC log information is as follows:

Java HotSpot(TM) 64-Bit Server VM (25.161-b12) for linux-amd64 JRE (1.8.0_161-b12), built on Dec 19 2017 16:12:43 by "java_re" with gcc 4.3.0 20080428 (Red Hat 4.3.0-8) Memory: 4k page, physical 12302896k(7521532k free), swap 0k(0k free) CommandLine flags: -XX:HeapDumpPath=/home/logs/skywalking/heap_dump.log -XX:InitialHeapSize=8589934592 -XX:MaxHeapSize=8589934592 -XX:MaxNewSize=536870912 -XX:NewSize=536870912 -XX:+PrintGC -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+UseCompressedClassPointers -XX:+UseCompressedOops -XX:-UseGCOverheadLimit -XX:+UseParallelGC 2019-06-28T18:39:07.404+0800: 5.679: [GC (Allocation Failure) [PSYoungGen: 393216K->53294K(458752K)] 393216K->53374K(8323072K), 0.0904111 secs] [Times: user=0.16 sys=0.05, real=0.09 secs] 2019-06-28T18:39:11.430+0800: 9.705: [GC (Allocation Failure) [PSYoungGen: 446510K->65520K(458752K)] 446590K->97248K(8323072K), 0.0823975 secs] [Times: user=0.24 sys=0.09, real=0.08 secs] 2019-06-28T18:39:14.488+0800: 12.763: [GC (Allocation Failure) [PSYoungGen: 458736K->65532K(458752K)] 490464K->155448K(8323072K), 0.0779793 secs] [Times: user=0.23 sys=0.05, real=0.08 secs] 2019-06-28T18:39:17.799+0800: 16.074: [GC (Allocation Failure) [PSYoungGen: 458748K->65532K(458752K)] 548664K->218400K(8323072K), 0.0668034 secs] [Times: user=0.20 sys=0.05, real=0.07 secs] 2019-06-28T18:39:20.516+0800: 18.791: [GC (Allocation Failure) [PSYoungGen: 458748K->65532K(458752K)] 611616K->292368K(8323072K), 0.0546505 secs] [Times: user=0.16 sys=0.06, real=0.05 secs] 2019-06-28T18:39:22.496+0800: 20.771: [GC (Allocation Failure) [PSYoungGen: 458748K->65532K(240640K)] 685584K->369496K(8104960K), 0.0520394 secs] [Times: user=0.14 sys=0.06, real=0.05 secs] 2019-06-28T18:39:23.791+0800: 22.066: [GC (Allocation Failure) [PSYoungGen: 240636K->91648K(349696K)] 544600K->395976K(8214016K), 0.0400618 secs] [Times: user=0.16 sys=0.00, real=0.04 secs] 2019-06-28T18:39:24.863+0800: 23.138: [GC (Allocation Failure) [PSYoungGen: 266752K->117664K(349696K)] 571080K->422256K(8214016K), 0.0238089 secs] [Times: user=0.09 sys=0.00, real=0.02 secs] 2019-06-28T18:39:25.798+0800: 24.072: [GC (Allocation Failure) [PSYoungGen: 292768K->78400K(349696K)] 597360K->464960K(8214016K), 0.0477896 secs] [Times: user=0.13 sys=0.06, real=0.05 secs] 2019-06-28T18:39:26.705+0800: 24.980: [GC (Allocation Failure) [PSYoungGen: 253504K->52640K(349184K)] 640064K->504568K(8213504K), 0.0350794 secs] [Times: user=0.08 sys=0.05, real=0.03 secs] 2019-06-28T18:39:27.528+0800: 25.803: [GC (Allocation Failure) [PSYoungGen: 227744K->26560K(349696K)] 679672K->543968K(8214016K), 0.0300844 secs] [Times: user=0.06 sys=0.05, real=0.03 secs] 2019-06-28T18:39:28.347+0800: 26.622: [GC (Allocation Failure) [PSYoungGen: 201664K->26144K(349696K)] 719072K->576208K(8214016K), 0.0191140 secs] [Times: user=0.05 sys=0.02, real=0.02 secs] 2019-06-28T18:39:29.153+0800: 27.428: [GC (Allocation Failure) [PSYoungGen: 201248K->26528K(349696K)] 751312K->609464K(8214016K), 0.0221618 secs] [Times: user=0.05 sys=0.03, real=0.02 secs] 2019-06-28T18:39:29.967+0800: 28.242: [GC (Allocation Failure) [PSYoungGen: 201632K->26528K(349696K)] 784568K->642064K(8214016K), 0.0209792 secs] [Times: user=0.06 sys=0.02, real=0.02 secs] 2019-06-28T18:39:30.769+0800: 29.044: [GC (Allocation Failure) [PSYoungGen: 201632K->26688K(349696K)] 817168K->674912K(8214016K), 0.0214878 secs] [Times: user=0.06 sys=0.02, real=0.02 secs] 2019-06-28T18:39:31.584+0800: 29.859: [GC (Allocation Failure) [PSYoungGen: 201792K->26464K(349696K)] 850016K->707480K(8214016K), 0.0212753 secs] [Times: user=0.06 sys=0.03, real=0.02 secs] 2019-06-28T18:39:32.394+0800: 30.669: [GC (Allocation Failure) [PSYoungGen: 201568K->26592K(349696K)] 882584K->740448K(8214016K), 0.0207920 secs] [Times: user=0.07 sys=0.02, real=0.02 secs] 2019-06-28T18:39:33.203+0800: 31.477: [GC (Allocation Failure) [PSYoungGen: 201696K->26592K(354816K)] 915552K->773176K(8219136K), 0.0208266 secs] [Times: user=0.06 sys=0.03, real=0.03 secs] 2019-06-28T18:39:34.558+0800: 32.833: [GC (Allocation Failure) [PSYoungGen: 206816K->27424K(349696K)] 953400K->806688K(8214016K), 0.0244211 secs] [Times: user=0.07 sys=0.03, real=0.02 secs] 2019-06-28T18:39:35.513+0800: 33.788: [GC (Allocation Failure) [PSYoungGen: 207648K->27360K(366080K)] 986912K->840416K(8230400K), 0.0242397 secs] [Times: user=0.06 sys=0.03, real=0.03 secs] 2019-06-28T18:39:37.060+0800: 35.335: [GC (Allocation Failure) [PSYoungGen: 229600K->30624K(360448K)] 1042656K->877272K(8224768K), 0.0268807 secs] [Times: user=0.08 sys=0.03, real=0.03 secs] 2019-06-28T18:39:38.953+0800: 37.227: [GC (Allocation Failure) [PSYoungGen: 232864K->30208K(379392K)] 1079512K->914632K(8243712K), 0.0284409 secs] [Times: user=0.07 sys=0.04, real=0.03 secs] 2019-06-28T18:39:40.243+0800: 38.518: [GC (Allocation Failure) [PSYoungGen: 258048K->34496K(372736K)] 1142472K->956416K(8237056K), 0.0243899 secs] [Times: user=0.06 sys=0.03, real=0.02 secs] 2019-06-28T18:39:41.836+0800: 40.110: [GC (Allocation Failure) [PSYoungGen: 262336K->34400K(393216K)] 1184256K->998888K(8257536K), 0.0286452 secs] [Times: user=0.08 sys=0.03, real=0.03 secs] 2019-06-28T18:39:43.698+0800: 41.973: [GC (Allocation Failure) [PSYoungGen: 289888K->38368K(386560K)] 1254376K->1045456K(8250880K), 0.0294143 secs] [Times: user=0.08 sys=0.03, real=0.03 secs] 2019-06-28T18:39:45.710+0800: 43.985: [GC (Allocation Failure) [PSYoungGen: 293856K->38560K(407040K)] 1300944K->1093384K(8271360K), 0.0321099 secs] [Times: user=0.09 sys=0.04, real=0.03 secs] 2019-06-28T18:39:47.200+0800: 45.474: [GC (Allocation Failure) [PSYoungGen: 321696K->42624K(400384K)] 1376520K->1145088K(8264704K), 0.0295124 secs] [Times: user=0.09 sys=0.03, real=0.03 secs] 2019-06-28T18:39:48.736+0800: 47.011: [GC (Allocation Failure) [PSYoungGen: 325760K->42464K(420352K)] 1428224K->1197776K(8284672K), 0.0282520 secs] [Times: user=0.07 sys=0.04, real=0.03 secs] 2019-06-28T18:39:50.617+0800: 48.892: [GC (Allocation Failure) [PSYoungGen: 352736K->46528K(414208K)] 1508048K->1254696K(8278528K), 0.0351752 secs] [Times: user=0.10 sys=0.04, real=0.03 secs] 2019-06-28T18:39:52.719+0800: 50.994: [GC (Allocation Failure) [PSYoungGen: 356800K->46752K(430080K)] 1564968K->1312616K(8294400K), 0.0382053 secs] [Times: user=0.11 sys=0.04, real=0.04 secs] 2019-06-28T18:39:55.148+0800: 53.423: [GC (Allocation Failure) [PSYoungGen: 378016K->49408K(425472K)] 1643880K->1373280K(8289792K), 0.0386258 secs] [Times: user=0.11 sys=0.04, real=0.04 secs] 2019-06-28T18:39:56.822+0800: 55.097: [GC (Allocation Failure) [PSYoungGen: 380672K->49760K(436224K)] 1704544K->1435552K(8300544K), 0.0407393 secs] [Times: user=0.10 sys=0.04, real=0.04 secs] 2019-06-28T18:39:58.651+0800: 56.926: [GC (Allocation Failure) [PSYoungGen: 394848K->51808K(433152K)] 1780640K->1499440K(8297472K), 0.0431373 secs] [Times: user=0.10 sys=0.04, real=0.05 secs] 2019-06-28T18:40:00.235+0800: 58.510: [GC (Allocation Failure) [PSYoungGen: 396896K->51744K(439808K)] 1844528K->1563768K(8304128K), 0.0396774 secs] [Times: user=0.10 sys=0.05, real=0.04 secs] 2019-06-28T18:40:02.994+0800: 61.269: [GC (Allocation Failure) [PSYoungGen: 405024K->52672K(437760K)] 1917048K->1629064K(8302080K), 0.0445259 secs] [Times: user=0.13 sys=0.05, real=0.04 secs] 2019-06-28T18:40:04.788+0800: 63.063: [GC (Allocation Failure) [PSYoungGen: 405952K->52960K(442880K)] 1982344K->1695000K(8307200K), 0.0465839 secs] [Times: user=0.11 sys=0.05, real=0.05 secs] 2019-06-28T18:40:06.718+0800: 64.993: [GC (Allocation Failure) [PSYoungGen: 412896K->53760K(441344K)] 2054936K->1761648K(8305664K), 0.0426515 secs] [Times: user=0.12 sys=0.04, real=0.04 secs] 2019-06-28T18:40:09.503+0800: 67.778: [GC (Allocation Failure) [PSYoungGen: 413696K->53888K(445440K)] 2121584K->1828648K(8309760K), 0.0495876 secs] [Times: user=0.13 sys=0.07, real=0.05 secs] 2019-06-28T18:40:12.283+0800: 70.557: [GC (Allocation Failure) [PSYoungGen: 418944K->61824K(427008K)] 2193704K->1903648K(8291328K), 0.0643526 secs] [Times: user=0.20 sys=0.06, real=0.07 secs] 2019-06-28T18:40:15.031+0800: 73.305: [GC (Allocation Failure) [PSYoungGen: 426880K->54752K(444928K)] 2268704K->1971424K(8309248K), 0.0621974 secs] [Times: user=0.19 sys=0.06, real=0.06 secs] 2019-06-28T18:40:16.822+0800: 75.097: [GC (Allocation Failure) [PSYoungGen: 418784K->54592K(443392K)] 2335456K->2039432K(8307712K), 0.0476391 secs] [Times: user=0.14 sys=0.05, real=0.05 secs] 2019-06-28T18:40:19.055+0800: 77.330: [GC (Allocation Failure) [PSYoungGen: 418624K->54464K(447488K)] 2403464K->2107128K(8311808K), 0.0500992 secs] [Times: user=0.14 sys=0.06, real=0.05 secs] 2019-06-28T18:40:20.987+0800: 79.262: [GC (Allocation Failure) [PSYoungGen: 424128K->55296K(446464K)] 2476792K->2175928K(8310784K), 0.0464451 secs] [Times: user=0.13 sys=0.05, real=0.05 secs] 2019-06-28T18:40:23.315+0800: 81.589: [GC (Allocation Failure) [PSYoungGen: 424960K->55456K(450048K)] 2545592K->2244696K(8314368K), 0.0504747 secs] [Times: user=0.15 sys=0.05, real=0.05 secs] 2019-06-28T18:40:25.385+0800: 83.659: [GC (Allocation Failure) [PSYoungGen: 430240K->56032K(449024K)] 2619480K->2314096K(8313344K), 0.0507339 secs] [Times: user=0.14 sys=0.06, real=0.05 secs] 2019-06-28T18:40:28.209+0800: 86.484: [GC (Allocation Failure) [PSYoungGen: 430816K->55968K(451584K)] 2688880K->2383784K(8315904K), 0.0503815 secs] [Times: user=0.14 sys=0.05, real=0.05 secs] 2019-06-28T18:40:30.084+0800: 88.359: [GC (Allocation Failure) [PSYoungGen: 433824K->56480K(450560K)] 2761640K->2453944K(8314880K), 0.0430315 secs] [Times: user=0.12 sys=0.04, real=0.04 secs] 2019-06-28T18:40:31.793+0800: 90.067: [GC (Allocation Failure) [PSYoungGen: 434336K->56448K(452608K)] 2831800K->2524296K(8316928K), 0.0500244 secs] [Times: user=0.13 sys=0.06, real=0.05 secs] 2019-06-28T18:40:33.516+0800: 91.791: [GC (Allocation Failure) [PSYoungGen: 436864K->56672K(452096K)] 2904712K->2594632K(8316416K), 0.0485193 secs] [Times: user=0.14 sys=0.04, real=0.05 secs] 2019-06-28T18:40:35.269+0800: 93.544: [GC (Allocation Failure) [PSYoungGen: 437088K->57280K(453632K)] 2975048K->2665688K(8317952K), 0.0511686 secs] [Times: user=0.14 sys=0.05, real=0.05 secs] 2019-06-28T18:40:37.042+0800: 95.317: [GC (Allocation Failure) [PSYoungGen: 440256K->57376K(453632K)] 3048664K->2736792K(8317952K), 0.0501898 secs] [Times: user=0.15 sys=0.04, real=0.05 secs] 2019-06-28T18:40:38.919+0800: 97.194: [GC (Allocation Failure) [PSYoungGen: 440352K->57408K(454656K)] 3119768K->2808384K(8318976K), 0.0525431 secs] [Times: user=0.14 sys=0.06, real=0.05 secs] 2019-06-28T18:40:41.732+0800: 100.006: [GC (Allocation Failure) [PSYoungGen: 441920K->57664K(454144K)] 3192896K->2880168K(8318464K), 0.0507531 secs] [Times: user=0.15 sys=0.04, real=0.05 secs] 2019-06-28T18:40:43.865+0800: 102.140: [GC (Allocation Failure) [PSYoungGen: 442176K->57312K(455680K)] 3264680K->2951560K(8320000K), 0.0531695 secs] [Times: user=0.16 sys=0.05, real=0.05 secs] 2019-06-28T18:40:46.700+0800: 104.974: [GC (Allocation Failure) [PSYoungGen: 443872K->57408K(455168K)] 3338120K->3023224K(8319488K), 0.0591342 secs] [Times: user=0.17 sys=0.06, real=0.06 secs] 2019-06-28T18:40:49.123+0800: 107.398: [GC (Allocation Failure) [PSYoungGen: 443968K->57824K(456704K)] 3409784K->3095200K(8321024K), 0.0559448 secs] [Times: user=0.17 sys=0.05, real=0.06 secs] 2019-06-28T18:40:50.981+0800: 109.256: [GC (Allocation Failure) [PSYoungGen: 446432K->58208K(456192K)] 3483808K->3167472K(8320512K), 0.0506522 secs] [Times: user=0.15 sys=0.05, real=0.05 secs] 2019-06-28T18:40:52.948+0800: 111.223: [GC (Allocation Failure) [PSYoungGen: 446816K->58272K(457216K)] 3556080K->3239888K(8321536K), 0.0539854 secs] [Times: user=0.14 sys=0.05, real=0.05 secs] 2019-06-28T18:40:55.249+0800: 113.524: [GC (Allocation Failure) [PSYoungGen: 447904K->58304K(456704K)] 3629520K->3312464K(8321024K), 0.0549437 secs] [Times: user=0.16 sys=0.05, real=0.06 secs] 2019-06-28T18:40:57.639+0800: 115.914: [GC (Allocation Failure) [PSYoungGen: 447936K->57600K(458240K)] 3702096K->3384320K(8322560K), 0.0553431 secs] [Times: user=0.16 sys=0.05, real=0.06 secs] 2019-06-28T18:40:59.628+0800: 117.903: [GC (Allocation Failure) [PSYoungGen: 449280K->58400K(457728K)] 3776000K->3456712K(8322048K), 0.0521124 secs] [Times: user=0.16 sys=0.05, real=0.05 secs] 2019-06-28T18:41:02.143+0800: 120.418: [GC (Allocation Failure) [PSYoungGen: 450080K->58496K(458752K)] 3848392K->3529256K(8323072K), 0.0588060 secs] [Times: user=0.16 sys=0.06, real=0.05 secs] 2019-06-28T18:41:04.073+0800: 122.348: [GC (Allocation Failure) [PSYoungGen: 451200K->58368K(458240K)] 3921960K->3602032K(8322560K), 0.0473972 secs] [Times: user=0.12 sys=0.06, real=0.04 secs] 2019-06-28T18:41:05.837+0800: 124.112: [GC (Allocation Failure) [PSYoungGen: 451072K->58400K(459264K)] 3994736K->3674688K(8323584K), 0.0552726 secs] [Times: user=0.16 sys=0.05, real=0.05 secs] 2019-06-28T18:41:07.604+0800: 125.879: [GC (Allocation Failure) [PSYoungGen: 452128K->58496K(458752K)] 4068416K->3747608K(8323072K), 0.0564095 secs] [Times: user=0.17 sys=0.04, real=0.05 secs] 2019-06-28T18:41:10.444+0800: 128.719: [GC (Allocation Failure) [PSYoungGen: 452224K->58080K(459776K)] 4141336K->3819992K(8324096K), 0.0507885 secs] [Times: user=0.15 sys=0.06, real=0.05 secs] 2019-06-28T18:41:12.509+0800: 130.784: [GC (Allocation Failure) [PSYoungGen: 452832K->59200K(459264K)] 4214744K->3893112K(8323584K), 0.0495178 secs] [Times: user=0.15 sys=0.04, real=0.05 secs] 2019-06-28T18:41:14.304+0800: 132.579: [GC (Allocation Failure) [PSYoungGen: 453952K->59072K(460288K)] 4287864K->3966616K(8324608K), 0.0490897 secs] [Times: user=0.14 sys=0.05, real=0.05 secs] 2019-06-28T18:41:16.118+0800: 134.393: [GC (Allocation Failure) [PSYoungGen: 454848K->59232K(459776K)] 4362392K->4040400K(8324096K), 0.0696319 secs] [Times: user=0.21 sys=0.04, real=0.07 secs] 2019-06-28T18:41:18.639+0800: 136.914: [GC (Allocation Failure) [PSYoungGen: 455008K->59136K(460288K)] 4436176K->4114072K(8324608K), 0.0695425 secs] [Times: user=0.21 sys=0.06, real=0.07 secs] 2019-06-28T18:41:20.746+0800: 139.021: [GC (Allocation Failure) [PSYoungGen: 455424K->59360K(460288K)] 4510360K->4187928K(8324608K), 0.0566070 secs] [Times: user=0.17 sys=0.05, real=0.05 secs] 2019-06-28T18:41:23.884+0800: 142.159: [GC (Allocation Failure) [PSYoungGen: 455648K->59232K(460288K)] 4584216K->4261640K(8324608K), 0.0608947 secs] [Times: user=0.18 sys=0.06, real=0.06 secs] 2019-06-28T18:41:26.512+0800: 144.787: [GC (Allocation Failure) [PSYoungGen: 455520K->59264K(460288K)] 4657928K->4335328K(8324608K), 0.0635067 secs] [Times: user=0.19 sys=0.05, real=0.07 secs] 2019-06-28T18:41:28.420+0800: 146.695: [GC (Allocation Failure) [PSYoungGen: 455552K->59232K(460800K)] 4731616K->4409112K(8325120K), 0.0510466 secs] [Times: user=0.14 sys=0.05, real=0.05 secs] 2019-06-28T18:41:30.688+0800: 148.963: [GC (Allocation Failure) [PSYoungGen: 456544K->59296K(460800K)] 4806424K->4482792K(8325120K), 0.0612692 secs] [Times: user=0.18 sys=0.05, real=0.06 secs] 2019-06-28T18:41:32.961+0800: 151.235: [GC (Allocation Failure) [PSYoungGen: 456608K->59168K(461312K)] 4880104K->4556424K(8325632K), 0.0552887 secs] [Times: user=0.16 sys=0.06, real=0.06 secs] 2019-06-28T18:41:35.382+0800: 153.656: [GC (Allocation Failure) [PSYoungGen: 456992K->59360K(460800K)] 4954248K->4630248K(8325120K), 0.0674113 secs] [Times: user=0.20 sys=0.05, real=0.07 secs] 2019-06-28T18:41:37.689+0800: 155.964: [GC (Allocation Failure) [PSYoungGen: 457184K->59360K(461312K)] 5028072K->4704472K(8325632K), 0.0633608 secs] [Times: user=0.18 sys=0.07, real=0.06 secs] 2019-06-28T18:41:39.948+0800: 158.223: [GC (Allocation Failure) [PSYoungGen: 457696K->58240K(461312K)] 5102808K->4777272K(8325632K), 0.0718478 secs] [Times: user=0.20 sys=0.08, real=0.07 secs] 2019-06-28T18:41:42.521+0800: 160.796: [GC (Allocation Failure) [PSYoungGen: 456576K->59424K(461824K)] 5175608K->4851024K(8326144K), 0.0638641 secs] [Times: user=0.19 sys=0.07, real=0.07 secs] 2019-06-28T18:41:45.967+0800: 164.242: [GC (Allocation Failure) [PSYoungGen: 458784K->56992K(461824K)] 5250384K->4938800K(8326144K), 0.1276870 secs] [Times: user=0.42 sys=0.07, real=0.13 secs] 2019-06-28T18:41:48.177+0800: 166.451: [GC (Allocation Failure) [PSYoungGen: 456352K->59712K(461824K)] 5338160K->5012088K(8326144K), 0.0647845 secs] [Times: user=0.19 sys=0.06, real=0.06 secs] 2019-06-28T18:41:50.651+0800: 168.926: [GC (Allocation Failure) [PSYoungGen: 459072K->59616K(461824K)] 5411448K->5086480K(8326144K), 0.0734278 secs] [Times: user=0.23 sys=0.05, real=0.08 secs] 2019-06-28T18:41:53.617+0800: 171.892: [GC (Allocation Failure) [PSYoungGen: 458976K->59392K(461824K)] 5485840K->5160400K(8326144K), 0.0702969 secs] [Times: user=0.23 sys=0.05, real=0.07 secs] 2019-06-28T18:41:56.697+0800: 174.972: [GC (Allocation Failure) [PSYoungGen: 458752K->59616K(461824K)] 5559760K->5234672K(8326144K), 0.0711115 secs] [Times: user=0.21 sys=0.07, real=0.07 secs] 2019-06-28T18:41:59.257+0800: 177.532: [GC (Allocation Failure) [PSYoungGen: 458976K->59552K(462336K)] 5634032K->5308504K(8326656K), 0.0676520 secs] [Times: user=0.22 sys=0.04, real=0.07 secs] 2019-06-28T18:42:02.355+0800: 180.630: [GC (Allocation Failure) [PSYoungGen: 459424K->59360K(461824K)] 5708376K->5382160K(8326144K), 0.0708176 secs] [Times: user=0.21 sys=0.06, real=0.07 secs] 2019-06-28T18:42:04.427+0800: 182.702: [GC (Allocation Failure) [PSYoungGen: 459232K->59328K(462336K)] 5782032K->5456248K(8326656K), 0.0672371 secs] [Times: user=0.21 sys=0.05, real=0.07 secs] 2019-06-28T18:42:07.588+0800: 185.862: [GC (Allocation Failure) [PSYoungGen: 459712K->60224K(462336K)] 5856632K->5530824K(8326656K), 0.0748176 secs] [Times: user=0.23 sys=0.07, real=0.07 secs] 2019-06-28T18:42:10.611+0800: 188.886: [GC (Allocation Failure) [PSYoungGen: 460608K->59904K(462336K)] 5931208K->5605152K(8326656K), 0.0715404 secs] [Times: user=0.20 sys=0.06, real=0.07 secs] 2019-06-28T18:42:13.159+0800: 191.434: [GC (Allocation Failure) [PSYoungGen: 460288K->59776K(462336K)] 6005536K->5679760K(8326656K), 0.0798284 secs] [Times: user=0.22 sys=0.05, real=0.08 secs] 2019-06-28T18:42:15.672+0800: 193.947: [GC (Allocation Failure) [PSYoungGen: 460160K->59936K(462336K)] 6080144K->5754736K(8326656K), 0.0722845 secs] [Times: user=0.22 sys=0.05, real=0.08 secs] 2019-06-28T18:42:18.183+0800: 196.458: [GC (Allocation Failure) [PSYoungGen: 460320K->59936K(462336K)] 6155120K->5829384K(8326656K), 0.0771282 secs] [Times: user=0.25 sys=0.06, real=0.07 secs] 2019-06-28T18:42:20.657+0800: 198.932: [GC (Allocation Failure) [PSYoungGen: 460320K->60000K(462336K)] 6229768K->5904168K(8326656K), 0.0932153 secs] [Times: user=0.27 sys=0.05, real=0.09 secs] 2019-06-28T18:42:22.637+0800: 200.912: [GC (Allocation Failure) [PSYoungGen: 460384K->59840K(462336K)] 6304552K->5978576K(8326656K), 0.0680531 secs] [Times: user=0.21 sys=0.05, real=0.07 secs] 2019-06-28T18:42:24.471+0800: 202.746: [GC (Allocation Failure) [PSYoungGen: 460224K->60000K(462336K)] 6378960K->6053232K(8326656K), 0.0721660 secs] [Times: user=0.23 sys=0.05, real=0.07 secs] 2019-06-28T18:42:26.323+0800: 204.598: [GC (Allocation Failure) [PSYoungGen: 460384K->59904K(462336K)] 6453616K->6127712K(8326656K), 0.0719512 secs] [Times: user=0.22 sys=0.05, real=0.08 secs] 2019-06-28T18:42:28.856+0800: 207.131: [GC (Allocation Failure) [PSYoungGen: 460288K->59744K(462848K)] 6528096K->6202224K(8327168K), 0.0745775 secs] [Times: user=0.23 sys=0.07, real=0.07 secs] 2019-06-28T18:42:30.973+0800: 209.248: [GC (Allocation Failure) [PSYoungGen: 460640K->59872K(462336K)] 6603120K->6276800K(8326656K), 0.0756466 secs] [Times: user=0.25 sys=0.05, real=0.08 secs] 2019-06-28T18:42:33.763+0800: 212.038: [GC (Allocation Failure) [PSYoungGen: 460768K->60064K(462848K)] 6677696K->6351400K(8327168K), 0.0763387 secs] [Times: user=0.24 sys=0.05, real=0.08 secs] 2019-06-28T18:42:35.736+0800: 214.010: [GC (Allocation Failure) [PSYoungGen: 461472K->59616K(462848K)] 6752808K->6425744K(8327168K), 0.0743335 secs] [Times: user=0.22 sys=0.07, real=0.07 secs] 2019-06-28T18:42:37.570+0800: 215.844: [GC (Allocation Failure) [PSYoungGen: 461024K->60000K(462848K)] 6827152K->6500704K(8327168K), 0.0728785 secs] [Times: user=0.24 sys=0.05, real=0.07 secs] 2019-06-28T18:42:39.399+0800: 217.674: [GC (Allocation Failure) [PSYoungGen: 461408K->59872K(462848K)] 6902112K->6575080K(8327168K), 0.0739772 secs] [Times: user=0.23 sys=0.07, real=0.08 secs] 2019-06-28T18:42:41.334+0800: 219.609: [GC (Allocation Failure) [PSYoungGen: 461280K->60032K(462848K)] 6976488K->6649600K(8327168K), 0.0722555 secs] [Times: user=0.22 sys=0.07, real=0.07 secs] 2019-06-28T18:42:43.869+0800: 222.144: [GC (Allocation Failure) [PSYoungGen: 461440K->60096K(462848K)] 7051008K->6724152K(8327168K), 0.1143241 secs] [Times: user=0.34 sys=0.06, real=0.12 secs] 2019-06-28T18:42:47.322+0800: 225.597: [GC (Allocation Failure) [PSYoungGen: 461504K->59968K(462848K)] 7125560K->6798952K(8327168K), 0.0859688 secs] [Times: user=0.25 sys=0.06, real=0.09 secs] 2019-06-28T18:42:50.283+0800: 228.558: [GC (Allocation Failure) [PSYoungGen: 461376K->59840K(462848K)] 7200360K->6873600K(8327168K), 0.0948162 secs] [Times: user=0.25 sys=0.08, real=0.09 secs] 2019-06-28T18:42:52.531+0800: 230.805: [GC (Allocation Failure) [PSYoungGen: 461248K->59968K(463360K)] 7275008K->6948264K(8327680K), 0.1170745 secs] [Times: user=0.33 sys=0.07, real=0.12 secs] 2019-06-28T18:42:56.421+0800: 234.696: [GC (Allocation Failure) [PSYoungGen: 462400K->59968K(463360K)] 7350696K->7022856K(8327680K), 0.1483456 secs] [Times: user=0.38 sys=0.12, real=0.15 secs] 2019-06-28T18:42:58.677+0800: 236.952: [GC (Allocation Failure) [PSYoungGen: 462400K->59616K(463360K)] 7425288K->7097072K(8327680K), 0.1252026 secs] [Times: user=0.35 sys=0.08, real=0.12 secs]

When the program exits, it does report an OutOfMemoryError error.

mbaight@foxmail.com

From: 吴晟 Wu Sheng Date: 2019-06-29 13:45 To: apache/skywalking CC: zeroall; Mention Subject: Re: [apache/skywalking] OutOfMemoryError by com.google.common.reflect.ClassPath.from (#2969) @zeroall Have you increased the perm size or metadata size? Look like OOM from nonheap memory. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

wu-sheng commented 5 years ago

Could you try to upgrade the Guava version? Maybe v28.0? I don't know why it causes so many memory.

zeroall commented 5 years ago

I tried guava-27.0.1-jre and guava-28.0-jre, and the results were the same.

mbaight@foxmail.com

From: 吴晟 Wu Sheng Date: 2019-06-29 14:02 To: apache/skywalking CC: zeroall; Mention Subject: Re: [apache/skywalking] OutOfMemoryError by com.google.common.reflect.ClassPath.from (#2969) Could you try to upgrade the Guava version? Maybe v28.0? I don't know why it causes so many memory. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

zeroall commented 5 years ago

I tried guava-27.0.1-jre and guava-28.0-jre, and the results were the same.

wu-sheng commented 5 years ago

Could you submit an issue to Guava project? And link here? We are simply using their scan API, as you can see from codes, but this comes out.

zeroall commented 5 years ago

OK, I'll submit an issue to Guava project. Thank you for your patience.

mbaight@foxmail.com

From: 吴晟 Wu Sheng Date: 2019-06-29 14:30 To: apache/skywalking CC: zeroall; Mention Subject: Re: [apache/skywalking] OutOfMemoryError by com.google.common.reflect.ClassPath.from (#2969) Could you submit an issue to Guava project? And link here? We are simply using their scan API, as you can see from codes, but this comes out. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

zeroall commented 5 years ago

The reason for the problem was found. I scanned the entry of the scanDirectory of the ClassPath class with Arthas and found that it scanned the skywalking-ui directory, which contained a large number of nodeJS packages. ClassPath was too busy to work, so it caused OOM.

I'm sorry for the problem caused by the inadvertent introduction of redundant documents.

Before the problem arises, the directory structure is as follows:

drwxr-xr-x. 10 root root 170 6月 29 16:59 . drwxr-xr-x. 14 root root 162 6月 29 16:58 .. drwxr-xr-x. 8 root root 135 6月 29 16:04 agent drwxr-xr-x. 2 root root 121 6月 29 16:04 bin drwxr-xr-x. 2 root root 175 6月 29 16:04 config -rw-r--r--. 1 root root 27K 6月 29 16:04 LICENSE drwxr-xr-x. 3 root root 4.0K 6月 29 16:04 licenses drwxr-xr-x. 2 root root 21 6月 29 16:04 logs -rw-r--r--. 1 root root 29K 6月 29 16:04 NOTICE drwxr-xr-x. 2 root root 8.0K 6月 29 16:49 oap-libs -rw-r--r--. 1 root root 2.0K 6月 29 16:04 README.txt drwxr-xr-x. 7 root root 4.0K 6月 29 16:05 skywalking-ui drwxr-xr-x. 2 root root 53 6月 29 16:05 webapp

The skywalking-ui directory contains the following files:

-rw-r--r--. 1 root root 858 6月 29 16:05 babel.config.js -rw-r--r--. 1 root root 33 6月 29 16:05 .browserslistrc drwxr-xr-x. 5 root root 75 6月 29 16:04 dist -rw-r--r--. 1 root root 1.4K 6月 29 16:05 Dockerfile -rw-r--r--. 1 root root 1.3K 6月 29 16:05 Dockerfile-ci -rw-r--r--. 1 root root 4.4K 6月 29 16:05 gulpfile.js -rw-r--r--. 1 root root 12K 6月 29 16:05 LICENSE -rw-r--r--. 1 root root 2.3K 6月 29 16:05 nginx.conf drwxr-xr-x. 4 root root 53 6月 29 16:04 node drwxr-xr-x. 1137 root root 80K 6月 29 16:05 node_modules -rw-r--r--. 1 root root 1.1K 6月 29 16:05 package.json -rw-r--r--. 1 root root 388K 6月 29 16:05 package-lock.json -rw-r--r--. 1 root root 864 6月 29 16:05 postcss.config.js drwxr-xr-x. 2 root root 43 6月 29 16:05 public -rw-r--r--. 1 root root 2.0K 6月 29 16:05 README.md -rw-r--r--. 1 root root 1.6K 6月 29 16:05 run.sh drwxr-xr-x. 8 root root 199 6月 29 16:05 src -rw-r--r--. 1 root root 1.5K 6月 29 16:05 tsconfig.json -rw-r--r--. 1 root root 1.2K 6月 29 16:05 tslint.json -rw-r--r--. 1 root root 1.3K 6月 29 16:05 vue.config.js

This is a summary of some information printed by Arthas:

ts=2019-06-29 17:04:36; [cost=0.56186ms] result=@Object[][ @File[/usr/local/skywalking/skywalking-ui/nodemodules/@babel_types@7.4.4@@babel/types/lib/constants], @AppClassLoader[sun.misc.Launcher$AppClassLoader@4d7e1886], @String[skywalking-ui/node_modules/@vue/babel-preset-app/node_modules/@babel/plugin-syntax-jsx/node_modules/@babel/core/node_modules/@babel/helpers/node_modules/@babel/traverse/node_modules/@babel/helper-function-name/node_modules/@babel/template/node_modules/@babel/types/lib/constants/], @HashSet[isEmpty=false;size=28], ] ts=2019-06-29 17:04:36; [cost=0.127028ms] result=@Object[][ @File[/usr/local/skywalking/skywalking-ui/nodemodules/@babel_types@7.4.4@@babel/types/lib/converters], @AppClassLoader[sun.misc.Launcher$AppClassLoader@4d7e1886], @String[skywalking-ui/node_modules/@vue/babel-preset-app/node_modules/@babel/plugin-syntax-jsx/node_modules/@babel/core/node_modules/@babel/helpers/node_modules/@babel/traverse/node_modules/@babel/helper-function-name/node_modules/@babel/template/node_modules/@babel/types/lib/converters/], @HashSet[isEmpty=false;size=28], ] ts=2019-06-29 17:04:36; [cost=0.129942ms] result=@Object[][ @File[/usr/local/skywalking/skywalking-ui/nodemodules/@babel_types@7.4.4@@babel/types/lib/definitions], @AppClassLoader[sun.misc.Launcher$AppClassLoader@4d7e1886], @String[skywalking-ui/node_modules/@vue/babel-preset-app/node_modules/@babel/plugin-syntax-jsx/node_modules/@babel/core/node_modules/@babel/helpers/node_modules/@babel/traverse/node_modules/@babel/helper-function-name/node_modules/@babel/template/node_modules/@babel/types/lib/definitions/], @HashSet[isEmpty=false;size=28], ] ts=2019-06-29 17:04:36; [cost=0.09251ms] result=@Object[][ @File[/usr/local/skywalking/skywalking-ui/nodemodules/@babel_types@7.4.4@@babel/types/lib/modifications/flow], @AppClassLoader[sun.misc.Launcher$AppClassLoader@4d7e1886], @String[skywalking-ui/node_modules/@vue/babel-preset-app/node_modules/@babel/plugin-syntax-jsx/node_modules/@babel/core/node_modules/@babel/helpers/node_modules/@babel/traverse/node_modules/@babel/helper-function-name/node_modules/@babel/template/node_modules/@babel/types/lib/modifications/flow/], @HashSet[isEmpty=false;size=29], ]

wu-sheng commented 5 years ago

Why web ui added to oap classpath? Do you change some scripts?

zeroall commented 5 years ago

I added some print commands to the startup script, as follows：

...... echo "befor import libs CLASSPATH: $CLASSPATH"

CLASSPATH="$OAP_HOME/config:$CLASSPATH" for i in "$OAP_HOME"/oap-libs/*.jar do CLASSPATH="$i:$CLASSPATH" done ......

The following results are obtained： $ ./oapService.sh befor import libs CLASSPATH: .:/opt/java/lib/dt.jar:/opt/java/lib/tools.jar

Maybe the CLASSPATH environment variable already contains the current directory？

mbaight@foxmail.com

From: 吴晟 Wu Sheng Date: 2019-06-29 17:58 To: apache/skywalking CC: zeroall; State change Subject: Re: [apache/skywalking] OutOfMemoryError by com.google.common.reflect.ClassPath.from (#2969) Why web ui added to oap classpath? Do you change some scripts? — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub, or mute the thread.

wu-sheng commented 5 years ago

.:/opt/java/lib/dt.jar:/opt/java/lib/tools.jar

There are the expected jars for JVM. Please check the jar imported in for loop, to check whether there is any not from /lib folder

zeroall commented 5 years ago

$ bin/oapService.sh befor import libs CLASSPATH:.:/opt/java/lib/dt.jar:/opt/java/lib/tools.jar

after import libs CLASSPATH: /usr/local/skywalking/oap-libs/zookeeper-3.4.10.jar /usr/local/skywalking/oap-libs/zipkin-receiver-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/zipkin-2.9.1.jar /usr/local/skywalking/oap-libs/telemetry-prometheus-6.1.0.jar /usr/local/skywalking/oap-libs/telemetry-api-6.1.0.jar /usr/local/skywalking/oap-libs/t-digest-3.2.jar /usr/local/skywalking/oap-libs/swagger-annotations-1.5.12.jar /usr/local/skywalking/oap-libs/storage-zipkin-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/storage-jdbc-hikaricp-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/storage-jaeger-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/storage-elasticsearch-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/snakeyaml-1.18.jar /usr/local/skywalking/oap-libs/slf4j-api-1.7.25.jar /usr/local/skywalking/oap-libs/skywalking-trace-receiver-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/skywalking-sharing-server-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/skywalking-register-receiver-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/skywalking-mesh-receiver-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/skywalking-jvm-receiver-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/skywalking-clr-receiver-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/simpleclient_httpserver-0.6.0.jar /usr/local/skywalking/oap-libs/simpleclient_hotspot-0.6.0.jar /usr/local/skywalking/oap-libs/simpleclient_common-0.6.0.jar /usr/local/skywalking/oap-libs/simpleclient-0.6.0.jar /usr/local/skywalking/oap-libs/sharding-jdbc-core-2.0.3.jar /usr/local/skywalking/oap-libs/server-starter-6.1.0.jar /usr/local/skywalking/oap-libs/server-core-6.1.0.jar /usr/local/skywalking/oap-libs/server-alarm-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/retrofit-2.3.0.jar /usr/local/skywalking/oap-libs/reflectasm-1.11.7.jar /usr/local/skywalking/oap-libs/receiver-proto-6.1.0.jar /usr/local/skywalking/oap-libs/reactive-streams-1.0.2.jar /usr/local/skywalking/oap-libs/rank-eval-client-6.3.2.jar /usr/local/skywalking/oap-libs/query-graphql-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/proto-google-common-protos-1.0.0.jar /usr/local/skywalking/oap-libs/protobuf-java-3.4.0.jar /usr/local/skywalking/oap-libs/parent-join-client-6.3.2.jar /usr/local/skywalking/oap-libs/opencensus-contrib-grpc-metrics-0.12.3.jar /usr/local/skywalking/oap-libs/opencensus-api-0.12.3.jar /usr/local/skywalking/oap-libs/okio-1.13.0.jar /usr/local/skywalking/oap-libs/okhttp-ws-2.7.5.jar /usr/local/skywalking/oap-libs/okhttp-3.9.0.jar /usr/local/skywalking/oap-libs/okhttp-2.7.5.jar /usr/local/skywalking/oap-libs/netty-transport-4.1.27.Final.jar /usr/local/skywalking/oap-libs/netty-tcnative-boringssl-static-2.0.7.Final.jar /usr/local/skywalking/oap-libs/netty-resolver-4.1.27.Final.jar /usr/local/skywalking/oap-libs/netty-handler-proxy-4.1.27.Final.jar /usr/local/skywalking/oap-libs/netty-handler-4.1.27.Final.jar /usr/local/skywalking/oap-libs/netty-common-4.1.27.Final.jar /usr/local/skywalking/oap-libs/netty-codec-socks-4.1.27.Final.jar /usr/local/skywalking/oap-libs/netty-codec-http-4.1.27.Final.jar /usr/local/skywalking/oap-libs/netty-codec-http2-4.1.27.Final.jar /usr/local/skywalking/oap-libs/netty-codec-4.1.27.Final.jar /usr/local/skywalking/oap-libs/netty-buffer-4.1.27.Final.jar /usr/local/skywalking/oap-libs/netty-3.10.5.Final.jar /usr/local/skywalking/oap-libs/mysql-connector-java-5.1.47.jar /usr/local/skywalking/oap-libs/lucene-suggest-7.3.1.jar /usr/local/skywalking/oap-libs/lucene-spatial-extras-7.3.1.jar /usr/local/skywalking/oap-libs/lucene-spatial-7.3.1.jar /usr/local/skywalking/oap-libs/lucene-spatial3d-7.3.1.jar /usr/local/skywalking/oap-libs/lucene-sandbox-7.3.1.jar /usr/local/skywalking/oap-libs/lucene-queryparser-7.3.1.jar /usr/local/skywalking/oap-libs/lucene-queries-7.3.1.jar /usr/local/skywalking/oap-libs/lucene-misc-7.3.1.jar /usr/local/skywalking/oap-libs/lucene-memory-7.3.1.jar /usr/local/skywalking/oap-libs/lucene-join-7.3.1.jar /usr/local/skywalking/oap-libs/lucene-highlighter-7.3.1.jar /usr/local/skywalking/oap-libs/lucene-grouping-7.3.1.jar /usr/local/skywalking/oap-libs/lucene-core-7.3.1.jar /usr/local/skywalking/oap-libs/lucene-backward-codecs-7.3.1.jar /usr/local/skywalking/oap-libs/lucene-analyzers-common-7.3.1.jar /usr/local/skywalking/oap-libs/logging-interceptor-2.7.5.jar /usr/local/skywalking/oap-libs/log4j-slf4j-impl-2.9.0.jar /usr/local/skywalking/oap-libs/log4j-over-slf4j-1.7.25.jar /usr/local/skywalking/oap-libs/log4j-core-2.9.0.jar /usr/local/skywalking/oap-libs/log4j-api-2.9.0.jar /usr/local/skywalking/oap-libs/log4j-1.2.16.jar /usr/local/skywalking/oap-libs/library-util-6.1.0.jar /usr/local/skywalking/oap-libs/library-server-6.1.0.jar /usr/local/skywalking/oap-libs/library-module-6.1.0.jar /usr/local/skywalking/oap-libs/library-client-6.1.0.jar /usr/local/skywalking/oap-libs/library-buffer-6.1.0.jar /usr/local/skywalking/oap-libs/kotlin-stdlib-1.1.60.jar /usr/local/skywalking/oap-libs/kotlin-reflect-1.1.1.jar /usr/local/skywalking/oap-libs/jsr305-1.3.9.jar /usr/local/skywalking/oap-libs/jopt-simple-4.6.jar /usr/local/skywalking/oap-libs/joda-time-2.9.9.jar /usr/local/skywalking/oap-libs/jna-4.5.1.jar /usr/local/skywalking/oap-libs/jline-0.9.94.jar /usr/local/skywalking/oap-libs/jetty-util-9.4.2.v20170220.jar /usr/local/skywalking/oap-libs/jetty-servlet-9.4.2.v20170220.jar /usr/local/skywalking/oap-libs/jetty-server-9.4.2.v20170220.jar /usr/local/skywalking/oap-libs/jetty-security-9.4.2.v20170220.jar /usr/local/skywalking/oap-libs/jetty-io-9.4.2.v20170220.jar /usr/local/skywalking/oap-libs/jetty-http-9.4.2.v20170220.jar /usr/local/skywalking/oap-libs/jcl-over-slf4j-1.7.25.jar /usr/local/skywalking/oap-libs/javax.servlet-api-3.1.0.jar /usr/local/skywalking/oap-libs/java-dataloader-2.0.2.jar /usr/local/skywalking/oap-libs/jaeger-receiver-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/jackson-module-kotlin-2.8.8.jar /usr/local/skywalking/oap-libs/jackson-mapper-asl-1.9.13.jar /usr/local/skywalking/oap-libs/jackson-datatype-jdk8-2.9.5.jar /usr/local/skywalking/oap-libs/jackson-datatype-guava-2.9.5.jar /usr/local/skywalking/oap-libs/jackson-dataformat-yaml-2.8.10.jar /usr/local/skywalking/oap-libs/jackson-dataformat-smile-2.8.10.jar /usr/local/skywalking/oap-libs/jackson-dataformat-cbor-2.8.10.jar /usr/local/skywalking/oap-libs/jackson-databind-2.9.5.jar /usr/local/skywalking/oap-libs/jackson-core-asl-1.9.13.jar /usr/local/skywalking/oap-libs/jackson-core-2.9.5.jar /usr/local/skywalking/oap-libs/jackson-annotations-2.9.5.jar /usr/local/skywalking/oap-libs/httpcore-nio-4.4.5.jar /usr/local/skywalking/oap-libs/httpcore-4.4.5.jar /usr/local/skywalking/oap-libs/httpclient-4.5.2.jar /usr/local/skywalking/oap-libs/httpasyncclient-4.1.2.jar /usr/local/skywalking/oap-libs/hppc-0.7.1.jar /usr/local/skywalking/oap-libs/HikariCP-3.1.0.jar /usr/local/skywalking/oap-libs/HdrHistogram-2.1.9.jar /usr/local/skywalking/oap-libs/guava-27.0.1-jre.jar /usr/local/skywalking/oap-libs/gson-2.8.1.jar /usr/local/skywalking/oap-libs/grpc-stub-1.15.1.jar /usr/local/skywalking/oap-libs/grpc-protobuf-lite-1.15.1.jar /usr/local/skywalking/oap-libs/grpc-protobuf-1.15.1.jar /usr/local/skywalking/oap-libs/grpc-netty-1.15.1.jar /usr/local/skywalking/oap-libs/grpc-core-1.15.1.jar /usr/local/skywalking/oap-libs/grpc-context-1.15.1.jar /usr/local/skywalking/oap-libs/groovy-2.4.5-indy.jar /usr/local/skywalking/oap-libs/graphql-java-tools-5.2.3.jar /usr/local/skywalking/oap-libs/graphql-java-8.0.jar /usr/local/skywalking/oap-libs/generated-analysis-6.1.0.jar /usr/local/skywalking/oap-libs/exporter-6.1.0.jar /usr/local/skywalking/oap-libs/error_prone_annotations-2.2.0.jar /usr/local/skywalking/oap-libs/envoy-metrics-receiver-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/elasticsearch-x-content-6.3.2.jar /usr/local/skywalking/oap-libs/elasticsearch-secure-sm-6.3.2.jar /usr/local/skywalking/oap-libs/elasticsearch-rest-high-level-client-6.3.2.jar /usr/local/skywalking/oap-libs/elasticsearch-rest-client-6.3.2.jar /usr/local/skywalking/oap-libs/elasticsearch-core-6.3.2.jar /usr/local/skywalking/oap-libs/elasticsearch-cli-6.3.2.jar /usr/local/skywalking/oap-libs/elasticsearch-6.3.2.jar /usr/local/skywalking/oap-libs/curator-x-discovery-4.0.1.jar /usr/local/skywalking/oap-libs/curator-recipes-4.0.1.jar /usr/local/skywalking/oap-libs/curator-framework-4.0.1.jar /usr/local/skywalking/oap-libs/curator-client-4.0.1.jar /usr/local/skywalking/oap-libs/converter-jackson-2.3.0.jar /usr/local/skywalking/oap-libs/consul-client-1.2.6.jar /usr/local/skywalking/oap-libs/commons-pool-1.5.4.jar /usr/local/skywalking/oap-libs/commons-lang3-3.7.jar /usr/local/skywalking/oap-libs/commons-io-2.6.jar /usr/local/skywalking/oap-libs/commons-dbcp-1.4.jar /usr/local/skywalking/oap-libs/commons-codec-1.11.jar /usr/local/skywalking/oap-libs/cluster-zookeeper-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/cluster-standalone-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/cluster-kubernetes-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/cluster-consul-plugin-6.1.0.jar /usr/local/skywalking/oap-libs/client-java-proto-2.0.0.jar /usr/local/skywalking/oap-libs/client-java-api-2.0.0.jar /usr/local/skywalking/oap-libs/client-java-2.0.0.jar /usr/local/skywalking/oap-libs/caffeine-2.6.2.jar /usr/local/skywalking/oap-libs/bcprov-jdk15on-1.59.jar /usr/local/skywalking/oap-libs/bcprov-ext-jdk15on-1.59.jar /usr/local/skywalking/oap-libs/bcpkix-jdk15on-1.59.jar /usr/local/skywalking/oap-libs/apm-util-6.1.0.jar /usr/local/skywalking/oap-libs/apm-network-6.1.0.jar /usr/local/skywalking/oap-libs/apm-datacarrier-6.1.0.jar /usr/local/skywalking/oap-libs/antlr4-runtime-4.7.1.jar /usr/local/skywalking/oap-libs/annotations-13.0.jar /usr/local/skywalking/oap-libs/animal-sniffer-annotations-1.17.jar /usr/local/skywalking/oap-libs/aggs-matrix-stats-client-6.3.2.jar /usr/local/skywalking/config . /opt/java/lib/dt.jar /opt/java/lib/tools.jar

This is the detailed print result in the back. There is an extra "." in it. It's convenient for me to put skywalking-ui in the current directory, so I scanned too many files, which led to OOM.

mbaight@foxmail.com

From: 吴晟 Wu Sheng Date: 2019-07-01 09:31 To: apache/skywalking CC: zeroall; State change Subject: Re: [apache/skywalking] OutOfMemoryError by com.google.common.reflect.ClassPath.from (#2969) .:/opt/java/lib/dt.jar:/opt/java/lib/tools.jar There are the expected jars for JVM. Please check the jar imported in for loop, to check whether there is any not from /lib folder — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub, or mute the thread.

wu-sheng commented 5 years ago

You have moved the webaap.jar?

zeroall commented 5 years ago

No, I haven't started deploying webapp yet.

------------------ 原始邮件 ------------------ 发件人: "吴晟 Wu Sheng"notifications@github.com; 发送时间: 2019年7月1日(星期一) 上午9:43 收件人: "apache/skywalking"skywalking@noreply.github.com; 抄送: "mbaight"mbaight@foxmail.com;"State change"state_change@noreply.github.com; 主题: Re: [apache/skywalking] OutOfMemoryError bycom.google.common.reflect.ClassPath.from (#2969)

You have moved the webaap.jar?

— You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub, or mute the thread.

wu-sheng commented 5 years ago

webapp.jar is not in root folder.

zeroall commented 5 years ago

But I also put the webapp directory in the current directory. I will remove it. Thank you for your reminder.

mbaight@foxmail.com

From: 吴晟 Wu Sheng Date: 2019-07-01 09:43 To: apache/skywalking CC: zeroall; State change Subject: Re: [apache/skywalking] OutOfMemoryError by com.google.common.reflect.ClassPath.from (#2969) You have moved the webaap.jar? — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub, or mute the thread.

zeroall commented 5 years ago

root @ centos06 in /usr/local/skywalking [9:47:39]

$ l 总用量 132K drwxrwxr-x. 9 1001 1002 167 7月 1 09:25 . drwxr-xr-x. 15 root root 183 6月 29 17:07 .. drwxrwxr-x. 8 1001 1002 135 4月 30 17:00 agent drwxr-xr-x. 2 root root 241 5月 31 17:37 bin drwxr-xr-x. 2 root root 175 5月 31 17:37 config -rw-rw-r--. 1 1001 1002 27K 4月 30 16:48 LICENSE drwxrwxr-x. 3 1001 1002 4.0K 5月 31 17:37 licenses drwxr-xr-x. 2 root root 21 6月 28 16:56 logs -rw-rw-r--. 1 1001 1002 29K 4月 30 16:48 NOTICE drwxrwxr-x. 2 1001 1002 12K 6月 29 14:04 oap-libs -rw-rw-r--. 1 1001 1002 2.0K 4月 30 16:48 README.txt -rw-r--r--. 1 root root 47K 6月 29 10:00 sysctl.txt drwxr-xr-x. 2 root root 53 5月 31 17:37 webapp

The current directory structure is like this.

mbaight@foxmail.com

From: 吴晟 Wu Sheng Date: 2019-07-01 09:49 To: apache/skywalking CC: zeroall; State change Subject: Re: [apache/skywalking] OutOfMemoryError by com.google.common.reflect.ClassPath.from (#2969) webapp.jar is not in root folder. — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub, or mute the thread.

wu-sheng commented 5 years ago

webapp folder is not the issue, the jar is.

zeroall commented 5 years ago

OKay.

mbaight@foxmail.com

From: 吴晟 Wu Sheng Date: 2019-07-01 17:01 To: apache/skywalking CC: zeroall; State change Subject: Re: [apache/skywalking] OutOfMemoryError by com.google.common.reflect.ClassPath.from (#2969) webapp folder is not the issue, the jar is. — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub, or mute the thread.

apache / skywalking

OutOfMemoryError by com.google.common.reflect.ClassPath.from #2969

Question

Bug

Requirement or improvement

RUNTIME

CLASS-LOADING

COMPILATION

GARBAGE-COLLECTORS

MEMORY-MANAGERS

MEMORY

OPERATING-SYSTEM

THREAD

FILE-DESCRIPTOR

root @ centos0 in ~/data/skywalking/apache-skywalking-apm-bin/oap-libs [13:10:10]

root @ centos06 in /usr/local/skywalking [9:47:39]