search

kdlucas / byte-unixbench

Automatically exported from code.google.com/p/byte-unixbench
GNU General Public License v2.0
1.27k stars 323 forks source link

ValueError: NUMA Node(s) could not be found in lscpu value #47

Closed zilingliyu closed 7 years ago

zilingliyu commented 7 years ago

Hello everyone： I use unixbench to test a Ubuntu14.04 host, an error 'ValueError: NUMA Node (s) could not be found in lscpu value:'

[root@localhost PerfKitBenchmarker-1.13.0]# ./pkb.py --benchmarks=unixbench --benchmark_config_file=unixbench2u2g.yaml 2017-11-14 21:54:22,560 4658428b MainThread INFO Verbose logging to: /tmp/perfkitbenchmarker/runs/4658428b/pkb.log 2017-11-14 21:54:22,561 4658428b MainThread INFO PerfKitBenchmarker version: unknown 2017-11-14 21:54:22,561 4658428b MainThread INFO Flag values: --benchmark_config_file=unixbench2u2g.yaml --benchmarks=unixbench 2017-11-14 21:54:22,805 4658428b MainThread WARNING The key "static_vms" was not in the default config, but was in user overrides. This may indicate a typo. 2017-11-14 21:54:22,805 4658428b MainThread WARNING The key "flags" was not in the default config, but was in user overrides. This may indicate a typo. 2017-11-14 21:54:22,978 4658428b MainThread unixbench(1/1) INFO Provisioning resources for benchmark unixbench 2017-11-14 21:54:22,982 4658428b Thread-2 unixbench(1/1) INFO VM: 202.100.185.180 2017-11-14 21:54:22,982 4658428b Thread-2 unixbench(1/1) INFO Waiting for boot completion. 2017-11-14 21:54:22,982 4658428b Thread-2 unixbench(1/1) INFO Running: ssh -A -p 2279 root@202.100.185.180 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /root/.ssh/id_rsa hostname 2017-11-14 21:54:23,797 4658428b Thread-2 unixbench(1/1) INFO Running: ssh -A -p 2279 root@202.100.185.180 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /root/.ssh/id_rsa mkdir -p /tmp/pkb 2017-11-14 21:54:24,567 4658428b Thread-2 unixbench(1/1) INFO Running: ssh -A -p 2279 root@202.100.185.180 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /root/.ssh/id_rsa sudo mkdir -p /opt/pkb 2017-11-14 21:54:25,331 4658428b Thread-2 unixbench(1/1) INFO Running: ssh -A -p 2279 root@202.100.185.180 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /root/.ssh/id_rsa sudo chmod a+rwxt /opt/pkb 2017-11-14 21:54:26,091 4658428b Thread-2 unixbench(1/1) INFO Running: ssh -A -p 2279 root@202.100.185.180 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /root/.ssh/id_rsa dpkg --get-selections > /opt/pkb/dpkg_selections 2017-11-14 21:54:26,896 4658428b Thread-2 unixbench(1/1) INFO Running: ssh -A -p 2279 root@202.100.185.180 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /root/.ssh/id_rsa sudo apt-get update 2017-11-14 21:54:41,216 4658428b Thread-2 unixbench(1/1) INFO Running: ssh -A -p 2279 root@202.100.185.180 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /root/.ssh/id_rsa sudo DEBIAN_FRONTEND='noninteractive' /usr/bin/apt-get -y install python 2017-11-14 21:54:42,574 4658428b Thread-2 unixbench(1/1) INFO Running: ssh -A -p 2279 root@202.100.185.180 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /root/.ssh/id_rsa cat /proc/sys/net/ipv4/tcp_congestion_control 2017-11-14 21:54:43,312 4658428b Thread-2 unixbench(1/1) INFO Running: ssh -A -p 2279 root@202.100.185.180 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /root/.ssh/id_rsa lscpu 2017-11-14 21:54:44,138 4658428b MainThread unixbench(1/1) ERROR Exception occurred while calling PrepareVm(202.100.185.180): Traceback (most recent call last): File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/background_tasks.py", line 235, in Run self.return_value = self.target(*self.args, **self.kwargs) File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/benchmark_spec.py", line 456, in PrepareVm vm.PrepareVMEnvironment() File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/linux_virtual_machine.py", line 248, in PrepareVMEnvironment self.RecordAdditionalMetadata() File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/linux_virtual_machine.py", line 336, in RecordAdditionalMetadata lscpu_results = self.CheckLsCpu() File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/linux_virtual_machine.py", line 321, in CheckLsCpu return LsCpuResults(lscpu) File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/linux_virtual_machine.py", line 1274, in init lscpu) ValueError: NUMA Node(s) could not be found in lscpu value: Architecture: x86_64 CPU 32-bit, 64-bit Byte Order: Little Endian CPU(s): 4 On-line CPU(s) list: 0-3 1 2 Socket(s): 2 NUMA 1 ID GenuineIntel CPU 6 63 2 CPU MHz 2394.482 BogoMIPS: 4854.12 Xen full L1d 32K L1i 32K L2 256K L3 20480K NUMA node0 CPU(s): 0-3

2017-11-14 21:54:44,142 4658428b MainThread unixbench(1/1) ERROR Error during benchmark unixbench Traceback (most recent call last): File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/pkb.py", line 551, in RunBenchmark DoProvisionPhase(spec, detailed_timer) File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/pkb.py", line 430, in DoProvisionPhase spec.Provision() File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/benchmark_spec.py", line 340, in Provision vm_util.RunThreaded(self.PrepareVm, self.vms) File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/background_tasks.py", line 621, in RunThreaded max_concurrency=max_concurrent_threads) File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/background_tasks.py", line 565, in RunParallelThreads errors.VmUtil.ThreadException) File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/background_tasks.py", line 540, in _RunParallelTasks '{0}{1}'.format(os.linesep, os.linesep.join(error_strings))) ThreadException: The following exceptions occurred during parallel execution: Exception occurred while calling PrepareVm(202.100.185.180): Traceback (most recent call last): File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/background_tasks.py", line 235, in Run self.return_value = self.target(*self.args, **self.kwargs) File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/benchmark_spec.py", line 456, in PrepareVm vm.PrepareVMEnvironment() File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/linux_virtual_machine.py", line 248, in PrepareVMEnvironment self.RecordAdditionalMetadata() File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/linux_virtual_machine.py", line 336, in RecordAdditionalMetadata lscpu_results = self.CheckLsCpu() File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/linux_virtual_machine.py", line 321, in CheckLsCpu return LsCpuResults(lscpu) File "/usr/local/PerfKitBenchmarker-1.13.0/perfkitbenchmarker/linux_virtual_machine.py", line 1274, in init lscpu) ValueError: NUMA Node(s) could not be found in lscpu value: Architecture: x86_64 CPU 32-bit, 64-bit Byte Order: Little Endian CPU(s): 4 On-line CPU(s) list: 0-3 1 2 Socket(s): 2 NUMA 1 ID GenuineIntel CPU 6 63 2 CPU MHz 2394.482 BogoMIPS: 4854.12 Xen full L1d 32K L1i 32K L2 256K L3 20480K NUMA node0 CPU(s): 0-3

2017-11-14 21:54:44,143 4658428b Thread-12 unixbench(1/1) INFO Running: ssh -A -p 2279 root@202.100.185.180 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /root/.ssh/id_rsa sudo dpkg --clear-selections 2017-11-14 21:54:45,008 4658428b Thread-12 unixbench(1/1) INFO Running: ssh -A -p 2279 root@202.100.185.180 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /root/.ssh/id_rsa sudo dpkg --set-selections < /opt/pkb/dpkg_selections 2017-11-14 21:54:45,926 4658428b Thread-12 unixbench(1/1) INFO Running: ssh -A -p 2279 root@202.100.185.180 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /root/.ssh/id_rsa sudo DEBIAN_FRONTEND='noninteractive' apt-get --purge -y dselect-upgrade 2017-11-14 21:54:49,671 4658428b Thread-12 unixbench(1/1) INFO Running: ssh -A -p 2279 root@202.100.185.180 -2 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o IdentitiesOnly=yes -o PreferredAuthentications=publickey -o PasswordAuthentication=no -o ConnectTimeout=5 -o GSSAPIAuthentication=no -o ServerAliveInterval=30 -o ServerAliveCountMax=10 -i /root/.ssh/id_rsa sudo rm -rf /opt/pkb 2017-11-14 21:54:50,483 4658428b MainThread unixbench(1/1) ERROR Benchmark 1/1 unixbench (UID: unixbench0) failed. Execution will continue. 2017-11-14 21:54:50,500 4658428b MainThread INFO Benchmark run statuses:

Name UID Status

unixbench unixbench0 FAILED

Success rate: 0.00% (0/1) 2017-11-14 21:54:50,502 4658428b MainThread INFO Complete logs can be found at: /tmp/perfkitbenchmarker/runs/4658428b/pkb.log 2017-11-14 21:54:50,503 4658428b MainThread INFO Completion statuses can be found at: /tmp/perfkitbenchmarker/runs/4658428b/completion_statuses.json

When I execute 'lscpu' on the host being tested, it shows: qq 201711141542578888 What is the reason? Is it related to the encoding format? thanks！

gstrauss commented 7 years ago

ERROR Exception occurred while calling PrepareVm(202.100.185.180):

The error is not in UnixBench. The error is somewhere in PerfKitBenchmarker. Your might try running pkb.py with LANG=C ./pkb.py --benchmarks=unixbench