search

end18 / psutil

Automatically exported from code.google.com/p/psutil
Other
0 stars 0 forks source link

cpu_percent() examining only one cpu(?) #127

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
What steps will reproduce the problem?
1. import psutil,time
2. p = []
3. for i in range(100); p.append(psutil.cpu_percent); time.sleep(0.1)
4. print sum(p)/100

What is the expected output? What do you see instead?
On my idling eight cpu machine, I expect to see an average cpu_percent < 0.15, 
relatively unaffected by larger sleep times.
Instead I see an average ~ 30, and significantly less as time.sleep increases 
(eg average 6 percent with sleep 1.0 second).

What version of psutil are you using? What Python version?
psutil 1.3, python 2.6.5

On what operating system? Is it 32bit or 64bit version?
linux 64 bit

Please provide any additional information below.
It looks like cpu_percent is only returning percentage of cpu running the 
python process, but haven't checked source.

Original issue reported on code.google.com by llew...@gmail.com on 30 Oct 2010 at 5:49

GoogleCodeExporter commented 9 years ago 
I'm not sure to understand the problem you're describing and neither I'm able 
to run that code. It fails with:
*** TypeError: unsupported operand type(s) for +: 'int' and 'function'

Original comment by g.rodola on 30 Oct 2010 at 6:06

GoogleCodeExporter commented 9 years ago 
Didn't realize the code had some typos.
Here's what I get on Ubuntu 64 bit, 2 CPUs:
5.14361871132

Are you sure there are no other processes which are consuming the CPU?
Have you tried to look at top/htop/ghome-system-monitor while you do this?
What's the result of psutil.NUM_CPUS?

Original comment by g.rodola on 30 Oct 2010 at 6:14

GoogleCodeExporter commented 9 years ago 
Sorry about the typo.  Thanks for the quick reply.

psutil.NUM_CPUS is 8.

I have been monitoring all cpus with top, rather arbitrarily, but never see a 
single cpu less than 97% idle, while 5-6 out of 8 are 100% idle, while 
psutil.cpu_percent returns between 10 and 40%, depending on the sleep time (1 
sec to 0.1 sec).  Can't find any rogue background processes.
Above is running on a remote machine with putty.  With gnome system monitor, I 
get slightly higher cpu percentages, but maybe function of using remote desktop 
(nomachine).  I never, however, see any cpu with more than 10% and most idle, 
while cpu_percent() continues to return between 10 and 40%.

By eye, it looks like cpu_percent is the sum of the cpus rather than average.

When I replace above test with Process.get_cpu_percent(), with process obj 
initialized with os.getpid(), the result is less than one percent.  So clearly 
my speculation that it examines only current process cpu is wrong.

Original comment by llew...@gmail.com on 30 Oct 2010 at 7:44

GoogleCodeExporter commented 9 years ago 
> By eye, it looks like cpu_percent is the sum of the cpus rather than average.

cpu_percent is the percent of CPU utilization across all CPUs since the module 
initialization or the last time the function was called, whichever is more 
recent.

The calculation is performed by using getting the raw CPU idle time (as 
reported by the kernel), and the clock time, and figuring out what percentage 
of time was spent in a non-idle state. It's therefore a total utilization % 
across all CPUs. If you wanted average utilization per CPU you could divide by 
psutil.NUM_CPUS. 

Note also that support for per-process CPU statistics is being tracked as Issue 
#125

Original comment by jlo...@gmail.com on 30 Oct 2010 at 8:37

GoogleCodeExporter commented 9 years ago 
Ok, thanks for the clarification.  Is it possible then for cpu_percent() to 
return > 100?

Original comment by llew...@gmail.com on 30 Oct 2010 at 8:52

GoogleCodeExporter commented 9 years ago 
> Ok, thanks for the clarification.  Is it possible then for cpu_percent() to 
return > 100?

I should clarify we are actually dividing by NUM_CPUS in the psutil code, 
because the amount of idle time returned by the kernel is total across all 
CPUs. For example, if 5 seconds have gone by, and I have two CPUs, I'll get 10 
seconds of CPU time for that period. What we do in cpu_percent is the 
following: 

    # get the percentage of the time that was spent in idle state 
    # this value can be up to NUM_CPUS * 100
    idle_percent = (idle_delta / time_delta) * 100.0

    # calculate the total possible amount of CPU % (NUM_CPUS * 100)
    # subtract the amount of idle percentage above and divide by the NUM_CPUS
    # this gives the CPU util percent during the time frame for all CPUs
    util_percent = ((100 * NUM_CPUS) - idle_percent) / NUM_CPUS

This number should match what you see in top/taskmgr/Activity Monitor etc. as 
your overall utilization for that period. It should be possible to come out 
greater than 100%.

Original comment by jlo...@gmail.com on 30 Oct 2010 at 9:16

GoogleCodeExporter commented 9 years ago 
Sorry, I meant should NOT be possible to come out > 100%

Original comment by jlo...@gmail.com on 30 Oct 2010 at 9:23

GoogleCodeExporter commented 9 years ago 
Ok, I'll look into the code if I need to now.  Anyhow, psutil has been a 
helpful utility -- I just may need to adjust my expectations of cpu_percent but 
for my purposes (determining whether a new process should be started to work on 
a subproblem) that should be fine.  Thanks.

Original comment by llew...@gmail.com on 1 Nov 2010 at 3:51

GoogleCodeExporter commented 9 years ago 
Closing as invalid, since no change was needed here, and we are redoing all the 
CPU percent code in the next release.

Original comment by jlo...@gmail.com on 10 Nov 2010 at 6:50