improve physics performance with large number of files/directories

[GoogleCodeExporter]

Please improve speed - use more threads to maximize the use of multiple cores.

I need to view the whole project tree over 1 year:

gource myrepo.git --hide-filenames --max-files 10000 --disable-progress
--auto-skip-seconds 1 --seconds-per-day 1 --highlight-all-users
--file-idle-time 600 --stop-at-end --output-ppm-stream ppm.out
--output-framerate 25

My system is an Intel Core i7 2.8Ghz (QuadCore with HyperThreading) - Speed
is terribly slow - only one (max. 2) core(s) are used. CPU usage 16% average.

Original issue reported on code.google.com by r...@itsolution2.de on 2 Feb 2010 at 7:07

[GoogleCodeExporter]

What OS are you on? As long as it's not Windows you can do:

gource --output-ppm-stream - > ppm.out

Which will be faster.

If it's Windows I suggest using Fraps.

Original comment by acaudw...@gmail.com on 2 Feb 2010 at 8:02

[GoogleCodeExporter]

It's windows. And it is fast when I don't add --max-files 10000

Original comment by r...@itsolution2.de on 2 Feb 2010 at 8:44

[GoogleCodeExporter]

Ah ok. Yeah, I'm still looking into making output-ppm-stream faster, but until I
figure out how, right now using Fraps or some other capture program is the best
option on Windows.

Original comment by acaudw...@gmail.com on 2 Feb 2010 at 8:59

[GoogleCodeExporter]

i did lots of tries with the ppm thing on my fedora box, it's not a super-fast-
machine, but it's 2 core 2.8ghz 4gb ram workstation with GF8600, and when using 
--
output-ppm-stream it just kills it.

don't think it's the application, but the writing to disk. few minutes of video 
in 
480p+ takes between 10-50GB as ppm. this is a lot to just write. in my tests i 
used 
ffmpeg to convert ppms to mp4 video. i found it's very easy to use and give 
good 
results, since it works with streams of video and don't take lots of resources, 
maybe 
you can make Gource to have an option to decode it directly into any format 
supported.

Original comment by igal.al...@gmail.com on 12 Apr 2010 at 9:48

[GoogleCodeExporter]

It's not only the disk speed - in my case its depending on the number of 
"object" /
checkins. gource is fast if I use it for a small project.

Original comment by r...@itsolution2.de on 12 Apr 2010 at 10:07

[GoogleCodeExporter]

I've changed the topic of this bug to be about the physics performance (the 
video
page should be clearer now that output-ppm-stream is slow when writing to disk
because disk i/o is slow and uncompressed video files are huge).

Original comment by acaudw...@gmail.com on 12 Apr 2010 at 10:50

• Changed title: improve physics performance with large number of files/directories

[GoogleCodeExporter]

With large git, or into full HD, gource ahve big performance problem. Thanks to 
optimize it.

Original comment by brule.he...@gmail.com on 4 Nov 2012 at 11:27