While working to further improve the performance of s3fs, I noticed that
s3fs_readdir() is not checking the file stat cache. On a directory with a large
number of files, this is a huge performance hit.
$ # r310 s3fs_readdir() - 3000 files, stat cache empty
$ time ls
real 1m2.615s
$ # r310 s3fs_readdir() - 3000 files, stat cache populated
$ time ls
real 1m11.437s
$ # patched r310 s3fs_readdir() - 3000 files, stat cache empty
$ time ls
real 1m16.350s
$ # patched r310 s3fs_readdir() - 3000 files, stat cache populated
$ time ls
real 0m4.084s
Original issue reported on code.google.com by ben.lema...@gmail.com on 10 Feb 2011 at 11:41
Original issue reported on code.google.com by
ben.lema...@gmail.com
on 10 Feb 2011 at 11:41Attachments: