LaurentCR / pylast

Automatically exported from code.google.com/p/pylast
Apache License 2.0
0 stars 0 forks source link

caching does not scale and create thousands of tiny files in a single directory #20

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
Please type example code that produces the issue:
enable_caching('.cache')

What is the expected output? What do you see instead?
each individual object is serialized to disk in its own file. This cannot
scale as it end up creating tens of thousands of individual files on disk.

It would be more appropriate to use something like shelve to store it or
even sqllite

What version of pyLast is this?
0.3.1

Please provide any additional information below.

Original issue reported on code.google.com by sbaill...@gmail.com on 25 Jun 2009 at 11:49

GoogleCodeExporter commented 9 years ago
Thank you, I will look into this pretty soon.

Original comment by amr.hassan on 25 Jun 2009 at 1:56

GoogleCodeExporter commented 9 years ago
I've updated the version in the trunk (r192) to use a shelve.DbfilenameShelf 
object
for caching. try it out.

Original comment by amr.hassan on 26 Jun 2009 at 5:54