search

bbfsdev / bbfs

Big brother file system (distributed file system)
14 stars 5 forks source link

Load with chunks #232

Closed yarondbb closed 10 years ago

yarondbb commented 10 years ago

@kolmanv or @genadyp who can code review? The main change is making the loading of the data base from file is done using chunks (same techniqu as writing to file) for better memory performence. I validated that memory of process reduces from 275M to 225M for 150K files, when loading all 150K files from file.

bbfsdev commented 10 years ago

I will code review tomorrow morning. Yaron, are there anything I can help with the Release? Maybe some manual testing?

On Sat, Nov 30, 2013 at 5:02 AM, yarondbb notifications@github.com wrote:

@kolmanv https://github.com/kolmanv or @genadyphttps://github.com/genadypwho can code review? The main change is making the loading of the data base from file is done using chunks (same techniqu as writing to file) for better memory performence. I validated that memory of process reduces from 275M to 225M for 150K files, when loading all 150K files from file.

— Reply to this email directly or view it on GitHubhttps://github.com/bbfsdev/bbfs/pull/232#issuecomment-29544669 .

yarondbb commented 10 years ago

The most help will be to code review. This is currently the only gating for the release (and Shiray's reply)

yarondbb commented 10 years ago

done fixing all comments