how large can the db be?

peterbourgon / diskv

A disk-backed key-value store.

http://godoc.org/github.com/peterbourgon/diskv

MIT License

1.4k stars 102 forks source link

how large can the db be? #74

Closed hiqsociety closed 2 years ago

hiqsociety commented 2 years ago

if i want to access a key from a db, does it read the whole file into mem or just that particular key section? just wondering if i need to have lots of mem available for this. 100GB per db size advisable etc?

peterbourgon commented 2 years ago

In diskv, each key is one-to-one with a file on disk. A diskv "database" is just a directory, potentially including subdirectories, and all the files contained therein. So it can be as big as your disk, I guess. Diskv doesn't really add much meaningful overhead in this dimension.