cuid as partition key - Githubissues

paralleldrive / cuid

Collision-resistant ids optimized for horizontal scaling and performance.

Other

3.44k stars 123 forks source link

cuid as partition key #74

Closed kjmiller1 closed 7 years ago

kjmiller1 commented 7 years ago

Due to the c{timestamp}... structure, I have concerns about "todays" items creating a hot spot in a distributed data store for my use-case (long history of items, todays items are used heavily, using aws DynamoDB).

Thoughts on the validity of my concern?

ericelliott commented 7 years ago

Most distributed storage systems allow you to create your own partitioning hash function. I would give it a try, and if it does indeed create a hotspot, swap out the hash function to solve it.