tonbo-io / tonbo

A portable embedded database using Arrow.
https://tonbo.io
Apache License 2.0
795 stars 46 forks source link

chore: detach SnapShot from Transaction #207

Closed KKould closed 1 week ago

KKould commented 2 weeks ago

ref: https://github.com/tonbo-io/tonbo/issues/206

github-actions[bot] commented 2 weeks ago

Read:

+--------------------------------------------+---------+---------+
|                                            | tonbo   | rocksdb |
+================================================================+
| random range reads                         | 93986ms | 36657ms |
|--------------------------------------------+---------+---------|
| random range reads                         | 90383ms | 36495ms |
|--------------------------------------------+---------+---------|
| random range projection reads              | 40715ms | 37289ms |
|--------------------------------------------+---------+---------|
| random range projection reads              | 40512ms | 37135ms |
|--------------------------------------------+---------+---------|
| random range projection reads (4 threads)  | 33421ms | 37380ms |
|--------------------------------------------+---------+---------|
| random range projection reads (8 threads)  | 31393ms | 37363ms |
|--------------------------------------------+---------+---------|
| random range projection reads (16 threads) | 28797ms | 35901ms |
|--------------------------------------------+---------+---------|
| random range projection reads (32 threads) | 23761ms | 35783ms |
+--------------------------------------------+---------+---------+
github-actions[bot] commented 2 weeks ago

Write:

+-------------------------------+--------+---------+
|                               | tonbo  | rocksdb |
+==================================================+
| bulk load                     | 6511ms | 9407ms  |
|-------------------------------+--------+---------|
| individual writes             | 8273ms | 10663ms |
|-------------------------------+--------+---------|
| individual writes (4 threads) | 8256ms | 10723ms |
|-------------------------------+--------+---------|
| individual writes (8 threads) | 7758ms | 10639ms |
|-------------------------------+--------+---------|
| batch writes                  | 7879ms | 7118ms  |
|-------------------------------+--------+---------|
| batch writes (4 threads)      | 7793ms | 7086ms  |
|-------------------------------+--------+---------|
| batch writes (8 threads)      | 7578ms | 7087ms  |
|-------------------------------+--------+---------|
| removals                      | 3088ms | 3811ms  |
+-------------------------------+--------+---------+
github-actions[bot] commented 2 weeks ago

Read:

+--------------------------------------------+---------+---------+
|                                            | tonbo   | rocksdb |
+================================================================+
| random range reads                         | 88549ms | 36708ms |
|--------------------------------------------+---------+---------|
| random range reads                         | 84745ms | 36840ms |
|--------------------------------------------+---------+---------|
| random range projection reads              | 39290ms | 37676ms |
|--------------------------------------------+---------+---------|
| random range projection reads              | 39595ms | 37800ms |
|--------------------------------------------+---------+---------|
| random range projection reads (4 threads)  | 32656ms | 37401ms |
|--------------------------------------------+---------+---------|
| random range projection reads (8 threads)  | 30889ms | 37770ms |
|--------------------------------------------+---------+---------|
| random range projection reads (16 threads) | 28186ms | 36137ms |
|--------------------------------------------+---------+---------|
| random range projection reads (32 threads) | 24193ms | 35869ms |
+--------------------------------------------+---------+---------+
github-actions[bot] commented 2 weeks ago

Write:

+-------------------------------+--------+---------+
|                               | tonbo  | rocksdb |
+==================================================+
| bulk load                     | 6374ms | 9464ms  |
|-------------------------------+--------+---------|
| individual writes             | 8288ms | 10754ms |
|-------------------------------+--------+---------|
| individual writes (4 threads) | 8195ms | 10872ms |
|-------------------------------+--------+---------|
| individual writes (8 threads) | 7676ms | 10678ms |
|-------------------------------+--------+---------|
| batch writes                  | 7889ms | 7158ms  |
|-------------------------------+--------+---------|
| batch writes (4 threads)      | 7755ms | 7092ms  |
|-------------------------------+--------+---------|
| batch writes (8 threads)      | 7747ms | 7104ms  |
|-------------------------------+--------+---------|
| removals                      | 3083ms | 3829ms  |
+-------------------------------+--------+---------+
ethe commented 1 week ago

It should be a feat rather than chore: https://gist.github.com/joshbuchea/6f47e86d2510bce28f8e7f42ae84c716