search

elastic / apm-server

https://www.elastic.co/guide/en/apm/guide/current/index.html
Other
1.22k stars 521 forks source link

Update badger to latest version #11546

Open kruskall opened 1 year ago

kruskall commented 1 year ago

We are using an older badger version that is no longer supported. We should switch to the newer/latest version (currently v4)

axw commented 12 months ago

When we're ready for this, we should revive https://github.com/elastic/apm-server/pull/11344 and replace/update the GC test.

carsonip commented 3 months ago

This needs to be tested thoroughly, as my experiments show that the memory profiles (v2 vs v4) look quite different:

v2: https://github.com/carsonip/tbs-badger-playground/tree/main/prefetch v4: https://github.com/carsonip/tbs-badger-playground/tree/badgerv4/prefetch

carsonip commented 1 week ago

Updated the playground: https://github.com/carsonip/tbs-badger-playground

TLDR

TLDR: The point that worries me is that the fix we applied in https://github.com/elastic/apm-server/pull/13464 will be less effective as you may notice a perf regression in -prefetch=hybrid -hit=false case from badgerv2 to v4. rbytes does not seem to be different in badger v4 for any prefetch values. It appears that badgerv4 just reads the entire db on startup, which is also why its performance characteristics just cannot be analyzed using this simple playground.

v2:

0.07user 0.05system 0:00.17elapsed 73%CPU (0avgtext+0avgdata 66048maxresident)k
87152inputs+16outputs (227major+7109minor)pagefaults 0swaps
259:0 rbytes=44634112 wbytes=0 rios=579 wios=0 dbytes=0 dios=0
252:0 rbytes=44634112 wbytes=4096 rios=330 wios=1 dbytes=0 dios=0
252:1 rbytes=44634112 wbytes=0 rios=330 wios=0 dbytes=0 dios=0

v4:

0.24user 0.65system 0:02.23elapsed 40%CPU (0avgtext+0avgdata 685568maxresident)k
1910256inputs+48outputs (4576major+28993minor)pagefaults 0swaps
259:0 rbytes=978063360 wbytes=0 rios=9373 wios=2 dbytes=0 dios=0
252:0 rbytes=978063360 wbytes=4096 rios=4872 wios=3 dbytes=0 dios=0
252:1 rbytes=978063360 wbytes=0 rios=4872 wios=2 dbytes=0 dios=0

full results

badger v2

=== ./prefetch run -dir foo -prefetch=false -hit=false
Running as unit: run-re225b6318cb84569ba9c4bda26a17c4e.scope; invocation ID: fd0507988a9d4b5aa0633fea5d13a300
badger 2024/10/08 11:07:25 INFO: All 2 tables opened in 18ms
badger 2024/10/08 11:07:25 INFO: Replaying file id: 26 at offset: 60607284
badger 2024/10/08 11:07:25 INFO: Replay took: 2.452µs
2024/10/08 11:07:25 0 values read
MemTotal:       65504044 kB ->  MemTotal:       65504044 kB =   0 kB
MemFree:        24752396 kB ->  MemFree:        24666464 kB =   -85932 kB
MemAvailable:   33893428 kB ->  MemAvailable:   33858328 kB =   -35100 kB
Buffers:          153572 kB ->  Buffers:          153736 kB =   164 kB
Cached:          6504868 kB ->  Cached:          6555548 kB =   50680 kB
SwapCached:            0 kB ->  SwapCached:            0 kB =   0 kB
Active:         20926952 kB ->  Active:         20976148 kB =   49196 kB
Inactive:        8048156 kB ->  Inactive:        8063696 kB =   15540 kB
Active(anon):   19457728 kB ->  Active(anon):   19471632 kB =   13904 kB
Inactive(anon):  7118264 kB ->  Inactive(anon):  7118264 kB =   0 kB
Active(file):    1469224 kB ->  Active(file):    1504516 kB =   35292 kB
Inactive(file):   929892 kB ->  Inactive(file):   945432 kB =   15540 kB
Unevictable:     2684652 kB ->  Unevictable:     2684652 kB =   0 kB
Mlocked:             480 kB ->  Mlocked:             480 kB =   0 kB
SwapTotal:             0 kB ->  SwapTotal:             0 kB =   0 kB
SwapFree:              0 kB ->  SwapFree:              0 kB =   0 kB
Zswap:                 0 kB ->  Zswap:                 0 kB =   0 kB
Zswapped:              0 kB ->  Zswapped:              0 kB =   0 kB
Dirty:            136160 kB ->  Dirty:            136224 kB =   64 kB
Writeback:             0 kB ->  Writeback:             0 kB =   0 kB
AnonPages:      25001604 kB ->  AnonPages:      25015496 kB =   13892 kB
Mapped:          2343540 kB ->  Mapped:          2380248 kB =   36708 kB
Shmem:           4396608 kB ->  Shmem:           4396600 kB =   -8 kB
KReclaimable:    7474124 kB ->  KReclaimable:    7474124 kB =   0 kB
Slab:            8397788 kB ->  Slab:            8397796 kB =   8 kB
SReclaimable:    7474124 kB ->  SReclaimable:    7474124 kB =   0 kB
SUnreclaim:       923664 kB ->  SUnreclaim:       923672 kB =   8 kB
KernelStack:       65712 kB ->  KernelStack:       65816 kB =   104 kB
PageTables:       201324 kB ->  PageTables:       201572 kB =   248 kB
SecPageTables:         0 kB ->  SecPageTables:         0 kB =   0 kB
NFS_Unstable:          0 kB ->  NFS_Unstable:          0 kB =   0 kB
Bounce:                0 kB ->  Bounce:                0 kB =   0 kB
WritebackTmp:          0 kB ->  WritebackTmp:          0 kB =   0 kB
CommitLimit:    32752020 kB ->  CommitLimit:    32752020 kB =   0 kB
Committed_AS:   54651488 kB ->  Committed_AS:   54731568 kB =   80080 kB
VmallocTotal:   34359738367 kB  ->  VmallocTotal:   34359738367 kB  =   0 kB
VmallocUsed:      215144 kB ->  VmallocUsed:      215240 kB =   96 kB
VmallocChunk:          0 kB ->  VmallocChunk:          0 kB =   0 kB
Percpu:            30400 kB ->  Percpu:            30400 kB =   0 kB
HardwareCorrupted:     0 kB ->  HardwareCorrupted:     0 kB =   0 kB
AnonHugePages:         0 kB ->  AnonHugePages:         0 kB =   0 kB
ShmemHugePages:  1775616 kB ->  ShmemHugePages:  1775616 kB =   0 kB
ShmemPmdMapped:        0 kB ->  ShmemPmdMapped:        0 kB =   0 kB
FileHugePages:         0 kB ->  FileHugePages:         0 kB =   0 kB
FilePmdMapped:         0 kB ->  FilePmdMapped:         0 kB =   0 kB
Unaccepted:            0 kB ->  Unaccepted:            0 kB =   0 kB
HugePages_Total:       0    ->  HugePages_Total:       0    =   0 
HugePages_Free:        0    ->  HugePages_Free:        0    =   0 
HugePages_Rsvd:        0    ->  HugePages_Rsvd:        0    =   0 
HugePages_Surp:        0    ->  HugePages_Surp:        0    =   0 
Hugepagesize:       2048 kB ->  Hugepagesize:       2048 kB =   0 kB
Hugetlb:               0 kB ->  Hugetlb:               0 kB =   0 kB
DirectMap4k:      606196 kB ->  DirectMap4k:      606196 kB =   0 kB
DirectMap2M:    18972672 kB ->  DirectMap2M:    18972672 kB =   0 kB
DirectMap1G:    47185920 kB ->  DirectMap1G:    47185920 kB =   0 kB
0.06user 0.05system 0:00.16elapsed 73%CPU (0avgtext+0avgdata 66176maxresident)k
87264inputs+16outputs (225major+7028minor)pagefaults 0swaps
259:0 rbytes=44679168 wbytes=0 rios=611 wios=0 dbytes=0 dios=0
252:0 rbytes=44679168 wbytes=0 rios=361 wios=0 dbytes=0 dios=0
252:1 rbytes=44679168 wbytes=0 rios=361 wios=0 dbytes=0 dios=0
===
=== ./prefetch run -dir foo -prefetch=true -hit=false
Running as unit: run-ra6b2c539e9dc48da9ccaa8125f309b9d.scope; invocation ID: ca81faa31c834008b69808af112cff56
badger 2024/10/08 11:07:28 INFO: All 2 tables opened in 24ms
badger 2024/10/08 11:07:28 INFO: Replaying file id: 26 at offset: 60607284
badger 2024/10/08 11:07:28 INFO: Replay took: 4.705µs
2024/10/08 11:07:33 0 values read
MemTotal:       65504044 kB ->  MemTotal:       65504044 kB =   0 kB
MemFree:        25304572 kB ->  MemFree:        24862476 kB =   -442096 kB
MemAvailable:   33972764 kB ->  MemAvailable:   33719864 kB =   -252900 kB
Buffers:            2436 kB ->  Buffers:            5904 kB =   3468 kB
Cached:          6488988 kB ->  Cached:          8427436 kB =   1938448 kB
SwapCached:            0 kB ->  SwapCached:            0 kB =   0 kB
Active:         15904768 kB ->  Active:         16447316 kB =   542548 kB
Inactive:       12929300 kB ->  Inactive:       14202492 kB =   1273192 kB
Active(anon):   14534216 kB ->  Active(anon):   15012496 kB =   478280 kB
Inactive(anon): 12033888 kB ->  Inactive(anon): 11629212 kB =   -404676 kB
Active(file):    1370552 kB ->  Active(file):    1434820 kB =   64268 kB
Inactive(file):   895412 kB ->  Inactive(file):  2573280 kB =   1677868 kB
Unevictable:     2646448 kB ->  Unevictable:     2845188 kB =   198740 kB
Mlocked:             480 kB ->  Mlocked:             480 kB =   0 kB
SwapTotal:             0 kB ->  SwapTotal:             0 kB =   0 kB
SwapFree:              0 kB ->  SwapFree:              0 kB =   0 kB
Zswap:                 0 kB ->  Zswap:                 0 kB =   0 kB
Zswapped:              0 kB ->  Zswapped:              0 kB =   0 kB
Dirty:              1764 kB ->  Dirty:              1952 kB =   188 kB
Writeback:           152 kB ->  Writeback:             4 kB =   -148 kB
AnonPages:      24990688 kB ->  AnonPages:      25061724 kB =   71036 kB
Mapped:          2351048 kB ->  Mapped:          4032092 kB =   1681044 kB
Shmem:           4361404 kB ->  Shmem:           4562176 kB =   200772 kB
KReclaimable:    7134436 kB ->  KReclaimable:    5581496 kB =   -1552940 kB
Slab:            8047108 kB ->  Slab:            6433308 kB =   -1613800 kB
SReclaimable:    7134436 kB ->  SReclaimable:    5581496 kB =   -1552940 kB
SUnreclaim:       912672 kB ->  SUnreclaim:       851812 kB =   -60860 kB
KernelStack:       65776 kB ->  KernelStack:       66080 kB =   304 kB
PageTables:       201644 kB ->  PageTables:       205828 kB =   4184 kB
SecPageTables:         0 kB ->  SecPageTables:         0 kB =   0 kB
NFS_Unstable:          0 kB ->  NFS_Unstable:          0 kB =   0 kB
Bounce:                0 kB ->  Bounce:                0 kB =   0 kB
WritebackTmp:          0 kB ->  WritebackTmp:          0 kB =   0 kB
CommitLimit:    32752020 kB ->  CommitLimit:    32752020 kB =   0 kB
Committed_AS:   54729036 kB ->  Committed_AS:   55039848 kB =   310812 kB
VmallocTotal:   34359738367 kB  ->  VmallocTotal:   34359738367 kB  =   0 kB
VmallocUsed:      215288 kB ->  VmallocUsed:      215560 kB =   272 kB
VmallocChunk:          0 kB ->  VmallocChunk:          0 kB =   0 kB
Percpu:            30400 kB ->  Percpu:            30400 kB =   0 kB
HardwareCorrupted:     0 kB ->  HardwareCorrupted:     0 kB =   0 kB
AnonHugePages:         0 kB ->  AnonHugePages:         0 kB =   0 kB
ShmemHugePages:  1789952 kB ->  ShmemHugePages:  1984512 kB =   194560 kB
ShmemPmdMapped:        0 kB ->  ShmemPmdMapped:        0 kB =   0 kB
FileHugePages:         0 kB ->  FileHugePages:         0 kB =   0 kB
FilePmdMapped:         0 kB ->  FilePmdMapped:         0 kB =   0 kB
Unaccepted:            0 kB ->  Unaccepted:            0 kB =   0 kB
HugePages_Total:       0    ->  HugePages_Total:       0    =   0 
HugePages_Free:        0    ->  HugePages_Free:        0    =   0 
HugePages_Rsvd:        0    ->  HugePages_Rsvd:        0    =   0 
HugePages_Surp:        0    ->  HugePages_Surp:        0    =   0 
Hugepagesize:       2048 kB ->  Hugepagesize:       2048 kB =   0 kB
Hugetlb:               0 kB ->  Hugetlb:               0 kB =   0 kB
DirectMap4k:      606196 kB ->  DirectMap4k:      606196 kB =   0 kB
DirectMap2M:    18972672 kB ->  DirectMap2M:    18972672 kB =   0 kB
DirectMap1G:    47185920 kB ->  DirectMap1G:    47185920 kB =   0 kB
6.13user 10.60system 0:04.89elapsed 341%CPU (0avgtext+0avgdata 1732648maxresident)k
3390792inputs+16outputs (420031major+223036minor)pagefaults 0swaps
259:0 rbytes=1736097792 wbytes=0 rios=413529 wios=0 dbytes=0 dios=0
252:0 rbytes=1736097792 wbytes=4096 rios=413281 wios=1 dbytes=0 dios=0
252:1 rbytes=1736097792 wbytes=0 rios=413281 wios=0 dbytes=0 dios=0
===
=== ./prefetch run -dir foo -prefetch=hybrid -hit=false
Running as unit: run-r09d3d210626d4bd4bff70aec6d0218ab.scope; invocation ID: 5b9a9cece3f54effbe350a50246bf254
badger 2024/10/08 11:07:36 INFO: All 2 tables opened in 19ms
badger 2024/10/08 11:07:36 INFO: Replaying file id: 26 at offset: 60607284
badger 2024/10/08 11:07:36 INFO: Replay took: 3.134µs
2024/10/08 11:07:36 0 values read
MemTotal:       65504044 kB ->  MemTotal:       65504044 kB =   0 kB
MemFree:        26635164 kB ->  MemFree:        26550760 kB =   -84404 kB
MemAvailable:   33769664 kB ->  MemAvailable:   33737360 kB =   -32304 kB
Buffers:           58840 kB ->  Buffers:           58992 kB =   152 kB
Cached:          6633592 kB ->  Cached:          6685388 kB =   51796 kB
SwapCached:            0 kB ->  SwapCached:            0 kB =   0 kB
Active:         18836024 kB ->  Active:         18907752 kB =   71728 kB
Inactive:       10052052 kB ->  Inactive:       10067768 kB =   15716 kB
Active(anon):   17470276 kB ->  Active(anon):   17505620 kB =   35344 kB
Inactive(anon):  9124180 kB ->  Inactive(anon):  9124180 kB =   0 kB
Active(file):    1365748 kB ->  Active(file):    1402132 kB =   36384 kB
Inactive(file):   927872 kB ->  Inactive(file):   943588 kB =   15716 kB
Unevictable:     2818552 kB ->  Unevictable:     2818552 kB =   0 kB
Mlocked:             480 kB ->  Mlocked:             480 kB =   0 kB
SwapTotal:             0 kB ->  SwapTotal:             0 kB =   0 kB
SwapFree:              0 kB ->  SwapFree:              0 kB =   0 kB
Zswap:                 0 kB ->  Zswap:                 0 kB =   0 kB
Zswapped:              0 kB ->  Zswapped:              0 kB =   0 kB
Dirty:            142080 kB ->  Dirty:            142016 kB =   -64 kB
Writeback:             0 kB ->  Writeback:             0 kB =   0 kB
AnonPages:      25014444 kB ->  AnonPages:      25049660 kB =   35216 kB
Mapped:          2344808 kB ->  Mapped:          2382268 kB =   37460 kB
Shmem:           4536028 kB ->  Shmem:           4536032 kB =   4 kB
KReclaimable:    5573088 kB ->  KReclaimable:    5573088 kB =   0 kB
Slab:            6424464 kB ->  Slab:            6424456 kB =   -8 kB
SReclaimable:    5573088 kB ->  SReclaimable:    5573088 kB =   0 kB
SUnreclaim:       851376 kB ->  SUnreclaim:       851368 kB =   -8 kB
KernelStack:       65792 kB ->  KernelStack:       65920 kB =   128 kB
PageTables:       201740 kB ->  PageTables:       201996 kB =   256 kB
SecPageTables:         0 kB ->  SecPageTables:         0 kB =   0 kB
NFS_Unstable:          0 kB ->  NFS_Unstable:          0 kB =   0 kB
Bounce:                0 kB ->  Bounce:                0 kB =   0 kB
WritebackTmp:          0 kB ->  WritebackTmp:          0 kB =   0 kB
CommitLimit:    32752020 kB ->  CommitLimit:    32752020 kB =   0 kB
Committed_AS:   54806756 kB ->  Committed_AS:   54894176 kB =   87420 kB
VmallocTotal:   34359738367 kB  ->  VmallocTotal:   34359738367 kB  =   0 kB
VmallocUsed:      215288 kB ->  VmallocUsed:      215304 kB =   16 kB
VmallocChunk:          0 kB ->  VmallocChunk:          0 kB =   0 kB
Percpu:            30400 kB ->  Percpu:            30400 kB =   0 kB
HardwareCorrupted:     0 kB ->  HardwareCorrupted:     0 kB =   0 kB
AnonHugePages:         0 kB ->  AnonHugePages:         0 kB =   0 kB
ShmemHugePages:  1974272 kB ->  ShmemHugePages:  1974272 kB =   0 kB
ShmemPmdMapped:        0 kB ->  ShmemPmdMapped:        0 kB =   0 kB
FileHugePages:         0 kB ->  FileHugePages:         0 kB =   0 kB
FilePmdMapped:         0 kB ->  FilePmdMapped:         0 kB =   0 kB
Unaccepted:            0 kB ->  Unaccepted:            0 kB =   0 kB
HugePages_Total:       0    ->  HugePages_Total:       0    =   0 
HugePages_Free:        0    ->  HugePages_Free:        0    =   0 
HugePages_Rsvd:        0    ->  HugePages_Rsvd:        0    =   0 
HugePages_Surp:        0    ->  HugePages_Surp:        0    =   0 
Hugepagesize:       2048 kB ->  Hugepagesize:       2048 kB =   0 kB
Hugetlb:               0 kB ->  Hugetlb:               0 kB =   0 kB
DirectMap4k:      606196 kB ->  DirectMap4k:      606196 kB =   0 kB
DirectMap2M:    18972672 kB ->  DirectMap2M:    18972672 kB =   0 kB
DirectMap1G:    47185920 kB ->  DirectMap1G:    47185920 kB =   0 kB
0.07user 0.05system 0:00.17elapsed 73%CPU (0avgtext+0avgdata 66048maxresident)k
87152inputs+16outputs (227major+7109minor)pagefaults 0swaps
259:0 rbytes=44634112 wbytes=0 rios=579 wios=0 dbytes=0 dios=0
252:0 rbytes=44634112 wbytes=4096 rios=330 wios=1 dbytes=0 dios=0
252:1 rbytes=44634112 wbytes=0 rios=330 wios=0 dbytes=0 dios=0
===
=== ./prefetch run -dir foo -prefetch=false -hit=true
Running as unit: run-rb83b107be8bf428f93bed61cace3f04a.scope; invocation ID: 26f6d496da5343b5bbc3234ff359d310
badger 2024/10/08 11:07:39 INFO: All 2 tables opened in 18ms
badger 2024/10/08 11:07:39 INFO: Replaying file id: 26 at offset: 60607284
badger 2024/10/08 11:07:39 INFO: Replay took: 2.609µs
2024/10/08 11:08:07 891000 values read
MemTotal:       65504044 kB ->  MemTotal:       65504044 kB =   0 kB
MemFree:        26655676 kB ->  MemFree:        24207032 kB =   -2448644 kB
MemAvailable:   33770856 kB ->  MemAvailable:   33415604 kB =   -355252 kB
Buffers:            3252 kB ->  Buffers:          159376 kB =   156124 kB
Cached:          6597200 kB ->  Cached:          8601764 kB =   2004564 kB
SwapCached:            0 kB ->  SwapCached:            0 kB =   0 kB
Active:         18851764 kB ->  Active:         19201160 kB =   349396 kB
Inactive:       10023488 kB ->  Inactive:       12031636 kB =   2008148 kB
Active(anon):   17476516 kB ->  Active(anon):   17740784 kB =   264268 kB
Inactive(anon):  9124180 kB ->  Inactive(anon):  9123436 kB =   -744 kB
Active(file):    1375248 kB ->  Active(file):    1460376 kB =   85128 kB
Inactive(file):   899308 kB ->  Inactive(file):  2908200 kB =   2008892 kB
Unevictable:     2750068 kB ->  Unevictable:     2817932 kB =   67864 kB
Mlocked:             480 kB ->  Mlocked:             480 kB =   0 kB
SwapTotal:             0 kB ->  SwapTotal:             0 kB =   0 kB
SwapFree:              0 kB ->  SwapFree:              0 kB =   0 kB
Zswap:                 0 kB ->  Zswap:                 0 kB =   0 kB
Zswapped:              0 kB ->  Zswapped:              0 kB =   0 kB
Dirty:            142916 kB ->  Dirty:            162960 kB =   20044 kB
Writeback:             0 kB ->  Writeback:             0 kB =   0 kB
AnonPages:      25025404 kB ->  AnonPages:      25289860 kB =   264456 kB
Mapped:          2344092 kB ->  Mapped:          4150048 kB =   1805956 kB
Shmem:           4463196 kB ->  Shmem:           4529904 kB =   66708 kB
KReclaimable:    5572832 kB ->  KReclaimable:    5572204 kB =   -628 kB
Slab:            6424060 kB ->  Slab:            6424200 kB =   140 kB
SReclaimable:    5572832 kB ->  SReclaimable:    5572204 kB =   -628 kB
SUnreclaim:       851228 kB ->  SUnreclaim:       851996 kB =   768 kB
KernelStack:       65904 kB ->  KernelStack:       66448 kB =   544 kB
PageTables:       201684 kB ->  PageTables:       205976 kB =   4292 kB
SecPageTables:         0 kB ->  SecPageTables:         0 kB =   0 kB
NFS_Unstable:          0 kB ->  NFS_Unstable:          0 kB =   0 kB
Bounce:                0 kB ->  Bounce:                0 kB =   0 kB
WritebackTmp:          0 kB ->  WritebackTmp:          0 kB =   0 kB
CommitLimit:    32752020 kB ->  CommitLimit:    32752020 kB =   0 kB
Committed_AS:   54738760 kB ->  Committed_AS:   54965532 kB =   226772 kB
VmallocTotal:   34359738367 kB  ->  VmallocTotal:   34359738367 kB  =   0 kB
VmallocUsed:      215352 kB ->  VmallocUsed:      215992 kB =   640 kB
VmallocChunk:          0 kB ->  VmallocChunk:          0 kB =   0 kB
Percpu:            30400 kB ->  Percpu:            30400 kB =   0 kB
HardwareCorrupted:     0 kB ->  HardwareCorrupted:     0 kB =   0 kB
AnonHugePages:         0 kB ->  AnonHugePages:         0 kB =   0 kB
ShmemHugePages:  1914880 kB ->  ShmemHugePages:  2054144 kB =   139264 kB
ShmemPmdMapped:        0 kB ->  ShmemPmdMapped:        0 kB =   0 kB
FileHugePages:         0 kB ->  FileHugePages:         0 kB =   0 kB
FilePmdMapped:         0 kB ->  FilePmdMapped:         0 kB =   0 kB
Unaccepted:            0 kB ->  Unaccepted:            0 kB =   0 kB
HugePages_Total:       0    ->  HugePages_Total:       0    =   0 
HugePages_Free:        0    ->  HugePages_Free:        0    =   0 
HugePages_Rsvd:        0    ->  HugePages_Rsvd:        0    =   0 
HugePages_Surp:        0    ->  HugePages_Surp:        0    =   0 
Hugepagesize:       2048 kB ->  Hugepagesize:       2048 kB =   0 kB
Hugetlb:               0 kB ->  Hugetlb:               0 kB =   0 kB
DirectMap4k:      606196 kB ->  DirectMap4k:      606196 kB =   0 kB
DirectMap2M:    18972672 kB ->  DirectMap2M:    18972672 kB =   0 kB
DirectMap1G:    47185920 kB ->  DirectMap1G:    47185920 kB =   0 kB
1.30user 4.86system 0:28.39elapsed 21%CPU (0avgtext+0avgdata 1830528maxresident)k
3616112inputs+16outputs (440138major+8396minor)pagefaults 0swaps
259:0 rbytes=1851461632 wbytes=0 rios=441698 wios=0 dbytes=0 dios=0
252:0 rbytes=1851461632 wbytes=4096 rios=441449 wios=1 dbytes=0 dios=0
252:1 rbytes=1851461632 wbytes=0 rios=441449 wios=0 dbytes=0 dios=0
===
=== ./prefetch run -dir foo -prefetch=true -hit=true
Running as unit: run-r4d441094d6a94e699efc453f4cb85858.scope; invocation ID: 516df13a2c584ea9a1104fd51fb1ecce
badger 2024/10/08 11:08:11 INFO: All 2 tables opened in 18ms
badger 2024/10/08 11:08:11 INFO: Replaying file id: 26 at offset: 60607284
badger 2024/10/08 11:08:11 INFO: Replay took: 2.215µs
2024/10/08 11:08:16 891000 values read
MemTotal:       65504044 kB ->  MemTotal:       65504044 kB =   0 kB
MemFree:        26598192 kB ->  MemFree:        24625828 kB =   -1972364 kB
MemAvailable:   33557816 kB ->  MemAvailable:   33477776 kB =   -80040 kB
Buffers:            4112 kB ->  Buffers:            5952 kB =   1840 kB
Cached:          6363152 kB ->  Cached:          8198280 kB =   1835128 kB
SwapCached:            0 kB ->  SwapCached:            0 kB =   0 kB
Active:         19017692 kB ->  Active:         19134716 kB =   117024 kB
Inactive:        9874888 kB ->  Inactive:       11695572 kB =   1820684 kB
Active(anon):   17649288 kB ->  Active(anon):   17694624 kB =   45336 kB
Inactive(anon):  9123416 kB ->  Inactive(anon):  9123416 kB =   0 kB
Active(file):    1368404 kB ->  Active(file):    1440092 kB =   71688 kB
Inactive(file):   751472 kB ->  Inactive(file):  2572156 kB =   1820684 kB
Unevictable:     2673068 kB ->  Unevictable:     2617376 kB =   -55692 kB
Mlocked:             480 kB ->  Mlocked:             480 kB =   0 kB
SwapTotal:             0 kB ->  SwapTotal:             0 kB =   0 kB
SwapFree:              0 kB ->  SwapFree:              0 kB =   0 kB
Zswap:                 0 kB ->  Zswap:                 0 kB =   0 kB
Zswapped:              0 kB ->  Zswapped:              0 kB =   0 kB
Dirty:             20516 kB ->  Dirty:             20248 kB =   -268 kB
Writeback:             8 kB ->  Writeback:             0 kB =   -8 kB
AnonPages:      25198556 kB ->  AnonPages:      25243896 kB =   45340 kB
Mapped:          2348932 kB ->  Mapped:          4146608 kB =   1797676 kB
Shmem:           4384896 kB ->  Shmem:           4329176 kB =   -55720 kB
KReclaimable:    5571956 kB ->  KReclaimable:    5571908 kB =   -48 kB
Slab:            6423620 kB ->  Slab:            6423808 kB =   188 kB
SReclaimable:    5571956 kB ->  SReclaimable:    5571908 kB =   -48 kB
SUnreclaim:       851664 kB ->  SUnreclaim:       851900 kB =   236 kB
KernelStack:       66176 kB ->  KernelStack:       66416 kB =   240 kB
PageTables:       201880 kB ->  PageTables:       205824 kB =   3944 kB
SecPageTables:         0 kB ->  SecPageTables:         0 kB =   0 kB
NFS_Unstable:          0 kB ->  NFS_Unstable:          0 kB =   0 kB
Bounce:                0 kB ->  Bounce:                0 kB =   0 kB
WritebackTmp:          0 kB ->  WritebackTmp:          0 kB =   0 kB
CommitLimit:    32752020 kB ->  CommitLimit:    32752020 kB =   0 kB
Committed_AS:   54725568 kB ->  Committed_AS:   54875420 kB =   149852 kB
VmallocTotal:   34359738367 kB  ->  VmallocTotal:   34359738367 kB  =   0 kB
VmallocUsed:      215720 kB ->  VmallocUsed:      215928 kB =   208 kB
VmallocChunk:          0 kB ->  VmallocChunk:          0 kB =   0 kB
Percpu:            30400 kB ->  Percpu:            30400 kB =   0 kB
HardwareCorrupted:     0 kB ->  HardwareCorrupted:     0 kB =   0 kB
AnonHugePages:         0 kB ->  AnonHugePages:         0 kB =   0 kB
ShmemHugePages:  1910784 kB ->  ShmemHugePages:  1869824 kB =   -40960 kB
ShmemPmdMapped:        0 kB ->  ShmemPmdMapped:        0 kB =   0 kB
FileHugePages:         0 kB ->  FileHugePages:         0 kB =   0 kB
FilePmdMapped:         0 kB ->  FilePmdMapped:         0 kB =   0 kB
Unaccepted:            0 kB ->  Unaccepted:            0 kB =   0 kB
HugePages_Total:       0    ->  HugePages_Total:       0    =   0 
HugePages_Free:        0    ->  HugePages_Free:        0    =   0 
HugePages_Rsvd:        0    ->  HugePages_Rsvd:        0    =   0 
HugePages_Surp:        0    ->  HugePages_Surp:        0    =   0 
Hugepagesize:       2048 kB ->  Hugepagesize:       2048 kB =   0 kB
Hugetlb:               0 kB ->  Hugetlb:               0 kB =   0 kB
DirectMap4k:      606196 kB ->  DirectMap4k:      606196 kB =   0 kB
DirectMap2M:    18972672 kB ->  DirectMap2M:    18972672 kB =   0 kB
DirectMap1G:    47185920 kB ->  DirectMap1G:    47185920 kB =   0 kB
8.57user 11.33system 0:05.73elapsed 347%CPU (0avgtext+0avgdata 1845248maxresident)k
3616120inputs+16outputs (449055major+242953minor)pagefaults 0swaps
259:0 rbytes=1851465728 wbytes=0 rios=441699 wios=0 dbytes=0 dios=0
252:0 rbytes=1851465728 wbytes=4096 rios=441450 wios=1 dbytes=0 dios=0
252:1 rbytes=1851465728 wbytes=0 rios=441450 wios=0 dbytes=0 dios=0
===
=== ./prefetch run -dir foo -prefetch=hybrid -hit=true
Running as unit: run-r0964e8c5f761434cafd1f3aaa51d41f9.scope; invocation ID: 7dd3177e969b41fea03f10cbd099e954
badger 2024/10/08 11:08:19 INFO: All 2 tables opened in 18ms
badger 2024/10/08 11:08:19 INFO: Replaying file id: 26 at offset: 60607284
badger 2024/10/08 11:08:19 INFO: Replay took: 2.779µs
2024/10/08 11:08:26 891000 values read
MemTotal:       65504044 kB ->  MemTotal:       65504044 kB =   0 kB
MemFree:        26344108 kB ->  MemFree:        24607412 kB =   -1736696 kB
MemAvailable:   33369556 kB ->  MemAvailable:   33741580 kB =   372024 kB
Buffers:            5508 kB ->  Buffers:          151588 kB =   146080 kB
Cached:          6427380 kB ->  Cached:          8306236 kB =   1878856 kB
SwapCached:            0 kB ->  SwapCached:            0 kB =   0 kB
Active:         19069996 kB ->  Active:         19063156 kB =   -6840 kB
Inactive:        9902832 kB ->  Inactive:       11969776 kB =   2066944 kB
Active(anon):   17663400 kB ->  Active(anon):   17614660 kB =   -48740 kB
Inactive(anon):  9123416 kB ->  Inactive(anon):  9123416 kB =   0 kB
Active(file):    1406596 kB ->  Active(file):    1448496 kB =   41900 kB
Inactive(file):   779416 kB ->  Inactive(file):  2846360 kB =   2066944 kB
Unevictable:     2670540 kB ->  Unevictable:     2586372 kB =   -84168 kB
Mlocked:             480 kB ->  Mlocked:             480 kB =   0 kB
SwapTotal:             0 kB ->  SwapTotal:             0 kB =   0 kB
SwapFree:              0 kB ->  SwapFree:              0 kB =   0 kB
Zswap:                 0 kB ->  Zswap:                 0 kB =   0 kB
Zswapped:              0 kB ->  Zswapped:              0 kB =   0 kB
Dirty:             21864 kB ->  Dirty:            138308 kB =   116444 kB
Writeback:             0 kB ->  Writeback:            48 kB =   48 kB
AnonPages:      25210240 kB ->  AnonPages:      25162344 kB =   -47896 kB
Mapped:          2353884 kB ->  Mapped:          4153696 kB =   1799812 kB
Shmem:           4384392 kB ->  Shmem:           4299756 kB =   -84636 kB
KReclaimable:    5571644 kB ->  KReclaimable:    5571520 kB =   -124 kB
Slab:            6423304 kB ->  Slab:            6423300 kB =   -4 kB
SReclaimable:    5571644 kB ->  SReclaimable:    5571520 kB =   -124 kB
SUnreclaim:       851660 kB ->  SUnreclaim:       851780 kB =   120 kB
KernelStack:       66256 kB ->  KernelStack:       66400 kB =   144 kB
PageTables:       201868 kB ->  PageTables:       205512 kB =   3644 kB
SecPageTables:         0 kB ->  SecPageTables:         0 kB =   0 kB
NFS_Unstable:          0 kB ->  NFS_Unstable:          0 kB =   0 kB
Bounce:                0 kB ->  Bounce:                0 kB =   0 kB
WritebackTmp:          0 kB ->  WritebackTmp:          0 kB =   0 kB
CommitLimit:    32752020 kB ->  CommitLimit:    32752020 kB =   0 kB
Committed_AS:   54755380 kB ->  Committed_AS:   55004400 kB =   249020 kB
VmallocTotal:   34359738367 kB  ->  VmallocTotal:   34359738367 kB  =   0 kB
VmallocUsed:      215672 kB ->  VmallocUsed:      216088 kB =   416 kB
VmallocChunk:          0 kB ->  VmallocChunk:          0 kB =   0 kB
Percpu:            30400 kB ->  Percpu:            30400 kB =   0 kB
HardwareCorrupted:     0 kB ->  HardwareCorrupted:     0 kB =   0 kB
AnonHugePages:         0 kB ->  AnonHugePages:         0 kB =   0 kB
ShmemHugePages:  1931264 kB ->  ShmemHugePages:  1857536 kB =   -73728 kB
ShmemPmdMapped:        0 kB ->  ShmemPmdMapped:        0 kB =   0 kB
FileHugePages:         0 kB ->  FileHugePages:         0 kB =   0 kB
FilePmdMapped:         0 kB ->  FilePmdMapped:         0 kB =   0 kB
Unaccepted:            0 kB ->  Unaccepted:            0 kB =   0 kB
HugePages_Total:       0    ->  HugePages_Total:       0    =   0 
HugePages_Free:        0    ->  HugePages_Free:        0    =   0 
HugePages_Rsvd:        0    ->  HugePages_Rsvd:        0    =   0 
HugePages_Surp:        0    ->  HugePages_Surp:        0    =   0 
Hugepagesize:       2048 kB ->  Hugepagesize:       2048 kB =   0 kB
Hugetlb:               0 kB ->  Hugetlb:               0 kB =   0 kB
DirectMap4k:      606196 kB ->  DirectMap4k:      606196 kB =   0 kB
DirectMap2M:    18972672 kB ->  DirectMap2M:    18972672 kB =   0 kB
DirectMap1G:    47185920 kB ->  DirectMap1G:    47185920 kB =   0 kB
8.63user 11.54system 0:06.50elapsed 310%CPU (0avgtext+0avgdata 1845376maxresident)k
3616112inputs+16outputs (448041major+235313minor)pagefaults 0swaps
259:0 rbytes=1851461632 wbytes=0 rios=441698 wios=0 dbytes=0 dios=0
252:0 rbytes=1851461632 wbytes=4096 rios=441449 wios=1 dbytes=0 dios=0
252:1 rbytes=1851461632 wbytes=0 rios=441449 wios=0 dbytes=0 dios=0
===

badger v4

=== ./prefetch run -dir foo -prefetch=false -hit=false
Running as unit: run-rc381262fe5994a91bdab0f71adf56c4d.scope; invocation ID: 70250a2bc16147b7a41da2634cc4869d
badger 2024/10/08 16:03:07 INFO: All 33 tables opened in 21ms
badger 2024/10/08 16:03:07 INFO: Discard stats nextEmptySlot: 0
badger 2024/10/08 16:03:07 INFO: Set nextTxnTs to 9900
badger 2024/10/08 16:03:07 INFO: Deleting empty file: foo/000001.vlog
2024/10/08 16:03:09 0 values read
MemTotal:       65504044 kB ->  MemTotal:       65504044 kB =   0 kB
MemFree:        20607188 kB ->  MemFree:        17336840 kB =   -3270348 kB
MemAvailable:   29567412 kB ->  MemAvailable:   27323972 kB =   -2243440 kB
Buffers:            3440 kB ->  Buffers:            5808 kB =   2368 kB
Cached:          7229728 kB ->  Cached:          8254076 kB =   1024348 kB
SwapCached:            0 kB ->  SwapCached:            0 kB =   0 kB
Active:         25041748 kB ->  Active:         28055036 kB =   3013288 kB
Inactive:        9635596 kB ->  Inactive:        9684588 kB =   48992 kB
Active(anon):   22499332 kB ->  Active(anon):   24535000 kB =   2035668 kB
Inactive(anon):  8898336 kB ->  Inactive(anon):  8898336 kB =   0 kB
Active(file):    2542416 kB ->  Active(file):    3520036 kB =   977620 kB
Inactive(file):   737260 kB ->  Inactive(file):   786252 kB =   48992 kB
Unevictable:     2173624 kB ->  Unevictable:     2173624 kB =   0 kB
Mlocked:             480 kB ->  Mlocked:             480 kB =   0 kB
SwapTotal:             0 kB ->  SwapTotal:             0 kB =   0 kB
SwapFree:              0 kB ->  SwapFree:              0 kB =   0 kB
Zswap:                 0 kB ->  Zswap:                 0 kB =   0 kB
Zswapped:              0 kB ->  Zswapped:              0 kB =   0 kB
Dirty:             10568 kB ->  Dirty:             10384 kB =   -184 kB
Writeback:             0 kB ->  Writeback:             0 kB =   0 kB
AnonPages:      29618020 kB ->  AnonPages:      31653852 kB =   2035832 kB
Mapped:          3496488 kB ->  Mapped:          4220812 kB =   724324 kB
Shmem:           4089020 kB ->  Shmem:           4089024 kB =   4 kB
KReclaimable:    6412756 kB ->  KReclaimable:    6412712 kB =   -44 kB
Slab:            7294700 kB ->  Slab:            7294844 kB =   144 kB
SReclaimable:    6412756 kB ->  SReclaimable:    6412712 kB =   -44 kB
SUnreclaim:       881944 kB ->  SUnreclaim:       882132 kB =   188 kB
KernelStack:       71120 kB ->  KernelStack:       71616 kB =   496 kB
PageTables:       225088 kB ->  PageTables:       231384 kB =   6296 kB
SecPageTables:         0 kB ->  SecPageTables:         0 kB =   0 kB
NFS_Unstable:          0 kB ->  NFS_Unstable:          0 kB =   0 kB
Bounce:                0 kB ->  Bounce:                0 kB =   0 kB
WritebackTmp:          0 kB ->  WritebackTmp:          0 kB =   0 kB
CommitLimit:    32752020 kB ->  CommitLimit:    32752020 kB =   0 kB
Committed_AS:   60544980 kB ->  Committed_AS:   63709784 kB =   3164804 kB
VmallocTotal:   34359738367 kB  ->  VmallocTotal:   34359738367 kB  =   0 kB
VmallocUsed:      220980 kB ->  VmallocUsed:      221204 kB =   224 kB
VmallocChunk:          0 kB ->  VmallocChunk:          0 kB =   0 kB
Percpu:            30400 kB ->  Percpu:            30400 kB =   0 kB
HardwareCorrupted:     0 kB ->  HardwareCorrupted:     0 kB =   0 kB
AnonHugePages:         0 kB ->  AnonHugePages:         0 kB =   0 kB
ShmemHugePages:  2027520 kB ->  ShmemHugePages:  2027520 kB =   0 kB
ShmemPmdMapped:        0 kB ->  ShmemPmdMapped:        0 kB =   0 kB
FileHugePages:         0 kB ->  FileHugePages:         0 kB =   0 kB
FilePmdMapped:         0 kB ->  FilePmdMapped:         0 kB =   0 kB
Unaccepted:            0 kB ->  Unaccepted:            0 kB =   0 kB
HugePages_Total:       0    ->  HugePages_Total:       0    =   0 
HugePages_Free:        0    ->  HugePages_Free:        0    =   0 
HugePages_Rsvd:        0    ->  HugePages_Rsvd:        0    =   0 
HugePages_Surp:        0    ->  HugePages_Surp:        0    =   0 
Hugepagesize:       2048 kB ->  Hugepagesize:       2048 kB =   0 kB
Hugetlb:               0 kB ->  Hugetlb:               0 kB =   0 kB
DirectMap4k:      606196 kB ->  DirectMap4k:      606196 kB =   0 kB
DirectMap2M:    18972672 kB ->  DirectMap2M:    18972672 kB =   0 kB
DirectMap1G:    47185920 kB ->  DirectMap1G:    47185920 kB =   0 kB
3.27user 3.62system 0:02.26elapsed 305%CPU (0avgtext+0avgdata 2821744maxresident)k
1919368inputs+928512outputs (3406major+702981minor)pagefaults 0swaps
259:0 rbytes=982728704 wbytes=0 rios=9142 wios=1 dbytes=0 dios=0
252:0 rbytes=982728704 wbytes=475381760 rios=4873 wios=496 dbytes=0 dios=0
252:1 rbytes=982728704 wbytes=475348992 rios=4873 wios=459 dbytes=0 dios=0
===
=== ./prefetch run -dir foo -prefetch=true -hit=false
Running as unit: run-raa0700d2f802454aa780b136b65e87a6.scope; invocation ID: d389cfe1dac547a5838b3ed063b48c2c
badger 2024/10/08 16:03:12 INFO: All 23 tables opened in 16ms
badger 2024/10/08 16:03:12 INFO: Discard stats nextEmptySlot: 0
badger 2024/10/08 16:03:12 INFO: Set nextTxnTs to 9900
badger 2024/10/08 16:03:12 INFO: Deleting empty file: foo/000002.vlog
2024/10/08 16:03:14 0 values read
MemTotal:       65504044 kB ->  MemTotal:       65504044 kB =   0 kB
MemFree:        20327036 kB ->  MemFree:        19466300 kB =   -860736 kB
MemAvailable:   29297348 kB ->  MemAvailable:   29432016 kB =   134668 kB
Buffers:            2512 kB ->  Buffers:            3148 kB =   636 kB
Cached:          7241264 kB ->  Cached:          8236204 kB =   994940 kB
SwapCached:            0 kB ->  SwapCached:            0 kB =   0 kB
Active:         25057228 kB ->  Active:         26118428 kB =   1061200 kB
Inactive:        9636044 kB ->  Inactive:        9657340 kB =   21296 kB
Active(anon):   22505064 kB ->  Active(anon):   22592156 kB =   87092 kB
Inactive(anon):  8898336 kB ->  Inactive(anon):  8898336 kB =   0 kB
Active(file):    2552164 kB ->  Active(file):    3526272 kB =   974108 kB
Inactive(file):   737708 kB ->  Inactive(file):   759004 kB =   21296 kB
Unevictable:     2174072 kB ->  Unevictable:     2174136 kB =   64 kB
Mlocked:             480 kB ->  Mlocked:             480 kB =   0 kB
SwapTotal:             0 kB ->  SwapTotal:             0 kB =   0 kB
SwapFree:              0 kB ->  SwapFree:              0 kB =   0 kB
Zswap:                 0 kB ->  Zswap:                 0 kB =   0 kB
Zswapped:              0 kB ->  Zswapped:              0 kB =   0 kB
Dirty:             11060 kB ->  Dirty:              8396 kB =   -2664 kB
Writeback:             0 kB ->  Writeback:            84 kB =   84 kB
AnonPages:      29623668 kB ->  AnonPages:      29710896 kB =   87228 kB
Mapped:          3496712 kB ->  Mapped:          4086592 kB =   589880 kB
Shmem:           4089472 kB ->  Shmem:           4089536 kB =   64 kB
KReclaimable:    6412648 kB ->  KReclaimable:    6412648 kB =   0 kB
Slab:            7294848 kB ->  Slab:            7294872 kB =   24 kB
SReclaimable:    6412648 kB ->  SReclaimable:    6412648 kB =   0 kB
SUnreclaim:       882200 kB ->  SUnreclaim:       882224 kB =   24 kB
KernelStack:       71344 kB ->  KernelStack:       71488 kB =   144 kB
PageTables:       225132 kB ->  PageTables:       227560 kB =   2428 kB
SecPageTables:         0 kB ->  SecPageTables:         0 kB =   0 kB
NFS_Unstable:          0 kB ->  NFS_Unstable:          0 kB =   0 kB
Bounce:                0 kB ->  Bounce:                0 kB =   0 kB
WritebackTmp:          0 kB ->  WritebackTmp:          0 kB =   0 kB
CommitLimit:    32752020 kB ->  CommitLimit:    32752020 kB =   0 kB
Committed_AS:   60553268 kB ->  Committed_AS:   60780308 kB =   227040 kB
VmallocTotal:   34359738367 kB  ->  VmallocTotal:   34359738367 kB  =   0 kB
VmallocUsed:      220964 kB ->  VmallocUsed:      221060 kB =   96 kB
VmallocChunk:          0 kB ->  VmallocChunk:          0 kB =   0 kB
Percpu:            30400 kB ->  Percpu:            30400 kB =   0 kB
HardwareCorrupted:     0 kB ->  HardwareCorrupted:     0 kB =   0 kB
AnonHugePages:         0 kB ->  AnonHugePages:         0 kB =   0 kB
ShmemHugePages:  2027520 kB ->  ShmemHugePages:  2027520 kB =   0 kB
ShmemPmdMapped:        0 kB ->  ShmemPmdMapped:        0 kB =   0 kB
FileHugePages:         0 kB ->  FileHugePages:         0 kB =   0 kB
FilePmdMapped:         0 kB ->  FilePmdMapped:         0 kB =   0 kB
Unaccepted:            0 kB ->  Unaccepted:            0 kB =   0 kB
HugePages_Total:       0    ->  HugePages_Total:       0    =   0 
HugePages_Free:        0    ->  HugePages_Free:        0    =   0 
HugePages_Rsvd:        0    ->  HugePages_Rsvd:        0    =   0 
HugePages_Surp:        0    ->  HugePages_Surp:        0    =   0 
Hugepagesize:       2048 kB ->  Hugepagesize:       2048 kB =   0 kB
Hugetlb:               0 kB ->  Hugetlb:               0 kB =   0 kB
DirectMap4k:      606196 kB ->  DirectMap4k:      606196 kB =   0 kB
DirectMap2M:    18972672 kB ->  DirectMap2M:    18972672 kB =   0 kB
DirectMap1G:    47185920 kB ->  DirectMap1G:    47185920 kB =   0 kB
0.23user 0.67system 0:02.28elapsed 39%CPU (0avgtext+0avgdata 684800maxresident)k
1910000inputs+48outputs (4577major+28910minor)pagefaults 0swaps
259:0 rbytes=977932288 wbytes=0 rios=9370 wios=0 dbytes=0 dios=0
252:0 rbytes=977932288 wbytes=12288 rios=4869 wios=3 dbytes=0 dios=0
252:1 rbytes=977932288 wbytes=0 rios=4869 wios=0 dbytes=0 dios=0
===
=== ./prefetch run -dir foo -prefetch=hybrid -hit=false
Running as unit: run-r8b38f0d796a54510a978b4a6bcb05261.scope; invocation ID: f9e03aa1d65c4711bd711bd9985f1b1a
badger 2024/10/08 16:03:17 INFO: All 23 tables opened in 16ms
badger 2024/10/08 16:03:17 INFO: Discard stats nextEmptySlot: 0
badger 2024/10/08 16:03:17 INFO: Set nextTxnTs to 9900
badger 2024/10/08 16:03:17 INFO: Deleting empty file: foo/000003.vlog
2024/10/08 16:03:20 0 values read
MemTotal:       65504044 kB ->  MemTotal:       65504044 kB =   0 kB
MemFree:        20450492 kB ->  MemFree:        19509844 kB =   -940648 kB
MemAvailable:   29411416 kB ->  MemAvailable:   29447380 kB =   35964 kB
Buffers:            2120 kB ->  Buffers:            5480 kB =   3360 kB
Cached:          7232904 kB ->  Cached:          8206044 kB =   973140 kB
SwapCached:            0 kB ->  SwapCached:            0 kB =   0 kB
Active:         25062076 kB ->  Active:         26112872 kB =   1050796 kB
Inactive:        9628380 kB ->  Inactive:        9645980 kB =   17600 kB
Active(anon):   22510724 kB ->  Active(anon):   22602548 kB =   91824 kB
Inactive(anon):  8898336 kB ->  Inactive(anon):  8898328 kB =   -8 kB
Active(file):    2551352 kB ->  Active(file):    3510324 kB =   958972 kB
Inactive(file):   730044 kB ->  Inactive(file):   747652 kB =   17608 kB
Unevictable:     2173560 kB ->  Unevictable:     2173624 kB =   64 kB
Mlocked:             480 kB ->  Mlocked:             480 kB =   0 kB
SwapTotal:             0 kB ->  SwapTotal:             0 kB =   0 kB
SwapFree:              0 kB ->  SwapFree:              0 kB =   0 kB
Zswap:                 0 kB ->  Zswap:                 0 kB =   0 kB
Zswapped:              0 kB ->  Zswapped:              0 kB =   0 kB
Dirty:              9384 kB ->  Dirty:              9460 kB =   76 kB
Writeback:             0 kB ->  Writeback:             0 kB =   0 kB
AnonPages:      29629452 kB ->  AnonPages:      29721256 kB =   91804 kB
Mapped:          3496648 kB ->  Mapped:          4085280 kB =   588632 kB
Shmem:           4088956 kB ->  Shmem:           4089024 kB =   68 kB
KReclaimable:    6411736 kB ->  KReclaimable:    6411768 kB =   32 kB
Slab:            7293660 kB ->  Slab:            7293864 kB =   204 kB
SReclaimable:    6411736 kB ->  SReclaimable:    6411768 kB =   32 kB
SUnreclaim:       881924 kB ->  SUnreclaim:       882096 kB =   172 kB
KernelStack:       71376 kB ->  KernelStack:       71504 kB =   128 kB
PageTables:       225184 kB ->  PageTables:       227376 kB =   2192 kB
SecPageTables:         0 kB ->  SecPageTables:         0 kB =   0 kB
NFS_Unstable:          0 kB ->  NFS_Unstable:          0 kB =   0 kB
Bounce:                0 kB ->  Bounce:                0 kB =   0 kB
WritebackTmp:          0 kB ->  WritebackTmp:          0 kB =   0 kB
CommitLimit:    32752020 kB ->  CommitLimit:    32752020 kB =   0 kB
Committed_AS:   60556624 kB ->  Committed_AS:   60780612 kB =   223988 kB
VmallocTotal:   34359738367 kB  ->  VmallocTotal:   34359738367 kB  =   0 kB
VmallocUsed:      220964 kB ->  VmallocUsed:      221156 kB =   192 kB
VmallocChunk:          0 kB ->  VmallocChunk:          0 kB =   0 kB
Percpu:            30400 kB ->  Percpu:            30400 kB =   0 kB
HardwareCorrupted:     0 kB ->  HardwareCorrupted:     0 kB =   0 kB
AnonHugePages:         0 kB ->  AnonHugePages:         0 kB =   0 kB
ShmemHugePages:  2027520 kB ->  ShmemHugePages:  2027520 kB =   0 kB
ShmemPmdMapped:        0 kB ->  ShmemPmdMapped:        0 kB =   0 kB
FileHugePages:         0 kB ->  FileHugePages:         0 kB =   0 kB
FilePmdMapped:         0 kB ->  FilePmdMapped:         0 kB =   0 kB
Unaccepted:            0 kB ->  Unaccepted:            0 kB =   0 kB
HugePages_Total:       0    ->  HugePages_Total:       0    =   0 
HugePages_Free:        0    ->  HugePages_Free:        0    =   0 
HugePages_Rsvd:        0    ->  HugePages_Rsvd:        0    =   0 
HugePages_Surp:        0    ->  HugePages_Surp:        0    =   0 
Hugepagesize:       2048 kB ->  Hugepagesize:       2048 kB =   0 kB
Hugetlb:               0 kB ->  Hugetlb:               0 kB =   0 kB
DirectMap4k:      606196 kB ->  DirectMap4k:      606196 kB =   0 kB
DirectMap2M:    18972672 kB ->  DirectMap2M:    18972672 kB =   0 kB
DirectMap1G:    47185920 kB ->  DirectMap1G:    47185920 kB =   0 kB
0.24user 0.65system 0:02.23elapsed 40%CPU (0avgtext+0avgdata 685568maxresident)k
1910256inputs+48outputs (4576major+28993minor)pagefaults 0swaps
259:0 rbytes=978063360 wbytes=0 rios=9373 wios=2 dbytes=0 dios=0
252:0 rbytes=978063360 wbytes=4096 rios=4872 wios=3 dbytes=0 dios=0
252:1 rbytes=978063360 wbytes=0 rios=4872 wios=2 dbytes=0 dios=0
===
=== ./prefetch run -dir foo -prefetch=false -hit=true
Running as unit: run-r1ce7e4207a0646b39771814d06d117f0.scope; invocation ID: 593df81350254301ae91d4f27e700984
badger 2024/10/08 16:03:23 INFO: All 23 tables opened in 17ms
badger 2024/10/08 16:03:23 INFO: Discard stats nextEmptySlot: 0
badger 2024/10/08 16:03:23 INFO: Set nextTxnTs to 9900
badger 2024/10/08 16:03:23 INFO: Deleting empty file: foo/000004.vlog
2024/10/08 16:03:26 891000 values read
MemTotal:       65504044 kB ->  MemTotal:       65504044 kB =   0 kB
MemFree:        20385544 kB ->  MemFree:        18899808 kB =   -1485736 kB
MemAvailable:   29371420 kB ->  MemAvailable:   28872384 kB =   -499036 kB
Buffers:            1692 kB ->  Buffers:            2628 kB =   936 kB
Cached:          7258548 kB ->  Cached:          8244324 kB =   985776 kB
SwapCached:            0 kB ->  SwapCached:            0 kB =   0 kB
Active:         25073852 kB ->  Active:         26724932 kB =   1651080 kB
Inactive:        9641376 kB ->  Inactive:        9648540 kB =   7164 kB
Active(anon):   22510648 kB ->  Active(anon):   23182192 kB =   671544 kB
Inactive(anon):  8898328 kB ->  Inactive(anon):  8898328 kB =   0 kB
Active(file):    2563204 kB ->  Active(file):    3542740 kB =   979536 kB
Inactive(file):   743048 kB ->  Inactive(file):   750212 kB =   7164 kB
Unevictable:     2174136 kB ->  Unevictable:     2174136 kB =   0 kB
Mlocked:             480 kB ->  Mlocked:             480 kB =   0 kB
SwapTotal:             0 kB ->  SwapTotal:             0 kB =   0 kB
SwapFree:              0 kB ->  SwapFree:              0 kB =   0 kB
Zswap:                 0 kB ->  Zswap:                 0 kB =   0 kB
Zswapped:              0 kB ->  Zswapped:              0 kB =   0 kB
Dirty:             10316 kB ->  Dirty:             10196 kB =   -120 kB
Writeback:             0 kB ->  Writeback:             0 kB =   0 kB
AnonPages:      29629316 kB ->  AnonPages:      30300944 kB =   671628 kB
Mapped:          3496908 kB ->  Mapped:          4463228 kB =   966320 kB
Shmem:           4089536 kB ->  Shmem:           4089536 kB =   0 kB
KReclaimable:    6411832 kB ->  KReclaimable:    6411832 kB =   0 kB
Slab:            7293996 kB ->  Slab:            7294296 kB =   300 kB
SReclaimable:    6411832 kB ->  SReclaimable:    6411832 kB =   0 kB
SUnreclaim:       882164 kB ->  SUnreclaim:       882464 kB =   300 kB
KernelStack:       71280 kB ->  KernelStack:       71696 kB =   416 kB
PageTables:       225132 kB ->  PageTables:       228892 kB =   3760 kB
SecPageTables:         0 kB ->  SecPageTables:         0 kB =   0 kB
NFS_Unstable:          0 kB ->  NFS_Unstable:          0 kB =   0 kB
Bounce:                0 kB ->  Bounce:                0 kB =   0 kB
WritebackTmp:          0 kB ->  WritebackTmp:          0 kB =   0 kB
CommitLimit:    32752020 kB ->  CommitLimit:    32752020 kB =   0 kB
Committed_AS:   60556696 kB ->  Committed_AS:   61432544 kB =   875848 kB
VmallocTotal:   34359738367 kB  ->  VmallocTotal:   34359738367 kB  =   0 kB
VmallocUsed:      221012 kB ->  VmallocUsed:      221316 kB =   304 kB
VmallocChunk:          0 kB ->  VmallocChunk:          0 kB =   0 kB
Percpu:            30400 kB ->  Percpu:            30400 kB =   0 kB
HardwareCorrupted:     0 kB ->  HardwareCorrupted:     0 kB =   0 kB
AnonHugePages:         0 kB ->  AnonHugePages:         0 kB =   0 kB
ShmemHugePages:  2027520 kB ->  ShmemHugePages:  2027520 kB =   0 kB
ShmemPmdMapped:        0 kB ->  ShmemPmdMapped:        0 kB =   0 kB
FileHugePages:         0 kB ->  FileHugePages:         0 kB =   0 kB
FilePmdMapped:         0 kB ->  FilePmdMapped:         0 kB =   0 kB
Unaccepted:            0 kB ->  Unaccepted:            0 kB =   0 kB
HugePages_Total:       0    ->  HugePages_Total:       0    =   0 
HugePages_Free:        0    ->  HugePages_Free:        0    =   0 
HugePages_Rsvd:        0    ->  HugePages_Rsvd:        0    =   0 
HugePages_Surp:        0    ->  HugePages_Surp:        0    =   0 
Hugepagesize:       2048 kB ->  Hugepagesize:       2048 kB =   0 kB
Hugetlb:               0 kB ->  Hugetlb:               0 kB =   0 kB
DirectMap4k:      606196 kB ->  DirectMap4k:      606196 kB =   0 kB
DirectMap2M:    18972672 kB ->  DirectMap2M:    18972672 kB =   0 kB
DirectMap1G:    47185920 kB ->  DirectMap1G:    47185920 kB =   0 kB
3.47user 1.20system 0:03.23elapsed 144%CPU (0avgtext+0avgdata 1651416maxresident)k
1954264inputs+48outputs (1076major+192704minor)pagefaults 0swaps
259:0 rbytes=1000595456 wbytes=0 rios=8551 wios=2 dbytes=0 dios=0
252:0 rbytes=1000595456 wbytes=4096 rios=4842 wios=3 dbytes=0 dios=0
252:1 rbytes=1000595456 wbytes=0 rios=4842 wios=2 dbytes=0 dios=0
===
=== ./prefetch run -dir foo -prefetch=true -hit=true
Running as unit: run-r08eba68bbcd84497b0c1ef680bef2657.scope; invocation ID: b8dd923d6aa440e7ac0c62bccebeae54
badger 2024/10/08 16:03:29 INFO: All 23 tables opened in 18ms
badger 2024/10/08 16:03:29 INFO: Discard stats nextEmptySlot: 0
badger 2024/10/08 16:03:29 INFO: Set nextTxnTs to 9900
badger 2024/10/08 16:03:29 INFO: Deleting empty file: foo/000005.vlog
2024/10/08 16:03:34 891000 values read
MemTotal:       65504044 kB ->  MemTotal:       65504044 kB =   0 kB
MemFree:        20364824 kB ->  MemFree:        18849172 kB =   -1515652 kB
MemAvailable:   29344988 kB ->  MemAvailable:   28889604 kB =   -455384 kB
Buffers:            4884 kB ->  Buffers:            6364 kB =   1480 kB
Cached:          7249172 kB ->  Cached:          8309048 kB =   1059876 kB
SwapCached:            0 kB ->  SwapCached:            0 kB =   0 kB
Active:         25076068 kB ->  Active:         26738604 kB =   1662536 kB
Inactive:        9634468 kB ->  Inactive:        9709140 kB =   74672 kB
Active(anon):   22511888 kB ->  Active(anon):   23188836 kB =   676948 kB
Inactive(anon):  8898328 kB ->  Inactive(anon):  8898328 kB =   0 kB
Active(file):    2564180 kB ->  Active(file):    3549768 kB =   985588 kB
Inactive(file):   736140 kB ->  Inactive(file):   810812 kB =   74672 kB
Unevictable:     2174008 kB ->  Unevictable:     2174680 kB =   672 kB
Mlocked:             480 kB ->  Mlocked:             480 kB =   0 kB
SwapTotal:             0 kB ->  SwapTotal:             0 kB =   0 kB
SwapFree:              0 kB ->  SwapFree:              0 kB =   0 kB
Zswap:                 0 kB ->  Zswap:                 0 kB =   0 kB
Zswapped:              0 kB ->  Zswapped:              0 kB =   0 kB
Dirty:             11672 kB ->  Dirty:              4596 kB =   -7076 kB
Writeback:            56 kB ->  Writeback:             0 kB =   -56 kB
AnonPages:      29631096 kB ->  AnonPages:      30307516 kB =   676420 kB
Mapped:          3508012 kB ->  Mapped:          4463456 kB =   955444 kB
Shmem:           4089372 kB ->  Shmem:           4090044 kB =   672 kB
KReclaimable:    6412052 kB ->  KReclaimable:    6412060 kB =   8 kB
Slab:            7294080 kB ->  Slab:            7294332 kB =   252 kB
SReclaimable:    6412052 kB ->  SReclaimable:    6412060 kB =   8 kB
SUnreclaim:       882028 kB ->  SUnreclaim:       882272 kB =   244 kB
KernelStack:       71648 kB ->  KernelStack:       71568 kB =   -80 kB
PageTables:       225256 kB ->  PageTables:       228612 kB =   3356 kB
SecPageTables:         0 kB ->  SecPageTables:         0 kB =   0 kB
NFS_Unstable:          0 kB ->  NFS_Unstable:          0 kB =   0 kB
Bounce:                0 kB ->  Bounce:                0 kB =   0 kB
WritebackTmp:          0 kB ->  WritebackTmp:          0 kB =   0 kB
CommitLimit:    32752020 kB ->  CommitLimit:    32752020 kB =   0 kB
Committed_AS:   60563312 kB ->  Committed_AS:   61439064 kB =   875752 kB
VmallocTotal:   34359738367 kB  ->  VmallocTotal:   34359738367 kB  =   0 kB
VmallocUsed:      221244 kB ->  VmallocUsed:      221172 kB =   -72 kB
VmallocChunk:          0 kB ->  VmallocChunk:          0 kB =   0 kB
Percpu:            30400 kB ->  Percpu:            30400 kB =   0 kB
HardwareCorrupted:     0 kB ->  HardwareCorrupted:     0 kB =   0 kB
AnonHugePages:         0 kB ->  AnonHugePages:         0 kB =   0 kB
ShmemHugePages:  2027520 kB ->  ShmemHugePages:  2027520 kB =   0 kB
ShmemPmdMapped:        0 kB ->  ShmemPmdMapped:        0 kB =   0 kB
FileHugePages:         0 kB ->  FileHugePages:         0 kB =   0 kB
FilePmdMapped:         0 kB ->  FilePmdMapped:         0 kB =   0 kB
Unaccepted:            0 kB ->  Unaccepted:            0 kB =   0 kB
HugePages_Total:       0    ->  HugePages_Total:       0    =   0 
HugePages_Free:        0    ->  HugePages_Free:        0    =   0 
HugePages_Rsvd:        0    ->  HugePages_Rsvd:        0    =   0 
HugePages_Surp:        0    ->  HugePages_Surp:        0    =   0 
Hugepagesize:       2048 kB ->  Hugepagesize:       2048 kB =   0 kB
Hugetlb:               0 kB ->  Hugetlb:               0 kB =   0 kB
DirectMap4k:      606196 kB ->  DirectMap4k:      606196 kB =   0 kB
DirectMap2M:    18972672 kB ->  DirectMap2M:    18972672 kB =   0 kB
DirectMap1G:    47185920 kB ->  DirectMap1G:    47185920 kB =   0 kB
9.11user 1.87system 0:04.78elapsed 229%CPU (0avgtext+0avgdata 1661132maxresident)k
1954440inputs+48outputs (1096major+194752minor)pagefaults 0swaps
259:0 rbytes=1000685568 wbytes=0 rios=8552 wios=2 dbytes=0 dios=0
252:0 rbytes=1000685568 wbytes=4096 rios=4843 wios=3 dbytes=0 dios=0
252:1 rbytes=1000685568 wbytes=8192 rios=4843 wios=4 dbytes=0 dios=0
===
=== ./prefetch run -dir foo -prefetch=hybrid -hit=true
Running as unit: run-r0364b19dc8244a95b8afa51a0314a381.scope; invocation ID: 8eb21e495547444697b48c4c282ebecf
badger 2024/10/08 16:03:37 INFO: All 23 tables opened in 18ms
badger 2024/10/08 16:03:37 INFO: Discard stats nextEmptySlot: 0
badger 2024/10/08 16:03:37 INFO: Set nextTxnTs to 9900
badger 2024/10/08 16:03:37 INFO: Deleting empty file: foo/000006.vlog
2024/10/08 16:03:42 891000 values read
MemTotal:       65504044 kB ->  MemTotal:       65504044 kB =   0 kB
MemFree:        20436900 kB ->  MemFree:        18886788 kB =   -1550112 kB
MemAvailable:   29397620 kB ->  MemAvailable:   28888188 kB =   -509432 kB
Buffers:            4656 kB ->  Buffers:            7416 kB =   2760 kB
Cached:          7229584 kB ->  Cached:          8267388 kB =   1037804 kB
SwapCached:            0 kB ->  SwapCached:            0 kB =   0 kB
Active:         25054920 kB ->  Active:         26738068 kB =   1683148 kB
Inactive:        9633080 kB ->  Inactive:        9672940 kB =   39860 kB
Active(anon):   22508760 kB ->  Active(anon):   23191112 kB =   682352 kB
Inactive(anon):  8898328 kB ->  Inactive(anon):  8898328 kB =   0 kB
Active(file):    2546160 kB ->  Active(file):    3546956 kB =   1000796 kB
Inactive(file):   734752 kB ->  Inactive(file):   774612 kB =   39860 kB
Unevictable:     2173656 kB ->  Unevictable:     2173592 kB =   -64 kB
Mlocked:             480 kB ->  Mlocked:             480 kB =   0 kB
SwapTotal:             0 kB ->  SwapTotal:             0 kB =   0 kB
SwapFree:              0 kB ->  SwapFree:              0 kB =   0 kB
Zswap:                 0 kB ->  Zswap:                 0 kB =   0 kB
Zswapped:              0 kB ->  Zswapped:              0 kB =   0 kB
Dirty:              6120 kB ->  Dirty:               660 kB =   -5460 kB
Writeback:             0 kB ->  Writeback:             0 kB =   0 kB
AnonPages:      29627624 kB ->  AnonPages:      30309856 kB =   682232 kB
Mapped:          3496352 kB ->  Mapped:          4469572 kB =   973220 kB
Shmem:           4089016 kB ->  Shmem:           4088956 kB =   -60 kB
KReclaimable:    6412016 kB ->  KReclaimable:    6412040 kB =   24 kB
Slab:            7293820 kB ->  Slab:            7294412 kB =   592 kB
SReclaimable:    6412016 kB ->  SReclaimable:    6412040 kB =   24 kB
SUnreclaim:       881804 kB ->  SUnreclaim:       882372 kB =   568 kB
KernelStack:       71296 kB ->  KernelStack:       71584 kB =   288 kB
PageTables:       225048 kB ->  PageTables:       228624 kB =   3576 kB
SecPageTables:         0 kB ->  SecPageTables:         0 kB =   0 kB
NFS_Unstable:          0 kB ->  NFS_Unstable:          0 kB =   0 kB
Bounce:                0 kB ->  Bounce:                0 kB =   0 kB
WritebackTmp:          0 kB ->  WritebackTmp:          0 kB =   0 kB
CommitLimit:    32752020 kB ->  CommitLimit:    32752020 kB =   0 kB
Committed_AS:   60567996 kB ->  Committed_AS:   61522548 kB =   954552 kB
VmallocTotal:   34359738367 kB  ->  VmallocTotal:   34359738367 kB  =   0 kB
VmallocUsed:      220996 kB ->  VmallocUsed:      221236 kB =   240 kB
VmallocChunk:          0 kB ->  VmallocChunk:          0 kB =   0 kB
Percpu:            30400 kB ->  Percpu:            30400 kB =   0 kB
HardwareCorrupted:     0 kB ->  HardwareCorrupted:     0 kB =   0 kB
AnonHugePages:         0 kB ->  AnonHugePages:         0 kB =   0 kB
ShmemHugePages:  2027520 kB ->  ShmemHugePages:  2027520 kB =   0 kB
ShmemPmdMapped:        0 kB ->  ShmemPmdMapped:        0 kB =   0 kB
FileHugePages:         0 kB ->  FileHugePages:         0 kB =   0 kB
FilePmdMapped:         0 kB ->  FilePmdMapped:         0 kB =   0 kB
Unaccepted:            0 kB ->  Unaccepted:            0 kB =   0 kB
HugePages_Total:       0    ->  HugePages_Total:       0    =   0 
HugePages_Free:        0    ->  HugePages_Free:        0    =   0 
HugePages_Rsvd:        0    ->  HugePages_Rsvd:        0    =   0 
HugePages_Surp:        0    ->  HugePages_Surp:        0    =   0 
Hugepagesize:       2048 kB ->  Hugepagesize:       2048 kB =   0 kB
Hugetlb:               0 kB ->  Hugetlb:               0 kB =   0 kB
DirectMap4k:      606196 kB ->  DirectMap4k:      606196 kB =   0 kB
DirectMap2M:    18972672 kB ->  DirectMap2M:    18972672 kB =   0 kB
DirectMap1G:    47185920 kB ->  DirectMap1G:    47185920 kB =   0 kB
9.50user 1.96system 0:04.95elapsed 231%CPU (0avgtext+0avgdata 1658384maxresident)k
1954280inputs+48outputs (1093major+194520minor)pagefaults 0swaps
259:0 rbytes=1000603648 wbytes=0 rios=8553 wios=2 dbytes=0 dios=0
252:0 rbytes=1000603648 wbytes=4096 rios=4844 wios=3 dbytes=0 dios=0
252:1 rbytes=1000603648 wbytes=8192 rios=4844 wios=4 dbytes=0 dios=0
===