search

pmwkaa / ioarena

Embedded storage benchmarking tool
Other
132 stars 24 forks source link

error: Corruption: not an sstable (bad magic number) #4

Closed yannick closed 8 years ago

yannick commented 8 years ago

i consistently get 

error: Corruption: not an sstable (bad magic number)

with leveldb if -n is high enough.

# ./ioarena -n 4000000 -T set -D leveldb          

IOARENA (embedded storage benchmarking)

configuration:
  database:   leveldb
  output:     ./_ioarena
  benchmark:  set
  operations: 4000000
  key size:   16
  value size: 32

<<>> leveldb.set
0.1M   8.77 mb/sec
0.2M   9.85 mb/sec
0.3M   9.57 mb/sec
0.4M   9.22 mb/sec
0.5M   9.64 mb/sec
0.6M   9.26 mb/sec
0.7M   9.73 mb/sec
0.8M   9.30 mb/sec
0.9M   9.01 mb/sec
1.0M   9.17 mb/sec
error: Corruption: not an sstable (bad magic number)
☁  src [master] ⚡ ldd ioarena 
        linux-vdso.so.1 (0x00007fffe2d6b000)
        libleveldb.so.1 => /usr/lib/libleveldb.so.1 (0x00007f8725e8f000)
        librocksdb.so.3.13 => /usr/lib/librocksdb.so.3.13 (0x00007f8725989000)
        libsophia.so => /usr/lib/libsophia.so (0x00007f8725737000)
        libwiredtiger-2.7.0.so => /usr/lib/libwiredtiger-2.7.0.so (0x00007f8725414000)
        libm.so.6 => /usr/lib/libm.so.6 (0x00007f8725116000)
        libpthread.so.0 => /usr/lib/libpthread.so.0 (0x00007f8724ef9000)
        libc.so.6 => /usr/lib/libc.so.6 (0x00007f8724b55000)
        libsnappy.so.1 => /usr/lib/libsnappy.so.1 (0x00007f872494d000)
        libtcmalloc.so.4 => /usr/lib/libtcmalloc.so.4 (0x00007f87246d8000)
        libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x00007f8724356000)
        libgcc_s.so.1 => /usr/lib/libgcc_s.so.1 (0x00007f8724140000)
        librt.so.1 => /usr/lib/librt.so.1 (0x00007f8723f38000)
        libz.so.1 => /usr/lib/libz.so.1 (0x00007f8723d22000)
        libbz2.so.1.0 => /usr/lib/libbz2.so.1.0 (0x00007f8723b12000)
        liblz4.so.1 => /usr/lib/liblz4.so.1 (0x00007f8723900000)
        libjemalloc.so.2 => /usr/lib/libjemalloc.so.2 (0x00007f87236c2000)
        /lib64/ld-linux-x86-64.so.2 (0x00007f87260ed000)
        libdl.so.2 => /usr/lib/libdl.so.2 (0x00007f87234be000)
☁  src [master] ⚡ pacman -Q leveldb
leveldb 1.18-2
☁  src [master] ⚡
erthink commented 8 years ago

@yannick, could you try https://github.com/ReOpen/ioarena2, but the ./ioarena -n 4000000 -B set -D leveldb ?

yannick commented 8 years ago

ioarena2 works, thanks