TritonDataCenter / manta-mlive

Manta liveness checker
Mozilla Public License 2.0
0 stars 3 forks source link

MANTA-4964 manta-mlive for buckets #11

Closed bahamas10 closed 4 years ago

bahamas10 commented 4 years ago

This also makes the "setup" phase happen concurrently which significantly speeds it up.

Example against directory manta:

$ ./bin/mlive 2
will stomp over directory at "/dave/stor/mlive"
will test for liveness: reads, writes
assuming 3 metadata shards
testing: directory manta
using base paths: /dave/stor/mlive
time between requests: 50 ms
maximum outstanding requests: 100
environment:
    MANTA_URL = https://bart:2345
    MANTA_USER = dave
    MANTA_KEY_ID = 35:8c:b7:b5:87:4b:35:48:93:24:4f:7c:39:56:df:f4
    MANTA_TLS_INSECURE = true
creating test tree ... (45/45)
done.
took 4.986s to initialize
2020-02-22T00:20:18.901Z: reads okay, writes okay (14/14 ok since start)
2020-02-22T00:20:21.901Z: all okay (59/59 ok since 2020-02-22T00:20:18.901Z)
2020-02-22T00:20:23.902Z: all okay (40/40 ok since 2020-02-22T00:20:21.901Z)
2020-02-22T00:20:25.904Z: all okay (39/39 ok since 2020-02-22T00:20:23.902Z)

Example against buckets manta:

$ ./bin/mlive -b 2
will test for liveness: reads, writes
assuming 3 metadata shards
testing: buckets
using buckets: mlive
time between requests: 50 ms
maximum outstanding requests: 100
environment:
    MANTA_URL = https://bart:2345
    MANTA_USER = dave
    MANTA_KEY_ID = 35:8c:b7:b5:87:4b:35:48:93:24:4f:7c:39:56:df:f4
    MANTA_TLS_INSECURE = true
creating test tree ... (45/45)
done.
took 2.217s to initialize
2020-02-22T00:20:45.558Z: reads okay, writes okay (14/14 ok since start)
2020-02-22T00:20:47.559Z: all okay (42/42 ok since 2020-02-22T00:20:45.558Z)
2020-02-22T00:20:49.560Z: all okay (39/39 ok since 2020-02-22T00:20:47.559Z)
2020-02-22T00:20:51.561Z: all okay (39/39 ok since 2020-02-22T00:20:49.560Z)
bahamas10 commented 4 years ago

@chudley with the code as written, calling mlive like mlive -b will only create 1 bucket. It will create 45 objects within that bucket, but only 1 bucket will be created by default.