0728 test run

[h-w-chen]

part of 730 tests gaol: test 1M record load (each record value is 10KB)

test env

export NUM_OF_SI=5
export SI_INSTANCE_TYPE=t2.large
export RKV_INSTANCE_TYPE=t2.xlarge
export JAEGER_INSTANCE_TYPE=t2.xlarge
export JAEGER_ROOT_DISK_VOLUME=200
export YCSB_INSTANCE_TYPE=t2.large

test procedure (load only)

after the test lab has been set up, login to ycsb vm, cd work/go-ycsb, make change to workloads/workloada file, with following changes:

threadcount=2
fieldlength=1000
recordcount=1000000
operationcount=1000000
workload=core

then run ./bin/go-ycsb load rkv -P workloads/workloada

test result

Run finished, takes 1h9m37.403247648s
INSERT - Takes(s): 4177.4, Count: 999990, OPS: 239.4, Avg(us): 8113, Min(us): 4344, Max(us): 217343, 99th(us): 25071, 99.9th(us): 43391, 99.99th(us): 62943

other observations

• rkv service host took memory used 547MB;
• redis si each took memory ~4.3GB

[pdgetrf]

what did you use to measure memory usage?

[pdgetrf]

probably do 5M after this?

[h-w-chen]

just use free to look at the memery info. will start a 5M load test.

[h-w-chen]

5M load test aborted due to rkv crashed. error info is in #31

[pdgetrf]

We’ll do some investigation tomorrow. Thanks!

Get Outlook for iOShttps://aka.ms/o0ukef

---

From: hwchen @.> Sent: Thursday, July 28, 2022 11:10:35 PM To: CentaurusInfra/regionless-storage-service @.> Cc: Peng Du @.>; Comment @.> Subject: Re: [CentaurusInfra/regionless-storage-service] 0728 test run (Issue #30)

5M load test aborted due to rkv crashed. error info is in #31https://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FCentaurusInfra%2Fregionless-storage-service%2Fissues%2F31&data=05%7C01%7Cpdu%40futurewei.com%7Cf6e7b0faf09448976a6108da71290dec%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C0%7C637946718407039225%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=shACcpA9IfEKExdBYRS69DuJ6EjcwuYOYMPz0BuEHcw%3D&reserved=0

— Reply to this email directly, view it on GitHubhttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FCentaurusInfra%2Fregionless-storage-service%2Fissues%2F30%23issuecomment-1198916049&data=05%7C01%7Cpdu%40futurewei.com%7Cf6e7b0faf09448976a6108da71290dec%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C0%7C637946718407039225%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=kKDL5B6UTs6wfBtVlfCGtR%2FuFJ7jKWK%2FMz89MIACuRk%3D&reserved=0, or unsubscribehttps://nam11.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAAB5Q5D5KW7FZ4CKXSXABTDVWNYVXANCNFSM5466CBFA&data=05%7C01%7Cpdu%40futurewei.com%7Cf6e7b0faf09448976a6108da71290dec%7C0fee8ff2a3b240189c753a1d5591fedc%7C1%7C0%7C637946718407039225%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Nzm35vrs2Qb2JIxRpAyXwnIBak7a4zxJCSI37gGz1Aw%3D&reserved=0. You are receiving this because you commented.Message ID: @.***>

[h-w-chen]

closed; already passed the milestone