search

breuner / elbencho

A distributed storage benchmark for file systems, object stores & block devices with support for GPUs
GNU General Public License v3.0
169 stars 25 forks source link

Issue generating charts using "ISO date" for x-axis #32

Closed rhugga closed 2 years ago

rhugga commented 2 years ago

I'm running a benchmark every 15 minutes using the exact same parameters and writing all results to the same file. Once a day I want to chart the previous day's data, plotting READ/WRITE throughput vs. time of day.

Here is a sample of my datafile:

2022-04-10T23:49:48+0000,,bucket,1,1,1,1,1,10737418240,134217728,0,0,,1,,0,WRITE,286522,286522,0,0,0,0,35,35,4,4,1,1,10240,10240,286516564,286516564,286516564,1986196,3558061,7762379,,,,,,,,,,,,,,,,,2.1-0,"elbencho" "--s3endpoints" "https://s3.example.com/" "--s3key" "REDACTED" "--s3secret" "REDACTED" "--delfiles" "--threads" "1" "--dirs" "1" "--files" "1" "--size" "10737418240" "--block" "134217728" "--write" "--read" "--lat" "--cpu" "--allelapsed" "--s3objprefix" "crontest.6385" "--s3nompcheck" "--csvfile" "20220410.csv" "storage-eng-dev"
2022-04-10T23:52:52+0000,,bucket,1,1,1,1,1,10737418240,134217728,0,0,,1,,0,READ,183317,183317,0,0,0,0,55,55,5,5,1,1,10240,10240,183311998,183311998,183311998,809746,2291385,5135635,,,,,,,,,,,,,,,,,2.1-0,"elbencho" "--s3endpoints" "https://s3.example.com/" "--s3key" "REDACTED" "--s3secret" "REDACTED" "--delfiles" "--threads" "1" "--dirs" "1" "--files" "1" "--size" "10737418240" "--block" "134217728" "--write" "--read" "--lat" "--cpu" "--allelapsed" "--s3objprefix" "crontest.6385" "--s3nompcheck" "--csvfile" "20220410.csv" "storage-eng-dev"
2022-04-10T23:52:52+0000,,bucket,1,1,1,1,1,10737418240,134217728,0,0,,1,,0,RMFILES,233,233,4,4,,,,,3,3,1,1,,,227680,227680,227680,,,,,,,,,,,,,,,,,,,,2.1-0,"elbencho" "--s3endpoints" "https://s3.example.com/" "--s3key" "REDACTED" "--s3secret" "REDACTED" "--delfiles" "--threads" "1" "--dirs" "1" "--files" "1" "--size" "10737418240" "--block" "134217728" "--write" "--read" "--lat" "--cpu" "--allelapsed" "--s3objprefix" "crontest.6385" "--s3nompcheck" "--csvfile" "20220410.csv" "storage-eng-dev"

And the error I'm getting:

charting data from 20220410.csv

gnuplot> set xtics ('2022-04-10T00:04:32+0000' 0, '2022-04-10T00:22:49+0000' 1, '2022-04-10T00:36:43+0000' 2, '2022-04-10T00:49:24+0000' 3, '2022-04-10T01:06:46+0000' 4, '2022-04-10T01:22:28+0000' 5, '2022-04-10T01:36:14+0000' 6, '2022-04-10T01:49:01+0000' 7, '2022-04-10T02:06:34+0000' 8, '2022-04-10T02:21:59+0000' 9, '2022-04-10T02:33:47+0000' 10, '2022-04-10T02:50:05+0000' 11, '2022-04-10T03:03:55+0000' 12, '2022-04-10T03:23:05+0000' 13, '2022-04-10T03:33:41+0000' 14, '2022-04-10T03:50:01+0000' 15, '2022-04-10T04:04:28+0000' 16, '2022-04-10T04:23:32+0000' 17, '2022-04-10T04:34:20+0000' 18, '2022-04-10T04:49:54+0000' 19, '2022-04-10T05:04:52+0000' 20, '2022-04-10T05:24:26+0000' 21, '2022-04-10T05:36:23+0000' 22, '2022-04-10T05:51:14+0000' 23, '2022-04-10T06:04:30+0000' 24, '2022-04-10T06:22:24+0000' 25, '2022-04-10T06:35:08+0000' 26, '2022-04-10T06:51:42+0000' 27, '2022-04-10T07:05:46+0000' 28, '2022-04-10T07:22:30+0000' 29, '2022-04-10T07:33:49+0000' 30, '2022-04-10T07:49:09+0000' 31, '2022-04-10T08:03:46+0000' 32, '2022-04-10T08:24:30+0000' 33, '2022-04-10T08:35:21+0000' 34, '2022-04-10T08:50:00+0000' 35, '2022-04-10T09:04:21+0000' 36, '2022-04-10T09:24:25+0000' 37, '2022-04-10T09:34:25+0000' 38, '2022-04-10T09:49:30+0000' 39, '2022-04-10T10:05:27+0000' 40, '2022-04-10T10:24:43+0000' 41, '2022-04-10T10:35:19+0000' 42, '2022-04-10T10:50:23+0000' 43, '2022-04-10T11:04:44+0000' 44, '2022-04-10T11:24:12+0000' 45, '2022-04-10T11:36:44+0000' 46, '2022-04-10T11:51:44+0000' 47, '2022-04-10T12:05:18+0000' 48, '2022-04-10T12:22:24+0000' 49, '2022-04-10T12:35:33+0000' 50, '2022-04-10T12:50:38+0000' 51, '2022-04-10T13:06:37+0000' 52, '2022-04-10T13:23:13+0000' 53, '2022-04-10T13:34:07+0000' 54, '2022-04-10T13:49:12+0000' 55, '2022-04-10T14:04:29+0000' 56, '2022-04-10T14:21:56+0000' 57, '2022-04-10T14:34:48+0000' 58, '2022-04-10T14:49:54+0000' 59, '2022-04-10T15:05:11+0000' 60, '2022-04-10T15:24:16+0000' 61, '2022-04-10T15:34:04+0000' 62, '2022-04-10T15:51:13+0000' 63, '2022-04-10T16:04:26+0000' 64, '2022-04-10T16:24:37+0000' 65, '2022-04-10T16:36:17+0000' 66, '2022-04-10T16:51:41+0000' 67, '2022-04-10T17:04:45+0000' 68, '2022-04-10T17:24:05+0000' 69, '2022-04-10T17:34:17+0000' 70, '2022-04-10T17:51:34+0000' 71, '2022-04-10T18:05:50+0000' 72, '2022-04-10T18:22:26+0000' 73, '2022-04-10T18:36:46+0000' 74, '2022-04-10T18:49:38+0000' 75, '2022-04-10T19:04:52+0000' 76, '2022-04-10T19:22:35+0000' 77, '2022-04-10T19:34:41+0000' 78, '2022-04-10T19:51:18+0000' 79, '2022-04-10T20:06:39+0000' 80, '2022-04-10T20:22:54+0000' 81, '2022-04-10T20:33:57+0000' 82, '2022-04-10T20:48:33+0000' 83, '2022-04-10T21:04:16+0000' 84, '2022-04-10T21:23:24+0000' 85, '2022-04-10T21:34:27+0000' 86, '2022-04-10T21:51:21+0000' 87, '2022-04-10T22:05:20+0000' 88, '2022-04-10T22:22:36+0000' 89, '2022-04-10T22:34:14+0000' 90, '2022-04-10T22:49:31+0000' 91, '2022-04-10T23:04:46+0000' 92, '2022-04-10T23:22:09+0000' 93, '2022-04-10T23:34:29+0000' 94, '2022-04-10T23:49:48+0000' 95, ) rotate by 90 right
                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                          ^
         line 0: invalid expression

It looks like some kind of off-by-one type error where it expects another value or something.

Am I doing something wrong here or is this a bug?

Thanks, Chuck

breuner commented 2 years ago

Closing after email conversation with @rhugga