search

flock-lab / flock

Flock: A Low-Cost Streaming Query Engine on FaaS Platforms
https://flock-lab.github.io/flock/
GNU Affero General Public License v3.0
291 stars 39 forks source link

feat: add flock watchlog tail #350

Closed gangliao closed 2 years ago

gangliao commented 2 years ago

Which issue does this PR close?

Closes #336

Rationale for this change

What changes are included in this PR?

Are there any user-facing changes?

By submitting this pull request

gangliao commented 2 years ago

Got the logs...

2021-12-11 14:19:18 START RequestId: 0c0bde1b-197f-45b7-83d4-2720f62e3406 Version: $LATEST

2021-12-11 14:19:19 Nexmark Benchmark: Query 1

2021-12-11 14:19:19 NexMarkSource { config: Config { args: {"seconds": "10", "events-per-second": "1000", "threads": "1"} }, window: ElementWise }

2021-12-11 14:19:19 [OK] Generate nexmark events.

2021-12-11 14:19:19 [OK] Send NexMark events (epoch: 0).

2021-12-11 14:19:19 Epoch 0: 20 persons, 60 auctions, 920 bids.

2021-12-11 14:19:19 [OK] Send 1 NexMark events from epoch 0 to function: q5-00-07.

2021-12-11 14:19:19 [OK] Event 0 - function payload bytes: 28980

2021-12-11 14:19:20 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }

2021-12-11 14:19:20 [OK] Send NexMark events (epoch: 1).

2021-12-11 14:19:20 Epoch 1: 20 persons, 60 auctions, 920 bids.

2021-12-11 14:19:20 [OK] Send 1 NexMark events from epoch 1 to function: q5-00-04.

2021-12-11 14:19:20 [OK] Event 0 - function payload bytes: 29558

2021-12-11 14:19:20 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }

2021-12-11 14:19:20 [OK] Send NexMark events (epoch: 2).

2021-12-11 14:19:20 Epoch 2: 20 persons, 60 auctions, 920 bids.

2021-12-11 14:19:20 [OK] Send 1 NexMark events from epoch 2 to function: q5-00-04.

2021-12-11 14:19:20 [OK] Event 0 - function payload bytes: 29113

2021-12-11 14:19:20 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }

2021-12-11 14:19:20 [OK] Send NexMark events (epoch: 3).

2021-12-11 14:19:20 Epoch 3: 20 persons, 60 auctions, 920 bids.

2021-12-11 14:19:20 [OK] Send 1 NexMark events from epoch 3 to function: q5-00-04.

2021-12-11 14:19:20 [OK] Event 0 - function payload bytes: 29726

2021-12-11 14:19:20 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }

2021-12-11 14:19:20 [OK] Send NexMark events (epoch: 4).

2021-12-11 14:19:20 Epoch 4: 20 persons, 60 auctions, 920 bids.

2021-12-11 14:19:20 [OK] Send 1 NexMark events from epoch 4 to function: q5-00-04.

2021-12-11 14:19:20 [OK] Event 0 - function payload bytes: 29787

2021-12-11 14:19:20 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }

2021-12-11 14:19:20 [OK] Send NexMark events (epoch: 5).

2021-12-11 14:19:20 Epoch 5: 20 persons, 60 auctions, 920 bids.

2021-12-11 14:19:20 [OK] Send 1 NexMark events from epoch 5 to function: q5-00-04.

2021-12-11 14:19:20 [OK] Event 0 - function payload bytes: 29378

2021-12-11 14:19:20 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }

2021-12-11 14:19:20 [OK] Send NexMark events (epoch: 6).

2021-12-11 14:19:20 Epoch 6: 20 persons, 60 auctions, 920 bids.

2021-12-11 14:19:20 [OK] Send 1 NexMark events from epoch 6 to function: q5-00-04.

2021-12-11 14:19:20 [OK] Event 0 - function payload bytes: 29307

2021-12-11 14:19:20 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }

2021-12-11 14:19:20 [OK] Send NexMark events (epoch: 7).

2021-12-11 14:19:20 Epoch 7: 20 persons, 60 auctions, 920 bids.

2021-12-11 14:19:20 [OK] Send 1 NexMark events from epoch 7 to function: q5-00-04.

2021-12-11 14:19:20 [OK] Event 0 - function payload bytes: 29556

2021-12-11 14:19:20 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }

2021-12-11 14:19:20 [OK] Send NexMark events (epoch: 8).

2021-12-11 14:19:20 Epoch 8: 20 persons, 60 auctions, 920 bids.

2021-12-11 14:19:20 [OK] Send 1 NexMark events from epoch 8 to function: q5-00-04.

2021-12-11 14:19:20 [OK] Event 0 - function payload bytes: 29640

2021-12-11 14:19:20 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }

2021-12-11 14:19:20 [OK] Send NexMark events (epoch: 9).

2021-12-11 14:19:20 Epoch 9: 20 persons, 60 auctions, 920 bids.

2021-12-11 14:19:20 [OK] Send 1 NexMark events from epoch 9 to function: q5-00-04.

2021-12-11 14:19:20 [OK] Event 0 - function payload bytes: 29556

2021-12-11 14:19:20 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }

2021-12-11 14:19:20 END RequestId: 0c0bde1b-197f-45b7-83d4-2720f62e3406

2021-12-11 14:19:20 REPORT RequestId: 0c0bde1b-197f-45b7-83d4-2720f62e3406      Duration: 1875.37 ms    Billed Duration: 1950 ms        Memory Size: 128 MB     Max Memory Used: 40 MB   Init Duration: 74.11 ms

[2021-12-11T19:19:46Z INFO  nexmark_bench] Got a Token response
[2021-12-11T19:19:46Z INFO  driver::logwatch::tail] Sending log request FilterLogEventsRequest { end_time: None, filter_pattern: None, limit: Some(100), log_group_name: "/aws/lambda/nexmark_datasource", log_stream_name_prefix: None, log_stream_names: None, next_token: Some("Bxkq6kVGFtq2y_MoigeqscPOdhXVbhiVtLoAmXb5jCowyfdIwEn78gmae44ay8DpxMGUU-0VEclzBjOVLXW7qfDbKeQQcAOMxDU-_ZCMG-6-EsdAuzW76sk0rpiEQcKDG9-axwYg_bgoyc1gdsun1s7gAyVRZ4UTQLh6jQ5-lmZeeSQjfzGF_zVKonzItukDkrxA4nSD294TVIgmZ8UpFmJM3FVO-SOtAbF-B-Rc8CL9-Z4JC6n_aIoqyQndDpz9shqY20mCqEb-12eg8p-4Sw"), start_time: Some(1639250086197) }
[2021-12-11T19:19:46Z INFO  driver::logwatch::tail] Got response FilterLogEventsResponse { events: Some([]), next_token: None, searched_log_streams: Some([]) }
[2021-12-11T19:19:46Z INFO  nexmark_bench] Got a lastlog response
[2021-12-11T19:19:46Z INFO  nexmark_bench] Waiting 1s before requesting logs again...
gangliao commented 2 years ago 
============================================================
 Running the benchmark 
============================================================
Nexmark Query Number: 1
Nexmark Generators: 1
Nexmark Events Per Second: 1000
Nexmark Seconds to Run: 10
============================================================

[OK] Nexmark Benchmark Starting

[1] Warming up the lambda functions

[2021-12-11T19:42:09Z INFO  nexmark_bench] Running benchmarks with the following options: NexmarkBenchmarkOpt { query_number: 1, debug: true, generators: 1, seconds: 10, events_per_second: 1000 }
[2021-12-11T19:42:09Z INFO  nexmark_bench] Creating lambda function: nexmark_datasource
[2021-12-11T19:42:10Z INFO  nexmark_bench] Creating lambda function: q1-00
[2021-12-11T19:42:10Z INFO  nexmark_bench] [OK] Invoke function: nexmark_datasource 0
Error: Execution("Lambda function execution failure: The operation cannot be performed at this time. The function is currently in the following state: Pending")
-------------------------------------------------------------

[2] Running the benchmark

[2021-12-11T19:42:12Z INFO  nexmark_bench] Running benchmarks with the following options: NexmarkBenchmarkOpt { query_number: 1, debug: true, generators: 1, seconds: 10, events_per_second: 1000 }
[2021-12-11T19:42:12Z INFO  nexmark_bench] Creating lambda function: nexmark_datasource
[2021-12-11T19:42:13Z INFO  nexmark_bench] Creating lambda function: q1-00
[2021-12-11T19:42:13Z INFO  nexmark_bench] [OK] Invoke function: nexmark_datasource 0
[2021-12-11T19:42:13Z INFO  nexmark_bench] [OK] Received status from function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
[2021-12-11T19:42:13Z INFO  driver::logwatch::tail] Sending log request FilterLogEventsRequest { end_time: None, filter_pattern: None, limit: Some(100), log_group_name: "/aws/lambda/nexmark_datasource", log_stream_name_prefix: None, log_stream_names: None, next_token: None, start_time: Some(1639251433669) }
[2021-12-11T19:42:14Z INFO  driver::logwatch::tail] [OK] Got response from AWS CloudWatch Logs.
[2021-12-11T19:42:14Z INFO  nexmark_bench] Got a lastlog response
[2021-12-11T19:42:14Z INFO  nexmark_bench] Waiting 5s before requesting logs again...
[2021-12-11T19:42:19Z INFO  driver::logwatch::tail] Sending log request FilterLogEventsRequest { end_time: None, filter_pattern: None, limit: Some(100), log_group_name: "/aws/lambda/nexmark_datasource", log_stream_name_prefix: None, log_stream_names: None, next_token: None, start_time: Some(1639251433669) }
[2021-12-11T19:42:21Z INFO  driver::logwatch::tail] [OK] Got response from AWS CloudWatch Logs.
2021-12-11 14:42:14 START RequestId: 20579a91-136c-489d-ba78-abc2d7a32331 Version: $LATEST
2021-12-11 14:42:14 [2021-12-11T19:42:14Z INFO  runtime::datasource::nexmark::nexmark] Generating events for 10s over 1 partitions.
2021-12-11 14:42:15 Nexmark Benchmark: Query 1
2021-12-11 14:42:15 NexMarkSource { config: Config { args: {"seconds": "10", "events-per-second": "1000", "threads": "1"} }, window: ElementWise }
2021-12-11 14:42:15 [OK] Generate nexmark events.
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 0).
2021-12-11 14:42:15 Epoch 0: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 1).
2021-12-11 14:42:15 Epoch 1: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 2).
2021-12-11 14:42:15 Epoch 2: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 3).
2021-12-11 14:42:15 Epoch 3: 20 persons, 60 auctions, 920 bids.
[2021-12-11T19:42:21Z INFO  nexmark_bench] Got a Token response
[2021-12-11T19:42:21Z INFO  driver::logwatch::tail] Sending log request FilterLogEventsRequest { end_time: None, filter_pattern: None, limit: Some(100), log_group_name: "/aws/lambda/nexmark_datasource", log_stream_name_prefix: None, log_stream_names: None, next_token: Some("Bxkq6kVGFtq2y_MoigeqscPOdhXVbhiVtLoAmXb5jCoFt-Q6WTab3Y-g6LbaKxRgpl7yWSf1sRM08GbAKNYIMxDfyrDuOaUrT0jMzY4PlR0RcNtUL914Jmhi0ap00L1IcvI9sb6VDtEH9xp0F7eBynN-P3KMEZ2E2dgp7NhKOS1SbX-JGNY7x-yAhcA4mynCnksUqBohtZe-CTLP_hUwviu1NTx3K9ZuoWYxopReKHzhf_GPoPz6Cqi_z7zVgawFuxGuyRJm3JYaVNG1Rc1MHA"), start_time: Some(1639251441467) }
[2021-12-11T19:42:23Z INFO  driver::logwatch::tail] [OK] Got response from AWS CloudWatch Logs.
[2021-12-11T19:42:23Z INFO  nexmark_bench] Got a lastlog response
[2021-12-11T19:42:23Z INFO  nexmark_bench] Waiting 5s before requesting logs again...
[2021-12-11T19:42:28Z INFO  driver::logwatch::tail] Sending log request FilterLogEventsRequest { end_time: None, filter_pattern: None, limit: Some(100), log_group_name: "/aws/lambda/nexmark_datasource", log_stream_name_prefix: None, log_stream_names: None, next_token: None, start_time: Some(1639251441467) }
[2021-12-11T19:42:29Z INFO  driver::logwatch::tail] [OK] Got response from AWS CloudWatch Logs.
2021-12-11 14:42:14 START RequestId: 20579a91-136c-489d-ba78-abc2d7a32331 Version: $LATEST
2021-12-11 14:42:14 [2021-12-11T19:42:14Z INFO  runtime::datasource::nexmark::nexmark] Generating events for 10s over 1 partitions.
2021-12-11 14:42:15 Nexmark Benchmark: Query 1
2021-12-11 14:42:15 NexMarkSource { config: Config { args: {"seconds": "10", "events-per-second": "1000", "threads": "1"} }, window: ElementWise }
2021-12-11 14:42:15 [OK] Generate nexmark events.
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 0).
2021-12-11 14:42:15 Epoch 0: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 1).
2021-12-11 14:42:15 Epoch 1: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 2).
2021-12-11 14:42:15 Epoch 2: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 3).
2021-12-11 14:42:15 Epoch 3: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 4).
2021-12-11 14:42:15 Epoch 4: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 5).
2021-12-11 14:42:15 Epoch 5: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 6).
2021-12-11 14:42:15 Epoch 6: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 7).
2021-12-11 14:42:15 Epoch 7: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 8).
2021-12-11 14:42:15 Epoch 8: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 9).
2021-12-11 14:42:15 Epoch 9: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 END RequestId: 20579a91-136c-489d-ba78-abc2d7a32331
2021-12-11 14:42:15 REPORT RequestId: 20579a91-136c-489d-ba78-abc2d7a32331      Duration: 916.93 ms     Billed Duration: 928 ms Memory Size: 128 MB     Max Memory Used: 22 MB   Init Duration: 10.54 ms
[2021-12-11T19:42:29Z INFO  nexmark_bench] Got a Token response
[2021-12-11T19:42:29Z INFO  driver::logwatch::tail] Sending log request FilterLogEventsRequest { end_time: None, filter_pattern: None, limit: Some(100), log_group_name: "/aws/lambda/nexmark_datasource", log_stream_name_prefix: None, log_stream_names: None, next_token: Some("Bxkq6kVGFtq2y_MoigeqscPOdhXVbhiVtLoAmXb5jCpErXiyEyNy01pFGEqDRNsgbNyUy82xo-L_WZ-Zk7TYpgB-vWPUP_pT4UgqPv2mLCKbCrTW3KRG751ojisgUO9XNKt7xaZ-Ft2Qia4_QgzqobR1ojwX6SaY1Vjev89bnZ3fvzLEx2n53GaqupyWm9jXeSBrm2nE_0_JY6sunI8Pdb2hnQwOTdW5p1hZXrUT7Y-uCapevhNb8y6x_VDcmCnUYd0mCDGHBZ43xm3UDJVLuw"), start_time: Some(1639251449601) }
[2021-12-11T19:42:30Z INFO  driver::logwatch::tail] [OK] Got response from AWS CloudWatch Logs.
[2021-12-11T19:42:30Z INFO  nexmark_bench] Got a lastlog response
[2021-12-11T19:42:30Z INFO  nexmark_bench] Waiting 5s before requesting logs again...
[2021-12-11T19:42:35Z INFO  driver::logwatch::tail] Sending log request FilterLogEventsRequest { end_time: None, filter_pattern: None, limit: Some(100), log_group_name: "/aws/lambda/nexmark_datasource", log_stream_name_prefix: None, log_stream_names: None, next_token: None, start_time: Some(1639251449601) }
[2021-12-11T19:42:37Z INFO  driver::logwatch::tail] [OK] Got response from AWS CloudWatch Logs.
2021-12-11 14:42:14 START RequestId: 20579a91-136c-489d-ba78-abc2d7a32331 Version: $LATEST
2021-12-11 14:42:14 [2021-12-11T19:42:14Z INFO  runtime::datasource::nexmark::nexmark] Generating events for 10s over 1 partitions.
2021-12-11 14:42:15 Nexmark Benchmark: Query 1
2021-12-11 14:42:15 NexMarkSource { config: Config { args: {"seconds": "10", "events-per-second": "1000", "threads": "1"} }, window: ElementWise }
2021-12-11 14:42:15 [OK] Generate nexmark events.
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 0).
2021-12-11 14:42:15 Epoch 0: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 1).
2021-12-11 14:42:15 Epoch 1: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 2).
2021-12-11 14:42:15 Epoch 2: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 3).
2021-12-11 14:42:15 Epoch 3: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 4).
2021-12-11 14:42:15 Epoch 4: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 5).
2021-12-11 14:42:15 Epoch 5: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 6).
2021-12-11 14:42:15 Epoch 6: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 7).
2021-12-11 14:42:15 Epoch 7: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 8).
2021-12-11 14:42:15 Epoch 8: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 9).
2021-12-11 14:42:15 Epoch 9: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 END RequestId: 20579a91-136c-489d-ba78-abc2d7a32331
2021-12-11 14:42:15 REPORT RequestId: 20579a91-136c-489d-ba78-abc2d7a32331      Duration: 916.93 ms     Billed Duration: 928 ms Memory Size: 128 MB     Max Memory Used: 22 MB   Init Duration: 10.54 ms
[2021-12-11T19:42:37Z INFO  nexmark_bench] Got a Token response
[2021-12-11T19:42:37Z INFO  driver::logwatch::tail] Sending log request FilterLogEventsRequest { end_time: None, filter_pattern: None, limit: Some(100), log_group_name: "/aws/lambda/nexmark_datasource", log_stream_name_prefix: None, log_stream_names: None, next_token: Some("Bxkq6kVGFtq2y_MoigeqscPOdhXVbhiVtLoAmXb5jCpErXiyEyNy01pFGEqDRNsgbNyUy82xo-L_WZ-Zk7TYpgB-vWPUP_pT4UgqPv2mLCKbCrTW3KRG751ojisgUO9XNKt7xaZ-Ft2Qia4_QgzqobR1ojwX6SaY1Vjev89bnZ3fvzLEx2n53GaqupyWm9jXeSBrm2nE_0_JY6sunI8Pdb2hnQwOTdW5p1hZXrUT7Y-uCapevhNb8y6x_VDcmCnUYd0mCDGHBZ43xm3UDJVLuw"), start_time: Some(1639251457588) }
[2021-12-11T19:42:38Z INFO  driver::logwatch::tail] [OK] Got response from AWS CloudWatch Logs.
[2021-12-11T19:42:38Z INFO  nexmark_bench] Got a lastlog response
[2021-12-11T19:42:38Z INFO  nexmark_bench] Waiting 5s before requesting logs again...
[2021-12-11T19:42:43Z INFO  driver::logwatch::tail] Sending log request FilterLogEventsRequest { end_time: None, filter_pattern: None, limit: Some(100), log_group_name: "/aws/lambda/nexmark_datasource", log_stream_name_prefix: None, log_stream_names: None, next_token: None, start_time: Some(1639251457588) }
[2021-12-11T19:42:43Z INFO  driver::logwatch::tail] [OK] Got response from AWS CloudWatch Logs.
2021-12-11 14:42:14 START RequestId: 20579a91-136c-489d-ba78-abc2d7a32331 Version: $LATEST
2021-12-11 14:42:14 [2021-12-11T19:42:14Z INFO  runtime::datasource::nexmark::nexmark] Generating events for 10s over 1 partitions.
2021-12-11 14:42:15 Nexmark Benchmark: Query 1
2021-12-11 14:42:15 NexMarkSource { config: Config { args: {"seconds": "10", "events-per-second": "1000", "threads": "1"} }, window: ElementWise }
2021-12-11 14:42:15 [OK] Generate nexmark events.
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 0).
2021-12-11 14:42:15 Epoch 0: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 1).
2021-12-11 14:42:15 Epoch 1: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 2).
2021-12-11 14:42:15 Epoch 2: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 3).
2021-12-11 14:42:15 Epoch 3: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 4).
2021-12-11 14:42:15 Epoch 4: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 5).
2021-12-11 14:42:15 Epoch 5: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 6).
2021-12-11 14:42:15 Epoch 6: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 7).
2021-12-11 14:42:15 Epoch 7: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 8).
2021-12-11 14:42:15 Epoch 8: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 [OK] Send NexMark events (epoch: 9).
2021-12-11 14:42:15 Epoch 9: 20 persons, 60 auctions, 920 bids.
2021-12-11 14:42:15 [OK] Received status from async lambda function. InvocationResponse { executed_version: None, function_error: None, log_result: None, payload: Some(b""), status_code: Some(202) }
2021-12-11 14:42:15 END RequestId: 20579a91-136c-489d-ba78-abc2d7a32331
2021-12-11 14:42:15 REPORT RequestId: 20579a91-136c-489d-ba78-abc2d7a32331      Duration: 916.93 ms     Billed Duration: 928 ms Memory Size: 128 MB     Max Memory Used: 22 MB   Init Duration: 10.54 ms
[2021-12-11T19:42:43Z INFO  nexmark_bench] Got a Token response
[2021-12-11T19:42:43Z INFO  driver::logwatch::tail] Sending log request FilterLogEventsRequest { end_time: None, filter_pattern: None, limit: Some(100), log_group_name: "/aws/lambda/nexmark_datasource", log_stream_name_prefix: None, log_stream_names: None, next_token: Some("Bxkq6kVGFtq2y_MoigeqscPOdhXVbhiVtLoAmXb5jCpErXiyEyNy01pFGEqDRNsgbNyUy82xo-L_WZ-Zk7TYpgB-vWPUP_pT4UgqPv2mLCKbCrTW3KRG751ojisgUO9XNKt7xaZ-Ft2Qia4_QgzqobR1ojwX6SaY1Vjev89bnZ3fvzLEx2n53GaqupyWm9jXeSBrm2nE_0_JY6sunI8Pdb2hnQwOTdW5p1hZXrUT7Y-uCapevhNb8y6x_VDcmCnUYd0mCDGHBZ43xm3UDJVLuw"), start_time: Some(1639251463724) }
[2021-12-11T19:42:44Z INFO  driver::logwatch::tail] [OK] Got response from AWS CloudWatch Logs.
[2021-12-11T19:42:44Z INFO  nexmark_bench] Got a lastlog response
[2021-12-11T19:42:44Z INFO  nexmark_bench] Waiting 5s before requesting logs again...