openfaas / nats-queue-worker

Queue-worker for OpenFaaS with NATS Streaming
https://docs.openfaas.com/reference/async/
MIT License
129 stars 59 forks source link

Allow up to max_inflight many concurrent function invocations. #95

Closed matthiashanel closed 4 years ago

matthiashanel commented 4 years ago

Description

Fixes #94

Switch from auto ack to manual ack. This enables message handling in individual go routines. In main.go switch to atomic counter and include index in traces. Going forward these may be mixed with concurrent traces.

Removes option to run without durable. Generates durable name base on subject. Removes issue where the durable would not see every messages.

Motivation and Context

This change repurposes max_inflight. When > 1 messages will be processed concurrently. This is a difference from before where all messages were processed sequentially. Using max_inflight this way has been discussed.

How Has This Been Tested?

Existing unit tests passed. (output below) I started openfaas in minikube on my mac. faas-nets queueworker-dep.yml was modified as follows:

@@ -30,13 +30,13 @@ spec:
               cpu: 50m
               memory: 120Mi

-        image: openfaas/queue-worker:0.10.1
-        imagePullPolicy: Always
+        image: openfaas/queue-worker:latest-amd64
+        imagePullPolicy: Never
         env:
         - name: faas_nats_address
           value: "nats.openfaas.svc.cluster.local"
-        - name: faas_nats_durable_queue_subscription
-          value: "false"
+        - name: max_inflight
+          value: "10"
         - name: faas_nats_channel
           value: "faas-request"
         - name: faas_nats_queue_group

Once openfaas was up and running, I deployed cows function and executed the following command: for x in {1..100}; do curl 'http://127.0.0.1:31112/async-function/cows' -d "{}" & ; done

After all curl commands finished I checked the queue workers log. It shows 10 functions starting/finishing concurrently: (This is only an excpert, full log of unit test/)

[#91] Received on [faas-request]: 'sequence:91 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"389f92b0-34b1-407b-8182-f1c695263e2e\"],\"X-Start-Time\":[\"1588053367432224863\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367432521588 '
[#91] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#86] Invoked: cows [200] in 0.271418s
[#86] cows returned 97 bytes
[#92] Received on [faas-request]: 'sequence:92 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"e687b551-9ebe-47ea-8094-5c49eec4b350\"],\"X-Start-Time\":[\"1588053367439249509\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367439504514 '
[#92] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#79] Invoked: cows [200] in 0.416490s
[#79] cows returned 77 bytes
[#88] Invoked: cows [200] in 0.186356s
[#88] cows returned 221 bytes
[#93] Received on [faas-request]: 'sequence:94 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"c208e895-0eef-4f12-975f-0b807b4456e8\"],\"X-Start-Time\":[\"1588053367440651288\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367441150643 '
[#93] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#94] Received on [faas-request]: 'sequence:93 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"158f1dec-1257-45e6-9263-9023d0d0da44\"],\"X-Start-Time\":[\"1588053367440510517\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367441149046 '
[#94] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#89] Invoked: cows [200] in 0.173041s
[#89] cows returned 280 bytes
[#95] Received on [faas-request]: 'sequence:95 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"4da4aba8-8ce9-4195-881b-567a98d8424a\"],\"X-Start-Time\":[\"1588053367440755227\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367441151027 '
[#95] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#80] Invoked: cows [200] in 0.441642s
[#80] cows returned 160 bytes
[#96] Received on [faas-request]: 'sequence:96 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"411d7310-c24c-44e8-936c-22ee55966248\"],\"X-Start-Time\":[\"1588053367448271944\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367448788949 '
[#96] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#82] Invoked: cows [200] in 0.419581s
[#82] cows returned 111 bytes
[#97] Received on [faas-request]: 'sequence:97 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"791c08d4-d242-4ad2-9ce3-cae4cf4a2087\"],\"X-Start-Time\":[\"1588053367451096400\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367451559359 '
[#97] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#83] Invoked: cows [200] in 0.409616s
[#83] cows returned 310 bytes
[#98] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#98] Received on [faas-request]: 'sequence:98 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"5cfe2258-3fde-4785-9c1b-c37083537084\"],\"X-Start-Time\":[\"1588053367453466774\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367454068977 '
[#84] Invoked: cows [200] in 0.401153s
[#84] cows returned 283 bytes
[#99] Received on [faas-request]: 'sequence:99 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"0084b3e0-ad4b-4750-b5c4-adc8de67568c\"],\"X-Start-Time\":[\"1588053367465992313\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367469220628 '
[#99] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#90] Invoked: cows [200] in 0.221186s
[#90] cows returned 100 bytes
[#100] Received on [faas-request]: 'sequence:100 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"76d92716-c995-4305-b570-f0f9d246651e\"],\"X-Start-Time\":[\"1588053367468895506\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367469223140 '
[#100] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#91] Invoked: cows [200] in 0.209727s
[#91] cows returned 306 bytes
[#95] Invoked: cows [200] in 0.222290s
[#95] cows returned 131 bytes
[#94] Invoked: cows [200] in 0.238848s
[#94] cows returned 99 bytes
[#99] Invoked: cows [200] in 0.170225s
[#99] cows returned 105 bytes
[#96] Invoked: cows [200] in 0.255603s
[#96] cows returned 104 bytes
[#93] Invoked: cows [200] in 0.284509s
[#93] cows returned 145 bytes
[#97] Invoked: cows [200] in 0.249226s
[#97] cows returned 121 bytes
[#92] Invoked: cows [200] in 0.310895s
[#92] cows returned 384 bytes
[#98] Invoked: cows [200] in 0.215637s
[#98] cows returned 219 bytes
[#100] Invoked: cows [200] in 0.192640s
[#100] cows returned 86 bytes

Types of changes

Checklist:

Suggested documentation change

Parallelism By default there is one queue-worker replica deployed which is set up to run a single task of up to 30 seconds in duration.

You can increase the parallelism by scaling the queue-worker up - i.e. 5 replicas for 5 parallel tasks.

Alternatively you can increase the parallelism by setting "max_inflight" to a value greater than one. This will cause the queue-worker to concurrently receive up to max_inflight many messages and simultaneously invoke their corresponding functions. Should you wish to restrict concurrent invocation for certain functions, please make use of the queue feature and separate these from functions where you want more concurrency. When you scale up a queue worker, please be aware that you will get n * max_inflight parallel tasks.

Full test log

 15:13:16 > make test
go test -v ./...
=== RUN   Test_makeFunctionURL_DefaultPathQS_GatewayInvoke_IncludesGWAddress
--- PASS: Test_makeFunctionURL_DefaultPathQS_GatewayInvoke_IncludesGWAddress (0.00s)
=== RUN   Test_makeFunctionURL_DefaultPathQS_GatewayInvoke_WithQS
--- PASS: Test_makeFunctionURL_DefaultPathQS_GatewayInvoke_WithQS (0.00s)
=== RUN   Test_makeFunctionURL_DefaultPathQS_GatewayInvoke_WithPath
--- PASS: Test_makeFunctionURL_DefaultPathQS_GatewayInvoke_WithPath (0.00s)
=== RUN   Test_makeFunctionURL_DefaultPathQS_GatewayInvokeOff_UsesDirectInvocation
--- PASS: Test_makeFunctionURL_DefaultPathQS_GatewayInvokeOff_UsesDirectInvocation (0.00s)
=== RUN   Test_ReadConfig_GatewayInvokeDefault
--- PASS: Test_ReadConfig_GatewayInvokeDefault (0.00s)
=== RUN   Test_ReadConfig_GatewayInvokeSetToTrue
--- PASS: Test_ReadConfig_GatewayInvokeSetToTrue (0.00s)
=== RUN   Test_ReadConfig_BasicAuthDefaultIsFalse
--- PASS: Test_ReadConfig_BasicAuthDefaultIsFalse (0.00s)
=== RUN   Test_ReadConfig_BasicAuthSetToTrue
--- PASS: Test_ReadConfig_BasicAuthSetToTrue (0.00s)
=== RUN   Test_ReadConfig_TLSInsecureDefaultFalse
--- PASS: Test_ReadConfig_TLSInsecureDefaultFalse (0.00s)
=== RUN   Test_ReadConfig_TLSInsecureSetTrue
--- PASS: Test_ReadConfig_TLSInsecureSetTrue (0.00s)
=== RUN   Test_ReadConfig_IncorrectPortValue
--- PASS: Test_ReadConfig_IncorrectPortValue (0.00s)
=== RUN   Test_ReadConfig
2020/04/28 15:13:17 max_inflight error: strconv.Atoi: parsing "10.00": invalid syntax
2020/04/28 15:13:17 ack_wait error: time: missing unit in duration 10
--- PASS: Test_ReadConfig (0.00s)
=== RUN   Test_ReadConfig_NatsChannelDefault
2020/04/28 15:13:17 max_inflight error: strconv.Atoi: parsing "10.00": invalid syntax
2020/04/28 15:13:17 ack_wait error: time: missing unit in duration 10
--- PASS: Test_ReadConfig_NatsChannelDefault (0.00s)
=== RUN   Test_ReadConfig_NatsQueueGroup
2020/04/28 15:13:17 max_inflight error: strconv.Atoi: parsing "10.00": invalid syntax
2020/04/28 15:13:17 ack_wait error: time: missing unit in duration 10
--- PASS: Test_ReadConfig_NatsQueueGroup (0.00s)
PASS
ok      nats-queue-worker   0.170s
=== RUN   Test_GetClientID_ContainsHostname
--- PASS: Test_GetClientID_ContainsHostname (0.00s)
=== RUN   TestCreategetClientID
--- PASS: TestCreategetClientID (0.00s)
=== RUN   TestCreategetClientIDWhenHostHasUnsupportedCharacters
--- PASS: TestCreategetClientIDWhenHostHasUnsupportedCharacters (0.00s)
PASS
ok      nats-queue-worker/handler   (cached)
=== RUN   TestGetClientID
--- PASS: TestGetClientID (0.00s)
=== RUN   TestGetClientIDWhenHostHasUnsupportedCharacters
--- PASS: TestGetClientIDWhenHostHasUnsupportedCharacters (0.00s)
PASS
ok      nats-queue-worker/nats  (cached)
 15:13:18 >
 01:56:35 > kubectl logs nats-8455bfbb58-xpw8h -n openfaas
[1] 2020/04/28 05:54:37.892989 [INF] STREAM: Starting nats-streaming-server[faas-cluster] version 0.17.0
[1] 2020/04/28 05:54:37.893067 [INF] STREAM: ServerID: kvmZVwBUTw3tUxmb5UkqQu
[1] 2020/04/28 05:54:37.893071 [INF] STREAM: Go version: go1.13.7
[1] 2020/04/28 05:54:37.893072 [INF] STREAM: Git commit: [f4b7190]
[1] 2020/04/28 05:54:37.893567 [INF] Starting nats-server version 2.1.4
[1] 2020/04/28 05:54:37.893574 [INF] Git commit [fb009af]
[1] 2020/04/28 05:54:37.893949 [INF] Listening for client connections on 0.0.0.0:4222
[1] 2020/04/28 05:54:37.893986 [INF] Server id is NBVGAPHLTCVESSBI3MH7I2FBRFP43TEZ4CB5SVAXVA5L44UGSOOB47KZ
[1] 2020/04/28 05:54:37.893989 [INF] Server is ready
[1] 2020/04/28 05:54:37.922040 [INF] STREAM: Recovering the state...
[1] 2020/04/28 05:54:37.922101 [INF] STREAM: No recovered state
[1] 2020/04/28 05:54:38.173909 [INF] STREAM: Message store is MEMORY
[1] 2020/04/28 05:54:38.174067 [INF] STREAM: ---------- Store Limits ----------
[1] 2020/04/28 05:54:38.174211 [INF] STREAM: Channels:                  100 *
[1] 2020/04/28 05:54:38.174311 [INF] STREAM: --------- Channels Limits --------
[1] 2020/04/28 05:54:38.174456 [INF] STREAM:   Subscriptions:          1000 *
[1] 2020/04/28 05:54:38.174508 [INF] STREAM:   Messages     :       1000000 *
[1] 2020/04/28 05:54:38.174633 [INF] STREAM:   Bytes        :     976.56 MB *
[1] 2020/04/28 05:54:38.174751 [INF] STREAM:   Age          :     unlimited *
[1] 2020/04/28 05:54:38.174921 [INF] STREAM:   Inactivity   :     unlimited *
[1] 2020/04/28 05:54:38.175054 [INF] STREAM: ----------------------------------
[1] 2020/04/28 05:54:38.175095 [INF] STREAM: Streaming Server is ready
[1] 2020/04/28 05:54:38.758910 [INF] STREAM: Channel "faas-request" has been created
 01:56:45 > kubectl get pods -n openfaas
NAME                                 READY   STATUS    RESTARTS   AGE
alertmanager-66655f9b87-qpbhh        1/1     Running   0          2m29s
basic-auth-plugin-6ffbc7dc78-p97c2   1/1     Running   0          2m29s
faas-idler-f4597f655-2pwnx           1/1     Running   2          2m29s
gateway-f4887bc48-dbf5m              2/2     Running   1          2m29s
nats-8455bfbb58-xpw8h                1/1     Running   0          2m29s
prometheus-75ffb6844f-r65jp          1/1     Running   0          2m29s
queue-worker-7cf897fcbd-ts27g        1/1     Running   2          2m28s
 01:56:59 > kubectl logs queue-worker-7cf897fcbd-ts27g -n openfaas
Loading basic authentication credentials
Connect: nats://nats.openfaas.svc.cluster.local:4222
Subscribing to: faas-request at nats://nats.openfaas.svc.cluster.local:4222
Wait for  1m0s
Listening on [faas-request], clientID=[faas-worker-queue-worker-7cf897fcbd-ts27g], qgroup=[faas] maxInFlight=[10]
[#1] Received on [faas-request]: 'sequence:1 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"fe89f95d-f634-463a-ac20-af3c679aa042\"],\"X-Start-Time\":[\"1588053366665091999\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366671307868 '
[#1] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#2] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#2] Received on [faas-request]: 'sequence:2 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"684f1d29-5040-4c45-b33a-8f78891b4f37\"],\"X-Start-Time\":[\"1588053366677581303\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366678416643 '
[#3] Received on [faas-request]: 'sequence:3 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"96a119d4-0f53-4c4b-aea7-c71aa2a340dc\"],\"X-Start-Time\":[\"1588053366706818020\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366708761456 '
[#3] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#4] Received on [faas-request]: 'sequence:4 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"b25660ac-8e54-47f6-8f37-ac5a87441ff6\"],\"X-Start-Time\":[\"1588053366778183574\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366780085957 '
[#4] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#5] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#6] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#7] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#8] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#9] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#5] Received on [faas-request]: 'sequence:6 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"16ce0ec9-1430-4819-bcc5-e46b29e62d50\"],\"X-Start-Time\":[\"1588053366779546738\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366780089780 '
[#6] Received on [faas-request]: 'sequence:5 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"f3dcd90c-616e-49b8-b7b1-91d3f60933bb\"],\"X-Start-Time\":[\"1588053366778525787\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366780089435 '
[#7] Received on [faas-request]: 'sequence:9 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"9dcdbefb-9905-4cb9-ad5c-47078636eb05\"],\"X-Start-Time\":[\"1588053366784422131\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366784640521 '
[#8] Received on [faas-request]: 'sequence:7 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"1976400c-1214-4bee-a352-986881284c67\"],\"X-Start-Time\":[\"1588053366784237460\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366784637291 '
[#9] Received on [faas-request]: 'sequence:8 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"bdbaaea9-7eab-4ad7-814d-a8e74785b22e\"],\"X-Start-Time\":[\"1588053366784353481\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366784640103 '
[#10] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#10] Received on [faas-request]: 'sequence:10 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"c1ddee0a-7f7c-4e72-af78-60c9b62dad65\"],\"X-Start-Time\":[\"1588053366792523461\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366794391615 '
[#10] cows returned 90 bytes
[#10] Invoked: cows [200] in 0.340022s
[#11] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#11] Received on [faas-request]: 'sequence:11 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"dda87996-3767-4665-a649-83d2f57331fb\"],\"X-Start-Time\":[\"1588053366792894520\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366794395064 '
[#3] Invoked: cows [200] in 0.521206s
[#12] Received on [faas-request]: 'sequence:12 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"dd2317d7-816f-4238-bf42-f8e65bfd70ec\"],\"X-Start-Time\":[\"1588053366793062427\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366794395522 '
[#3] cows returned 105 bytes
[#12] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#11] Invoked: cows [200] in 0.148545s
[#11] cows returned 572 bytes
[#13] Received on [faas-request]: 'sequence:13 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"03b35974-5607-4a80-b403-a58645a0b375\"],\"X-Start-Time\":[\"1588053366793276854\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366794404205 '
[#13] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#9] Invoked: cows [200] in 0.691316s
[#9] cows returned 102 bytes
[#14] Received on [faas-request]: 'sequence:14 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"56fa9d1c-4dd9-4661-8721-e9db043969f5\"],\"X-Start-Time\":[\"1588053366800921630\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366801372983 '
[#14] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#7] Invoked: cows [200] in 0.705778s
[#7] cows returned 122 bytes
[#15] Received on [faas-request]: 'sequence:15 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"7657df4a-51ae-414c-8f70-3bf2fb59eddc\"],\"X-Start-Time\":[\"1588053366828288156\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366828558005 '
[#15] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#8] Invoked: cows [200] in 0.710434s
[#8] cows returned 489 bytes
[#16] Received on [faas-request]: 'sequence:16 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"1ad617ab-56ca-44bf-b6c4-48b2c01faa40\"],\"X-Start-Time\":[\"1588053366849250326\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366849622806 '
[#16] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#2] Invoked: cows [200] in 0.848331s
[#2] cows returned 134 bytes
[#17] Received on [faas-request]: 'sequence:17 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"b27a5827-6498-41e2-bb0b-e0cdbb43dcc7\"],\"X-Start-Time\":[\"1588053366912947232\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366913196323 '
[#17] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#1] Invoked: cows [200] in 0.874725s
[#1] cows returned 234 bytes
[#18] Received on [faas-request]: 'sequence:18 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"faea04d0-f459-4cc6-9ef0-08970e59812b\"],\"X-Start-Time\":[\"1588053366970963295\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366971290848 '
[#18] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#13] Invoked: cows [200] in 0.282094s
[#13] cows returned 813 bytes
[#19] Received on [faas-request]: 'sequence:19 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"20de12bc-fb7a-4ae6-b3eb-bf769d265c45\"],\"X-Start-Time\":[\"1588053366971121970\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366971293453 '
[#19] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#6] Invoked: cows [200] in 0.846688s
[#6] cows returned 166 bytes
[#20] Received on [faas-request]: 'sequence:20 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"67f31a05-6ddd-4c20-a5e0-eadcdc337b75\"],\"X-Start-Time\":[\"1588053366983977699\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366984210463 '
[#20] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#5] Invoked: cows [200] in 0.848458s
[#5] cows returned 136 bytes
[#21] Received on [faas-request]: 'sequence:21 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"e9fa7482-89b3-43b3-8370-9ab2e348fc7a\"],\"X-Start-Time\":[\"1588053366990779078\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366991069641 '
[#21] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#4] Invoked: cows [200] in 0.887714s
[#4] cows returned 190 bytes
[#22] Received on [faas-request]: 'sequence:22 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"94728029-f794-420d-a406-e860aef3ceb3\"],\"X-Start-Time\":[\"1588053366994745887\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366995119628 '
[#22] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#12] Invoked: cows [200] in 0.450723s
[#12] cows returned 279 bytes
[#23] Received on [faas-request]: 'sequence:23 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"0ec76654-a14c-409f-ad45-c4cc9c0d6d8d\"],\"X-Start-Time\":[\"1588053366994911886\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053366995122500 '
[#23] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#14] Invoked: cows [200] in 0.258537s
[#14] cows returned 639 bytes
[#24] Received on [faas-request]: 'sequence:24 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"d5e2efdb-076d-4378-af29-d8f80a48487a\"],\"X-Start-Time\":[\"1588053367004984739\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367005265325 '
[#24] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#15] Invoked: cows [200] in 0.257479s
[#15] cows returned 126 bytes
[#25] Received on [faas-request]: 'sequence:25 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"2d623867-c1d3-46c5-a9df-95bb37b603d9\"],\"X-Start-Time\":[\"1588053367011584428\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367011933728 '
[#25] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#16] Invoked: cows [200] in 0.257545s
[#16] cows returned 572 bytes
[#26] Received on [faas-request]: 'sequence:26 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"6b3ce862-893b-48a7-a9ea-b1d70ab5430b\"],\"X-Start-Time\":[\"1588053367036403921\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367036678104 '
[#26] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#23] Invoked: cows [200] in 0.157419s
[#23] cows returned 91 bytes
[#27] Received on [faas-request]: 'sequence:27 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"9c638005-ab12-43b7-8f98-2f575f37f785\"],\"X-Start-Time\":[\"1588053367038997330\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367039255518 '
[#27] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#26] Invoked: cows [200] in 0.116720s
[#26] cows returned 83 bytes
[#28] Received on [faas-request]: 'sequence:28 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"b2e8eeb4-fe69-40ba-b9f8-a831b4e2c2a0\"],\"X-Start-Time\":[\"1588053367047692273\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367047961838 '
[#28] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#27] Invoked: cows [200] in 0.116127s
[#27] cows returned 137 bytes
[#29] Received on [faas-request]: 'sequence:29 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"a45578ce-638f-4b3e-ba66-316295fbb4f8\"],\"X-Start-Time\":[\"1588053367050738845\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367051015995 '
[#29] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#17] Invoked: cows [200] in 0.442131s
[#17] cows returned 221 bytes
[#30] Received on [faas-request]: 'sequence:30 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"c4094cf2-65ed-4934-b526-9480a94021a8\"],\"X-Start-Time\":[\"1588053367075010567\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367076717092 '
[#30] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#20] Invoked: cows [200] in 0.379614s
[#20] cows returned 119 bytes
[#31] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#31] Received on [faas-request]: 'sequence:31 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"a62b20e9-8a26-44fd-8f07-0d61a5f07962\"],\"X-Start-Time\":[\"1588053367075213207\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367076719921 '
[#18] Invoked: cows [200] in 0.491082s
[#18] cows returned 69 bytes
[#32] Received on [faas-request]: 'sequence:32 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"cdf24c12-0817-435b-9903-703265a278f8\"],\"X-Start-Time\":[\"1588053367078159314\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367078350617 '
[#32] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#19] Invoked: cows [200] in 0.489102s
[#19] cows returned 126 bytes
[#33] Received on [faas-request]: 'sequence:33 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"21c1053c-6445-4b5f-8493-a8aecbcb736d\"],\"X-Start-Time\":[\"1588053367085191008\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367085652739 '
[#33] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#28] Invoked: cows [200] in 0.217954s
[#28] cows returned 272 bytes
[#34] Received on [faas-request]: 'sequence:34 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"af25b7d4-a26a-434a-8ba1-ca039dd71a18\"],\"X-Start-Time\":[\"1588053367086418624\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367086668429 '
[#34] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#21] Invoked: cows [200] in 0.486697s
[#21] cows returned 236 bytes
[#35] Received on [faas-request]: 'sequence:35 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"7c15e3f0-4c9b-4001-aea8-070dc30e2c5f\"],\"X-Start-Time\":[\"1588053367094473159\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367097833493 '
[#35] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#22] cows returned 289 bytes
[#22] Invoked: cows [200] in 0.456720s
[#36] Received on [faas-request]: 'sequence:36 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"f481f6e3-ce23-4c76-8412-ebce125b0d30\"],\"X-Start-Time\":[\"1588053367100643467\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367100877940 '
[#36] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#29] Invoked: cows [200] in 0.214135s
[#29] cows returned 108 bytes
[#37] Received on [faas-request]: 'sequence:37 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"50ea2df0-a11c-456a-9002-01dda4bc0656\"],\"X-Start-Time\":[\"1588053367106636437\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367107001266 '
[#37] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#25] Invoked: cows [200] in 0.426518s
[#25] cows returned 384 bytes
[#38] Received on [faas-request]: 'sequence:38 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"9fcd7856-c326-4ae6-9a7b-62e38e5c9e1f\"],\"X-Start-Time\":[\"1588053367120112935\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367121029551 '
[#38] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#24] Invoked: cows [200] in 0.443494s
[#24] cows returned 550 bytes
[#39] Received on [faas-request]: 'sequence:39 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"1a017e83-7c6f-4f32-8d53-fbdf853d84bf\"],\"X-Start-Time\":[\"1588053367120281337\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367121033643 '
[#39] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#30] Invoked: cows [200] in 0.245285s
[#30] cows returned 219 bytes
[#40] Received on [faas-request]: 'sequence:40 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"aa18db29-bd60-40af-ab46-89f7df36c34d\"],\"X-Start-Time\":[\"1588053367120368508\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367121033982 '
[#40] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#32] Invoked: cows [200] in 0.257978s
[#32] cows returned 86 bytes
[#41] Received on [faas-request]: 'sequence:41 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"1f1e1013-f523-49d1-83a0-271eaed14d0c\"],\"X-Start-Time\":[\"1588053367120432793\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367121034301 '
[#41] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#33] Invoked: cows [200] in 0.243507s
[#33] cows returned 94 bytes
[#42] Received on [faas-request]: 'sequence:42 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"5829dc34-78c3-40d1-92c2-ab9f8db01da7\"],\"X-Start-Time\":[\"1588053367132408538\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367132694855 '
[#42] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#34] Invoked: cows [200] in 0.222918s
[#34] cows returned 131 bytes
[#43] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#43] Received on [faas-request]: 'sequence:43 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"7f41a99b-9e60-4b2f-8f80-c6a0ec993474\"],\"X-Start-Time\":[\"1588053367137347057\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367137552381 '
[#31] Invoked: cows [200] in 0.355712s
[#31] cows returned 148 bytes
[#44] Received on [faas-request]: 'sequence:44 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"f439a333-5396-4f00-ba52-5981e23fb4e1\"],\"X-Start-Time\":[\"1588053367154446876\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367154705046 '
[#44] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#42] Invoked: cows [200] in 0.125402s
[#42] cows returned 409 bytes
[#41] Invoked: cows [200] in 0.129800s
[#41] cows returned 200 bytes
[#45] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#45] Received on [faas-request]: 'sequence:46 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"a099a7a3-d280-414d-aa25-f3959e972c19\"],\"X-Start-Time\":[\"1588053367160144947\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367160350835 '
[#46] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#46] Received on [faas-request]: 'sequence:45 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"55e30f57-dcb1-406d-a915-c9ef2a6ed48b\"],\"X-Start-Time\":[\"1588053367159580974\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367160348554 '
[#46] Invoked: cows [200] in 0.112137s
[#46] cows returned 143 bytes
[#45] cows returned 474 bytes
[#47] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#45] Invoked: cows [200] in 0.113724s
[#47] Received on [faas-request]: 'sequence:47 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"d8406743-c879-496b-a3d3-17ab0109817b\"],\"X-Start-Time\":[\"1588053367164979257\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367165195808 '
[#48] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#48] Received on [faas-request]: 'sequence:48 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"6469ccd6-5c63-4e90-866b-f7aed2e933c1\"],\"X-Start-Time\":[\"1588053367178984515\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367180471169 '
[#39] Invoked: cows [200] in 0.413480s
[#39] cows returned 100 bytes
[#49] Received on [faas-request]: 'sequence:49 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"1da79fc9-b864-4907-abca-7f43a949adcc\"],\"X-Start-Time\":[\"1588053367179191198\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367180474611 '
[#49] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#35] Invoked: cows [200] in 0.492083s
[#35] cows returned 933 bytes
[#50] Received on [faas-request]: 'sequence:50 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"e3b1aad4-525c-4e3f-b716-093b361d50e2\"],\"X-Start-Time\":[\"1588053367192771628\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367193392544 '
[#50] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#36] Invoked: cows [200] in 0.502852s
[#36] cows returned 148 bytes
[#51] Received on [faas-request]: 'sequence:51 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"a94c200f-2859-4977-8f11-fb6cb91671f3\"],\"X-Start-Time\":[\"1588053367192954331\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367193395251 '
[#51] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#38] Invoked: cows [200] in 0.468451s
[#38] cows returned 210 bytes
[#52] Received on [faas-request]: 'sequence:52 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"95fc21e5-6653-4852-9c1f-ee125fbab04f\"],\"X-Start-Time\":[\"1588053367204426739\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367205315807 '
[#52] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#37] Invoked: cows [200] in 0.492124s
[#37] cows returned 131 bytes
[#53] Received on [faas-request]: 'sequence:53 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"a93a46f4-d4c7-4098-8739-62e879c8aaaa\"],\"X-Start-Time\":[\"1588053367208042836\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367208765630 '
[#53] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#40] Invoked: cows [200] in 0.462500s
[#40] cows returned 149 bytes
[#54] Received on [faas-request]: 'sequence:54 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"9145768c-9a8e-43a2-8d8b-06ae2089c72a\"],\"X-Start-Time\":[\"1588053367208265232\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367208768850 '
[#54] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#43] Invoked: cows [200] in 0.434038s
[#43] cows returned 46 bytes
[#55] Received on [faas-request]: 'sequence:55 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"28a04e17-bef4-434b-a6bc-e4aa0348437a\"],\"X-Start-Time\":[\"1588053367208391067\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367208769337 '
[#55] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#44] Invoked: cows [200] in 0.386112s
[#44] cows returned 229 bytes
[#56] Received on [faas-request]: 'sequence:56 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"e1d0f98b-111d-4089-b45d-974f7a347c5f\"],\"X-Start-Time\":[\"1588053367209740034\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367209985774 '
[#56] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#47] Invoked: cows [200] in 0.273580s
[#47] cows returned 227 bytes
[#57] Received on [faas-request]: 'sequence:57 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"9c921598-f408-4898-981d-e96f05e169c5\"],\"X-Start-Time\":[\"1588053367216713359\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367217662136 '
[#57] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#48] Invoked: cows [200] in 0.283393s
[#48] cows returned 643 bytes
[#58] Received on [faas-request]: 'sequence:58 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"701287ec-44df-441c-ad0c-13c093c5e77f\"],\"X-Start-Time\":[\"1588053367216799660\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367217665161 '
[#58] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#53] Invoked: cows [200] in 0.211534s
[#53] cows returned 813 bytes
[#59] Received on [faas-request]: 'sequence:59 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"61c297e0-99f8-429c-a38e-032e45ea3160\"],\"X-Start-Time\":[\"1588053367220097854\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367220318752 '
[#59] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#54] Invoked: cows [200] in 0.212359s
[#54] cows returned 727 bytes
[#60] Received on [faas-request]: 'sequence:60 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"11aa6d60-c4d6-4b91-b509-bbe8478718d1\"],\"X-Start-Time\":[\"1588053367228736023\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367231052007 '
[#60] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#56] Invoked: cows [200] in 0.188979s
[#56] cows returned 290 bytes
[#61] Received on [faas-request]: 'sequence:61 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"de3105cb-4165-483b-b943-8d146e8e24b9\"],\"X-Start-Time\":[\"1588053367230248446\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367231054678 '
[#61] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#49] Invoked: cows [200] in 0.409748s
[#49] cows returned 77 bytes
[#62] Received on [faas-request]: 'sequence:62 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"1f52c871-6d29-48bd-9f00-96b0bb35c8fc\"],\"X-Start-Time\":[\"1588053367235842658\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367237172359 '
[#62] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#51] Invoked: cows [200] in 0.396781s
[#51] cows returned 248 bytes
[#63] Received on [faas-request]: 'sequence:63 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"26c9858c-97ac-49b3-b598-81789b9cb81b\"],\"X-Start-Time\":[\"1588053367245047866\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367246242999 '
[#63] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#50] Invoked: cows [200] in 0.414786s
[#50] cows returned 458 bytes
[#64] Received on [faas-request]: 'sequence:64 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"6a609f11-fd75-44d6-b72a-447d6545d4d7\"],\"X-Start-Time\":[\"1588053367246393453\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367246637457 '
[#64] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#52] Invoked: cows [200] in 0.395435s
[#52] cows returned 160 bytes
[#65] Received on [faas-request]: 'sequence:65 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"81f7c685-dc54-4000-8970-07b01608f49e\"],\"X-Start-Time\":[\"1588053367254973516\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367255328952 '
[#65] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#59] Invoked: cows [200] in 0.191234s
[#59] cows returned 534 bytes
[#66] Received on [faas-request]: 'sequence:66 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"ceb4cb0e-1740-4cd3-aea6-2531994113b4\"],\"X-Start-Time\":[\"1588053367255148807\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367255331238 '
[#66] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#60] Invoked: cows [200] in 0.196385s
[#60] cows returned 107 bytes
[#67] Received on [faas-request]: 'sequence:67 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"8e49999d-b73a-48c9-a226-80160468c092\"],\"X-Start-Time\":[\"1588053367259247909\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367262528714 '
[#67] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#55] Invoked: cows [200] in 0.385186s
[#55] cows returned 84 bytes
[#68] Received on [faas-request]: 'sequence:68 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"2ef9de0a-770a-49a9-9393-4bf69d388346\"],\"X-Start-Time\":[\"1588053367269637224\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367269905971 '
[#68] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#57] Invoked: cows [200] in 0.344373s
[#57] cows returned 221 bytes
[#69] Received on [faas-request]: 'sequence:69 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"ed79f8c5-cc25-466f-b7bc-539b1d555e62\"],\"X-Start-Time\":[\"1588053367301036870\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367301523846 '
[#69] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#58] Invoked: cows [200] in 0.349243s
[#61] Invoked: cows [200] in 0.232147s
[#58] cows returned 149 bytes
[#61] cows returned 1073 bytes
[#70] Received on [faas-request]: 'sequence:70 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"22536843-5106-4235-b3f8-16a30bc1a705\"],\"X-Start-Time\":[\"1588053367301242131\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367301527430 '
[#70] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#71] Received on [faas-request]: 'sequence:71 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"a21a7059-3a26-4381-bff1-654b56f7d44e\"],\"X-Start-Time\":[\"1588053367305656280\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367305990254 '
[#71] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#62] Invoked: cows [200] in 0.263187s
[#62] cows returned 55 bytes
[#72] Received on [faas-request]: 'sequence:72 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"584be151-ac72-4501-afdb-be264ab4269b\"],\"X-Start-Time\":[\"1588053367305780437\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367305992661 '
[#72] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#65] Invoked: cows [200] in 0.277827s
[#65] cows returned 112 bytes
[#73] Received on [faas-request]: 'sequence:73 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"82ec8f16-9a8f-4b04-9575-eb2212fd6b83\"],\"X-Start-Time\":[\"1588053367322323546\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367322589511 '
[#73] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#67] Invoked: cows [200] in 0.252443s
[#67] cows returned 187 bytes
[#74] Received on [faas-request]: 'sequence:74 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"49e6a6bf-914e-4655-b71f-eedfce9f745a\"],\"X-Start-Time\":[\"1588053367333611910\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367333986353 '
[#74] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#63] Invoked: cows [200] in 0.364172s
[#63] cows returned 499 bytes
[#75] Received on [faas-request]: 'sequence:75 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"354014ec-18fc-456a-908f-19b56bb1f54d\"],\"X-Start-Time\":[\"1588053367333770760\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367333988413 '
[#75] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#64] Invoked: cows [200] in 0.368264s
[#64] cows returned 208 bytes
[#76] Received on [faas-request]: 'sequence:76 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"e4d25fc5-6e31-433b-b927-c720093e652a\"],\"X-Start-Time\":[\"1588053367339807967\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367340042268 '
[#76] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#68] Invoked: cows [200] in 0.275764s
[#68] cows returned 229 bytes
[#77] Received on [faas-request]: 'sequence:77 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"855725f9-7dd3-49e6-a1df-8d4fc98dc227\"],\"X-Start-Time\":[\"1588053367345643934\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367345881438 '
[#77] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#66] Invoked: cows [200] in 0.356356s
[#66] cows returned 89 bytes
[#78] Received on [faas-request]: 'sequence:78 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"a1504801-f336-4a7d-94ab-50f2e527caf3\"],\"X-Start-Time\":[\"1588053367354669400\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367355025239 '
[#78] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#72] Invoked: cows [200] in 0.248732s
[#72] cows returned 92 bytes
[#79] Received on [faas-request]: 'sequence:79 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"074a0164-b26a-4607-bc03-73c1095866cb\"],\"X-Start-Time\":[\"1588053367359408852\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367359817831 '
[#79] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#69] Invoked: cows [200] in 0.359703s
[#69] cows returned 191 bytes
[#80] Received on [faas-request]: 'sequence:80 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"aa157a54-80ca-421b-99a7-7cd15a1b46b3\"],\"X-Start-Time\":[\"1588053367359576847\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367359820165 '
[#80] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#70] Invoked: cows [200] in 0.348210s
[#70] cows returned 308 bytes
[#81] Received on [faas-request]: 'sequence:81 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"3896cde7-681b-4d5e-a55d-8e5c32fa91af\"],\"X-Start-Time\":[\"1588053367365223177\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367365474899 '
[#81] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#71] Invoked: cows [200] in 0.377214s
[#71] cows returned 172 bytes
[#82] Received on [faas-request]: 'sequence:82 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"55089059-72ad-404a-bc61-86d60984a170\"],\"X-Start-Time\":[\"1588053367372132991\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367372485467 '
[#82] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#73] Invoked: cows [200] in 0.290538s
[#73] cows returned 221 bytes
[#83] Received on [faas-request]: 'sequence:83 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"c0d48ca2-f660-49d5-bc73-12ab4e9192a1\"],\"X-Start-Time\":[\"1588053367373276816\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367373454656 '
[#83] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#74] Invoked: cows [200] in 0.290777s
[#74] cows returned 281 bytes
[#84] Received on [faas-request]: 'sequence:84 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"f8a86157-0504-441e-b64d-3ff11b839ffb\"],\"X-Start-Time\":[\"1588053367375361806\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367375592574 '
[#84] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#76] Invoked: cows [200] in 0.239143s
[#76] cows returned 221 bytes
[#85] Received on [faas-request]: 'sequence:85 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"626c2356-1345-43e2-93ed-8de85aff98d7\"],\"X-Start-Time\":[\"1588053367394026756\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367394338781 '
[#85] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#75] Invoked: cows [200] in 0.249627s
[#75] cows returned 256 bytes
[#86] Received on [faas-request]: 'sequence:86 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"ff300026-224a-4a4d-92a0-f45dc7e9ecfb\"],\"X-Start-Time\":[\"1588053367400593320\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367401059463 '
[#86] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#77] Invoked: cows [200] in 0.235525s
[#77] cows returned 542 bytes
[#87] Received on [faas-request]: 'sequence:87 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"762773ab-f6b6-4644-9d17-e973dcd4b61c\"],\"X-Start-Time\":[\"1588053367400791793\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367401062007 '
[#87] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#81] Invoked: cows [200] in 0.223036s
[#81] cows returned 244 bytes
[#88] Received on [faas-request]: 'sequence:88 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"b3ff5322-e601-4222-a737-49973b0d1aef\"],\"X-Start-Time\":[\"1588053367405279630\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367405559055 '
[#88] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#78] Invoked: cows [200] in 0.350251s
[#78] cows returned 397 bytes
[#89] Received on [faas-request]: 'sequence:89 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"67225702-4d1d-4fb3-8e12-d560e719c377\"],\"X-Start-Time\":[\"1588053367412079612\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367412325120 '
[#89] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#85] Invoked: cows [200] in 0.196188s
[#85] cows returned 122 bytes
[#90] Received on [faas-request]: 'sequence:90 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"7d4bc39d-cca2-4ed6-8247-e9f73cdcc4fd\"],\"X-Start-Time\":[\"1588053367418335812\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367418944119 '
[#90] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#87] Invoked: cows [200] in 0.259927s
[#87] cows returned 210 bytes
[#91] Received on [faas-request]: 'sequence:91 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"389f92b0-34b1-407b-8182-f1c695263e2e\"],\"X-Start-Time\":[\"1588053367432224863\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367432521588 '
[#91] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#86] Invoked: cows [200] in 0.271418s
[#86] cows returned 97 bytes
[#92] Received on [faas-request]: 'sequence:92 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"e687b551-9ebe-47ea-8094-5c49eec4b350\"],\"X-Start-Time\":[\"1588053367439249509\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367439504514 '
[#92] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#79] Invoked: cows [200] in 0.416490s
[#79] cows returned 77 bytes
[#88] Invoked: cows [200] in 0.186356s
[#88] cows returned 221 bytes
[#93] Received on [faas-request]: 'sequence:94 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"c208e895-0eef-4f12-975f-0b807b4456e8\"],\"X-Start-Time\":[\"1588053367440651288\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367441150643 '
[#93] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#94] Received on [faas-request]: 'sequence:93 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"158f1dec-1257-45e6-9263-9023d0d0da44\"],\"X-Start-Time\":[\"1588053367440510517\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367441149046 '
[#94] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#89] Invoked: cows [200] in 0.173041s
[#89] cows returned 280 bytes
[#95] Received on [faas-request]: 'sequence:95 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"4da4aba8-8ce9-4195-881b-567a98d8424a\"],\"X-Start-Time\":[\"1588053367440755227\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367441151027 '
[#95] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#80] Invoked: cows [200] in 0.441642s
[#80] cows returned 160 bytes
[#96] Received on [faas-request]: 'sequence:96 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"411d7310-c24c-44e8-936c-22ee55966248\"],\"X-Start-Time\":[\"1588053367448271944\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367448788949 '
[#96] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#82] Invoked: cows [200] in 0.419581s
[#82] cows returned 111 bytes
[#97] Received on [faas-request]: 'sequence:97 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"791c08d4-d242-4ad2-9ce3-cae4cf4a2087\"],\"X-Start-Time\":[\"1588053367451096400\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367451559359 '
[#97] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#83] Invoked: cows [200] in 0.409616s
[#83] cows returned 310 bytes
[#98] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#98] Received on [faas-request]: 'sequence:98 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"5cfe2258-3fde-4785-9c1b-c37083537084\"],\"X-Start-Time\":[\"1588053367453466774\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367454068977 '
[#84] Invoked: cows [200] in 0.401153s
[#84] cows returned 283 bytes
[#99] Received on [faas-request]: 'sequence:99 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"0084b3e0-ad4b-4750-b5c4-adc8de67568c\"],\"X-Start-Time\":[\"1588053367465992313\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367469220628 '
[#99] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#90] Invoked: cows [200] in 0.221186s
[#90] cows returned 100 bytes
[#100] Received on [faas-request]: 'sequence:100 subject:"faas-request" data:"{\"Header\":{\"Accept\":[\"*/*\"],\"Content-Length\":[\"2\"],\"Content-Type\":[\"application/x-www-form-urlencoded\"],\"User-Agent\":[\"curl/7.64.1\"],\"X-Call-Id\":[\"76d92716-c995-4305-b570-f0f9d246651e\"],\"X-Start-Time\":[\"1588053367468895506\"]},\"Host\":\"127.0.0.1:31112\",\"Body\":\"e30=\",\"Method\":\"POST\",\"Path\":\"\",\"QueryString\":\"\",\"Function\":\"cows\",\"QueueName\":\"\",\"CallbackUrl\":null}" timestamp:1588053367469223140 '
[#100] Invoking: cows with 2 bytes, via: http://gateway.openfaas.svc.cluster.local:8080/function/cows/
[#91] Invoked: cows [200] in 0.209727s
[#91] cows returned 306 bytes
[#95] Invoked: cows [200] in 0.222290s
[#95] cows returned 131 bytes
[#94] Invoked: cows [200] in 0.238848s
[#94] cows returned 99 bytes
[#99] Invoked: cows [200] in 0.170225s
[#99] cows returned 105 bytes
[#96] Invoked: cows [200] in 0.255603s
[#96] cows returned 104 bytes
[#93] Invoked: cows [200] in 0.284509s
[#93] cows returned 145 bytes
[#97] Invoked: cows [200] in 0.249226s
[#97] cows returned 121 bytes
[#92] Invoked: cows [200] in 0.310895s
[#92] cows returned 384 bytes
[#98] Invoked: cows [200] in 0.215637s
[#98] cows returned 219 bytes
[#100] Invoked: cows [200] in 0.192640s
[#100] cows returned 86 bytes
 01:56:59 >
derek[bot] commented 4 years ago

Thank you for your contribution. I've just checked and your commit doesn't appear to be signed-off. That's something we need before your Pull Request can be merged. Please see our contributing guide. Tip: if you only have one commit so far then run: git commit --amend --signoff and then git push --force.

alexellis commented 4 years ago

@LucasRoesler PTAL

alexellis commented 4 years ago

Thank you for the PR and for the attention to detail, we had several things "wrong" here and it's great to have the NATS team help us out. What are your thoughts on extracting the closure for processing messages to its own function?

alexellis commented 4 years ago

@matthiashanel please could you make an update to the README.md for the changes made in this PR?

A quick update in the docs for the async page would also be appreciated, if you have time? https://github.com/openfaas/docs

https://github.com/openfaas/docs/blob/master/docs/reference/async.md

LucasRoesler commented 4 years ago

I think this line in the README needs to be removed after this PR, since the durable config was also removed in this PR https://github.com/openfaas/nats-queue-worker/blame/master/README.md#L37

alexellis commented 4 years ago

Agreed, I also mentioned that here -> https://github.com/openfaas/nats-queue-worker/pull/95#discussion_r418503395

@matthiashanel is in the US so will be online a little later than us in Europe. The new options also need to be documented here and in the docs website.

matthiashanel commented 4 years ago

@alexellis @LucasRoesler hey, I will update the readme in the same change I'll also account for the helm change for max in flight