Closed JH7 closed 2 years ago
@JH7 Thank you for the detailed report, but not only I cannot reproduce, but the log that you attached above does not match your description, meaning that from the log we see that the last produced message ('test3') goes only to CLIENT:
2022/05/06 08:37:21.809382 [TRC] 172.19.0.1:53962 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB orders.client.stream.entry 5]
2022/05/06 08:37:21.809393 [TRC] 172.19.0.1:53962 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: ["test3"]
is sent to only this client:
2022/05/06 08:37:21.809463 [TRC] 172.19.0.1:53954 - cid:23 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [MSG orders.client.stream.entry 1 5]
which cid:23
correspond to your CLIENT, not CLIENT2:
2022/05/06 08:37:14.088585 [TRC] 172.19.0.1:53954 - cid:23 - <<- [CONNECT {"verbose":false,"pedantic":false,"user":"client","pass":"[REDACTED]","tls_required":false,"name":"NATS CLI Version 0.0.28","lang":"go","version":"1.13.0","protocol":1,"echo":true,"headers":true,"no_responders":true}]
2022/05/06 08:37:14.088624 [TRC] 172.19.0.1:53954 - cid:23 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PING]
2022/05/06 08:37:14.088626 [TRC] 172.19.0.1:53954 - cid:23 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PONG]
2022/05/06 08:37:14.088962 [TRC] 172.19.0.1:53954 - cid:23 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [SUB orders.> 1]
2022/05/06 08:37:14.088986 [DBG] 172.19.0.1:53954 - cid:23 - "v1.13.0:go:NATS CLI Version 0.0.28" - Creating import subscription on "orders.client.stream.>" from account "PUBLIC"
Did you miss some steps? (by the way, the steps from the log do not really match the steps described in the report, but I have tried both and in no case I can reproduce CLIENT2 getting the message at the same time than CLIENT).
@kozlovic sorry for the confusion, the log includes more testing on my side.
The following log contains the following actions:
nats --user client --password client stream info orders
nats --user client2 --password client2 stream info orders
nats --user client --password client stream view orders
nats --user client2 --password client2 stream view orders
(to confirm that the message in the streams is the test2
message)The log and the CLI show that both streams contain one message. stream view orders
confirms that this message is the test2
message in both cases.
Log:
2022/05/09 10:43:05.310523 [INF] Starting nats-server
2022/05/09 10:43:05.310550 [INF] Version: 2.8.2
2022/05/09 10:43:05.310552 [INF] Git: [9e5d25b]
2022/05/09 10:43:05.310553 [DBG] Go build: go1.17.9
2022/05/09 10:43:05.310555 [INF] Name: NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB
2022/05/09 10:43:05.310558 [INF] Node: GWIUpq6g
2022/05/09 10:43:05.310559 [INF] ID: NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB
2022/05/09 10:43:05.310560 [WRN] Plaintext passwords detected, use nkeys or bcrypt
2022/05/09 10:43:05.310563 [INF] Using configuration file: /etc/nats/nats-server.conf
2022/05/09 10:43:05.310573 [DBG] Created system account: "$SYS"
2022/05/09 10:43:05.310702 [INF] Starting JetStream
2022/05/09 10:43:05.310867 [DBG] JetStream creating dynamic configuration - 9.32 GB memory, 146.04 GB disk
2022/05/09 10:43:05.310978 [INF] _ ___ _____ ___ _____ ___ ___ _ __ __
2022/05/09 10:43:05.310991 [INF] _ | | __|_ _/ __|_ _| _ \ __| /_\ | \/ |
2022/05/09 10:43:05.310994 [INF] | || | _| | | \__ \ | | | / _| / _ \| |\/| |
2022/05/09 10:43:05.310996 [INF] \__/|___| |_| |___/ |_| |_|_\___/_/ \_\_| |_|
2022/05/09 10:43:05.310997 [INF]
2022/05/09 10:43:05.310998 [INF] https://docs.nats.io/jetstream
2022/05/09 10:43:05.310999 [INF]
2022/05/09 10:43:05.311000 [INF] ---------------- JETSTREAM ----------------
2022/05/09 10:43:05.311002 [INF] Max Memory: 9.32 GB
2022/05/09 10:43:05.311004 [INF] Max Storage: 146.04 GB
2022/05/09 10:43:05.311005 [INF] Store Directory: "/tmp/nats/jetstream"
2022/05/09 10:43:05.311005 [INF] -------------------------------------------
2022/05/09 10:43:05.311037 [DBG] Exports:
2022/05/09 10:43:05.311047 [DBG] $JS.API.>
2022/05/09 10:43:05.311063 [DBG] Enabled JetStream for account "CLIENT"
2022/05/09 10:43:05.311070 [DBG] Max Memory: -1 B
2022/05/09 10:43:05.311072 [DBG] Max Storage: -1 B
2022/05/09 10:43:05.311195 [DBG] JetStream state for account "CLIENT" recovered
2022/05/09 10:43:05.311221 [DBG] Enabled JetStream for account "CLIENT2"
2022/05/09 10:43:05.311235 [DBG] Max Memory: -1 B
2022/05/09 10:43:05.311238 [DBG] Max Storage: -1 B
2022/05/09 10:43:05.311392 [DBG] JetStream state for account "CLIENT2" recovered
2022/05/09 10:43:05.311631 [INF] Listening for client connections on 0.0.0.0:4222
2022/05/09 10:43:05.311647 [DBG] Get non local IPs for "0.0.0.0"
2022/05/09 10:43:05.311759 [DBG] ip=172.18.0.2
2022/05/09 10:43:05.311789 [INF] Server is ready
2022/05/09 10:43:13.285218 [DBG] 172.18.0.1:56136 - cid:7 - Client connection created
2022/05/09 10:43:13.285692 [TRC] 172.18.0.1:56136 - cid:7 - <<- [CONNECT {"verbose":false,"pedantic":false,"user":"client","pass":"[REDACTED]","tls_required":false,"name":"NATS CLI Version 0.0.28","lang":"go","version":"1.13.0","protocol":1,"echo":true,"headers":true,"no_responders":true}]
2022/05/09 10:43:13.285772 [TRC] 172.18.0.1:56136 - cid:7 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PING]
2022/05/09 10:43:13.285783 [TRC] 172.18.0.1:56136 - cid:7 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PONG]
2022/05/09 10:43:13.286163 [TRC] 172.18.0.1:56136 - cid:7 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [SUB orders.> 1]
2022/05/09 10:43:13.286180 [DBG] 172.18.0.1:56136 - cid:7 - "v1.13.0:go:NATS CLI Version 0.0.28" - Creating import subscription on "orders.client.stream.>" from account "PUBLIC"
2022/05/09 10:43:13.286186 [TRC] 172.18.0.1:56136 - cid:7 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PING]
2022/05/09 10:43:13.286188 [TRC] 172.18.0.1:56136 - cid:7 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PONG]
2022/05/09 10:43:14.515215 [DBG] 172.18.0.1:56140 - cid:8 - Client connection created
2022/05/09 10:43:14.515666 [TRC] 172.18.0.1:56140 - cid:8 - <<- [CONNECT {"verbose":false,"pedantic":false,"user":"client2","pass":"[REDACTED]","tls_required":false,"name":"NATS CLI Version 0.0.28","lang":"go","version":"1.13.0","protocol":1,"echo":true,"headers":true,"no_responders":true}]
2022/05/09 10:43:14.515734 [TRC] 172.18.0.1:56140 - cid:8 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PING]
2022/05/09 10:43:14.515744 [TRC] 172.18.0.1:56140 - cid:8 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PONG]
2022/05/09 10:43:14.516182 [TRC] 172.18.0.1:56140 - cid:8 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [SUB orders.> 1]
2022/05/09 10:43:14.516201 [DBG] 172.18.0.1:56140 - cid:8 - "v1.13.0:go:NATS CLI Version 0.0.28" - Creating import subscription on "orders.client2.stream.>" from account "PUBLIC"
2022/05/09 10:43:14.516206 [TRC] 172.18.0.1:56140 - cid:8 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PING]
2022/05/09 10:43:14.516208 [TRC] 172.18.0.1:56140 - cid:8 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PONG]
2022/05/09 10:43:15.666770 [DBG] 172.18.0.1:56136 - cid:7 - "v1.13.0:go:NATS CLI Version 0.0.28" - Client Ping Timer
2022/05/09 10:43:15.666803 [TRC] 172.18.0.1:56136 - cid:7 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PING]
2022/05/09 10:43:15.667213 [TRC] 172.18.0.1:56136 - cid:7 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PONG]
2022/05/09 10:43:16.914427 [DBG] 172.18.0.1:56140 - cid:8 - "v1.13.0:go:NATS CLI Version 0.0.28" - Client Ping Timer
2022/05/09 10:43:16.914462 [TRC] 172.18.0.1:56140 - cid:8 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PING]
2022/05/09 10:43:16.914926 [TRC] 172.18.0.1:56140 - cid:8 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PONG]
2022/05/09 10:43:17.189237 [DBG] 172.18.0.1:56144 - cid:9 - Client connection created
2022/05/09 10:43:17.189698 [TRC] 172.18.0.1:56144 - cid:9 - <<- [CONNECT {"verbose":false,"pedantic":false,"user":"public","pass":"[REDACTED]","tls_required":false,"name":"NATS CLI Version 0.0.28","lang":"go","version":"1.13.0","protocol":1,"echo":true,"headers":true,"no_responders":true}]
2022/05/09 10:43:17.189760 [TRC] 172.18.0.1:56144 - cid:9 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PING]
2022/05/09 10:43:17.189764 [TRC] 172.18.0.1:56144 - cid:9 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PONG]
2022/05/09 10:43:17.190106 [TRC] 172.18.0.1:56144 - cid:9 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB orders.client.stream.entry 5]
2022/05/09 10:43:17.190123 [TRC] 172.18.0.1:56144 - cid:9 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: ["test1"]
2022/05/09 10:43:17.190130 [TRC] 172.18.0.1:56136 - cid:7 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [MSG orders.client.stream.entry 1 5]
2022/05/09 10:43:17.190149 [TRC] 172.18.0.1:56144 - cid:9 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PING]
2022/05/09 10:43:17.190159 [TRC] 172.18.0.1:56144 - cid:9 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PONG]
2022/05/09 10:43:17.190547 [DBG] 172.18.0.1:56144 - cid:9 - "v1.13.0:go:NATS CLI Version 0.0.28" - Client connection closed: Client Closed
2022/05/09 10:43:18.795337 [DBG] 172.18.0.1:56136 - cid:7 - "v1.13.0:go:NATS CLI Version 0.0.28" - Client connection closed: Client Closed
2022/05/09 10:43:18.795375 [TRC] 172.18.0.1:56136 - cid:7 - "v1.13.0:go:NATS CLI Version 0.0.28" - <-> [DELSUB 1]
2022/05/09 10:43:19.716427 [DBG] 172.18.0.1:56140 - cid:8 - "v1.13.0:go:NATS CLI Version 0.0.28" - Client connection closed: Client Closed
2022/05/09 10:43:19.716466 [TRC] 172.18.0.1:56140 - cid:8 - "v1.13.0:go:NATS CLI Version 0.0.28" - <-> [DELSUB 1]
2022/05/09 10:43:22.092046 [DBG] 172.18.0.1:56148 - cid:10 - Client connection created
2022/05/09 10:43:22.092501 [TRC] 172.18.0.1:56148 - cid:10 - <<- [CONNECT {"verbose":false,"pedantic":false,"user":"client","pass":"[REDACTED]","tls_required":false,"name":"NATS CLI Version 0.0.28","lang":"go","version":"1.13.0","protocol":1,"echo":true,"headers":true,"no_responders":true}]
2022/05/09 10:43:22.092561 [TRC] 172.18.0.1:56148 - cid:10 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PING]
2022/05/09 10:43:22.092563 [TRC] 172.18.0.1:56148 - cid:10 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PONG]
2022/05/09 10:43:22.093639 [TRC] 172.18.0.1:56148 - cid:10 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [SUB _INBOX.qqARrwlVh1S6wCEHqAlXsW.* 1]
2022/05/09 10:43:22.093657 [TRC] 172.18.0.1:56148 - cid:10 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB $JS.API.STREAM.CREATE.orders _INBOX.qqARrwlVh1S6wCEHqAlXsW.Ejh7VOCn 344]
2022/05/09 10:43:22.093667 [TRC] 172.18.0.1:56148 - cid:10 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: ["{\"name\":\"orders\",\"subjects\":[\"orders.*.stream.entry\"],\"retention\":\"workqueue\",\"max_consumers\":-1,\"max_msgs_per_subject\":-1,\"max_msgs\":-1,\"max_bytes\":-1,\"max_age\":0,\"max_msg_size\":-1,\"storage\":\"file\",\"discard\":\"old\",\"num_replicas\":1,\"duplicate_window\":120000000000,\"sealed\":false,\"deny_delete\":false,\"deny_purge\":false,\"allow_rollup_hdrs\":false}"]
2022/05/09 10:43:22.094242 [DBG] JETSTREAM - Creating import subscription on "orders.*.stream.entry" from account "PUBLIC"
2022/05/09 10:43:22.094396 [TRC] 172.18.0.1:56148 - cid:10 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [MSG _INBOX.qqARrwlVh1S6wCEHqAlXsW.Ejh7VOCn 1 617]
2022/05/09 10:43:22.094405 [TRC] ACCOUNT - <<- [PUB $JS.EVENT.ADVISORY.API 1627]
2022/05/09 10:43:22.094419 [TRC] ACCOUNT - <<- MSG_PAYLOAD: ["{\"type\":\"io.nats.jetstream.advisory.v1.api_audit\",\"id\":\"isI2aINuYbNfJPUOv5LVLz\",\"timestamp\":\"2022-05-09T10:43:22.0943598Z\",\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"client\":{\"start\":\"2022-05-09T10:43:22.0920086Z\",\"host\":\"172.18.0.1\",\"id\":10,\"acc\":\"CLIENT\",\"user\":\"client\",\"name\":\"NATS CLI Version 0.0.28\",\"lang\":\"go\",\"ver\":\"1.13.0\",\"rtt\":504600,\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"kind\":\"Client\",\"client_type\":\"nats\"},\"subject\":\"$JS.API.STREAM.CREATE.orders\",\"request\":\"{\\\"name\\\":\\\"orders\\\",\\\"subjects\\\":[\\\"orders.*.stream.entry\\\"],\\\"retention\\\":\\\"workqueue\\\",\\\"max_consumers\\\":-1,\\\"max_msgs_per_subject\\\":-1,\\\"max_msgs\\\":-1,\\\"max_bytes\\\":-1,\\\"max_age\\\":0,\\\"max_msg_size\\\":-1,\\\"storage\\\":\\\"file\\\",\\\"discard\\\":\\\"old\\\",\\\"num_replicas\\\":1,\\\"duplicate_window\\\":120000000000,\\\"sealed\\\":false,\\\"deny_delete\\\":false,\\\"deny_purge\\\":false,\\\"allow_rollup_hdrs\\\":false}\",\"response\":\"{\\\"type\\\":\\\"io.nats.jetstream.api.v1.stream_create_response\\\",\\\"config\\\":{\\\"name\\\":\\\"orders\\\",\\\"subjects\\\":[\\\"orders.*.stream.entry\\\"],\\\"retention\\\":\\\"workqueue\\\",\\\"max_consumers\\\":-1,\\\"max_msgs\\\":-1,\\\"max_bytes\\\":-1,\\\"max_age\\\":0,\\\"max_msgs_per_subject\\\":-1,\\\"max_msg_size\\\":-1,\\\"discard\\\":\\\"old\\\",\\\"storage\\\":\\\"file\\\",\\\"num_replicas\\\":1,\\\"duplicate_window\\\":120000000000,\\\"sealed\\\":false,\\\"deny_delete\\\":false,\\\"deny_purge\\\":false,\\\"allow_rollup_hdrs\\\":false},\\\"created\\\":\\\"2022-05-09T10:43:22.0938638Z\\\",\\\"state\\\":{\\\"messages\\\":0,\\\"bytes\\\":0,\\\"first_seq\\\":0,\\\"first_ts\\\":\\\"0001-01-01T00:00:00Z\\\",\\\"last_seq\\\":0,\\\"last_ts\\\":\\\"0001-01-01T00:00:00Z\\\",\\\"consumer_count\\\":0},\\\"did_create\\\":true}\"}"]
2022/05/09 10:43:22.096562 [DBG] 172.18.0.1:56148 - cid:10 - "v1.13.0:go:NATS CLI Version 0.0.28" - Client connection closed: Client Closed
2022/05/09 10:43:22.096598 [TRC] 172.18.0.1:56148 - cid:10 - "v1.13.0:go:NATS CLI Version 0.0.28" - <-> [DELSUB 1]
2022/05/09 10:43:24.864512 [DBG] 172.18.0.1:56152 - cid:15 - Client connection created
2022/05/09 10:43:24.865411 [TRC] 172.18.0.1:56152 - cid:15 - <<- [CONNECT {"verbose":false,"pedantic":false,"user":"client2","pass":"[REDACTED]","tls_required":false,"name":"NATS CLI Version 0.0.28","lang":"go","version":"1.13.0","protocol":1,"echo":true,"headers":true,"no_responders":true}]
2022/05/09 10:43:24.865462 [TRC] 172.18.0.1:56152 - cid:15 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PING]
2022/05/09 10:43:24.865471 [TRC] 172.18.0.1:56152 - cid:15 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PONG]
2022/05/09 10:43:24.866548 [TRC] 172.18.0.1:56152 - cid:15 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [SUB _INBOX.BafRYPjlqq4rOQdJD2kIqb.* 1]
2022/05/09 10:43:24.866564 [TRC] 172.18.0.1:56152 - cid:15 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB $JS.API.STREAM.CREATE.orders _INBOX.BafRYPjlqq4rOQdJD2kIqb.k8JsyJVX 344]
2022/05/09 10:43:24.866573 [TRC] 172.18.0.1:56152 - cid:15 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: ["{\"name\":\"orders\",\"subjects\":[\"orders.*.stream.entry\"],\"retention\":\"workqueue\",\"max_consumers\":-1,\"max_msgs_per_subject\":-1,\"max_msgs\":-1,\"max_bytes\":-1,\"max_age\":0,\"max_msg_size\":-1,\"storage\":\"file\",\"discard\":\"old\",\"num_replicas\":1,\"duplicate_window\":120000000000,\"sealed\":false,\"deny_delete\":false,\"deny_purge\":false,\"allow_rollup_hdrs\":false}"]
2022/05/09 10:43:24.867001 [DBG] JETSTREAM - Creating import subscription on "orders.*.stream.entry" from account "PUBLIC"
2022/05/09 10:43:24.867064 [TRC] 172.18.0.1:56152 - cid:15 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [MSG _INBOX.BafRYPjlqq4rOQdJD2kIqb.k8JsyJVX 1 617]
2022/05/09 10:43:24.867079 [TRC] ACCOUNT - <<- [PUB $JS.EVENT.ADVISORY.API 1629]
2022/05/09 10:43:24.867107 [TRC] ACCOUNT - <<- MSG_PAYLOAD: ["{\"type\":\"io.nats.jetstream.advisory.v1.api_audit\",\"id\":\"isI2aINuYbNfJPUOv5LVND\",\"timestamp\":\"2022-05-09T10:43:24.8670363Z\",\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"client\":{\"start\":\"2022-05-09T10:43:24.8644706Z\",\"host\":\"172.18.0.1\",\"id\":15,\"acc\":\"CLIENT2\",\"user\":\"client2\",\"name\":\"NATS CLI Version 0.0.28\",\"lang\":\"go\",\"ver\":\"1.13.0\",\"rtt\":951800,\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"kind\":\"Client\",\"client_type\":\"nats\"},\"subject\":\"$JS.API.STREAM.CREATE.orders\",\"request\":\"{\\\"name\\\":\\\"orders\\\",\\\"subjects\\\":[\\\"orders.*.stream.entry\\\"],\\\"retention\\\":\\\"workqueue\\\",\\\"max_consumers\\\":-1,\\\"max_msgs_per_subject\\\":-1,\\\"max_msgs\\\":-1,\\\"max_bytes\\\":-1,\\\"max_age\\\":0,\\\"max_msg_size\\\":-1,\\\"storage\\\":\\\"file\\\",\\\"discard\\\":\\\"old\\\",\\\"num_replicas\\\":1,\\\"duplicate_window\\\":120000000000,\\\"sealed\\\":false,\\\"deny_delete\\\":false,\\\"deny_purge\\\":false,\\\"allow_rollup_hdrs\\\":false}\",\"response\":\"{\\\"type\\\":\\\"io.nats.jetstream.api.v1.stream_create_response\\\",\\\"config\\\":{\\\"name\\\":\\\"orders\\\",\\\"subjects\\\":[\\\"orders.*.stream.entry\\\"],\\\"retention\\\":\\\"workqueue\\\",\\\"max_consumers\\\":-1,\\\"max_msgs\\\":-1,\\\"max_bytes\\\":-1,\\\"max_age\\\":0,\\\"max_msgs_per_subject\\\":-1,\\\"max_msg_size\\\":-1,\\\"discard\\\":\\\"old\\\",\\\"storage\\\":\\\"file\\\",\\\"num_replicas\\\":1,\\\"duplicate_window\\\":120000000000,\\\"sealed\\\":false,\\\"deny_delete\\\":false,\\\"deny_purge\\\":false,\\\"allow_rollup_hdrs\\\":false},\\\"created\\\":\\\"2022-05-09T10:43:24.8666674Z\\\",\\\"state\\\":{\\\"messages\\\":0,\\\"bytes\\\":0,\\\"first_seq\\\":0,\\\"first_ts\\\":\\\"0001-01-01T00:00:00Z\\\",\\\"last_seq\\\":0,\\\"last_ts\\\":\\\"0001-01-01T00:00:00Z\\\",\\\"consumer_count\\\":0},\\\"did_create\\\":true}\"}"]
2022/05/09 10:43:24.869192 [DBG] 172.18.0.1:56152 - cid:15 - "v1.13.0:go:NATS CLI Version 0.0.28" - Client connection closed: Client Closed
2022/05/09 10:43:24.869232 [TRC] 172.18.0.1:56152 - cid:15 - "v1.13.0:go:NATS CLI Version 0.0.28" - <-> [DELSUB 1]
2022/05/09 10:43:27.460781 [DBG] 172.18.0.1:56156 - cid:19 - Client connection created
2022/05/09 10:43:27.461202 [TRC] 172.18.0.1:56156 - cid:19 - <<- [CONNECT {"verbose":false,"pedantic":false,"user":"public","pass":"[REDACTED]","tls_required":false,"name":"NATS CLI Version 0.0.28","lang":"go","version":"1.13.0","protocol":1,"echo":true,"headers":true,"no_responders":true}]
2022/05/09 10:43:27.461268 [TRC] 172.18.0.1:56156 - cid:19 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PING]
2022/05/09 10:43:27.461273 [TRC] 172.18.0.1:56156 - cid:19 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PONG]
2022/05/09 10:43:27.461639 [TRC] 172.18.0.1:56156 - cid:19 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB orders.client.stream.entry 5]
2022/05/09 10:43:27.461651 [TRC] 172.18.0.1:56156 - cid:19 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: ["test2"]
2022/05/09 10:43:27.461757 [TRC] 172.18.0.1:56156 - cid:19 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PING]
2022/05/09 10:43:27.461769 [TRC] 172.18.0.1:56156 - cid:19 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PONG]
2022/05/09 10:43:27.462184 [DBG] 172.18.0.1:56156 - cid:19 - "v1.13.0:go:NATS CLI Version 0.0.28" - Client connection closed: Client Closed
2022/05/09 10:43:35.335749 [DBG] 172.18.0.1:56160 - cid:20 - Client connection created
2022/05/09 10:43:35.336189 [TRC] 172.18.0.1:56160 - cid:20 - <<- [CONNECT {"verbose":false,"pedantic":false,"user":"client","pass":"[REDACTED]","tls_required":false,"name":"NATS CLI Version 0.0.28","lang":"go","version":"1.13.0","protocol":1,"echo":true,"headers":true,"no_responders":true}]
2022/05/09 10:43:35.336255 [TRC] 172.18.0.1:56160 - cid:20 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PING]
2022/05/09 10:43:35.336259 [TRC] 172.18.0.1:56160 - cid:20 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PONG]
2022/05/09 10:43:35.336597 [TRC] 172.18.0.1:56160 - cid:20 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [SUB _INBOX.0zQx2tiRt8Sya3Nmw7ZJnT.* 1]
2022/05/09 10:43:35.336615 [TRC] 172.18.0.1:56160 - cid:20 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB $JS.API.STREAM.INFO.orders _INBOX.0zQx2tiRt8Sya3Nmw7ZJnT.RrCbkjPq 0]
2022/05/09 10:43:35.336618 [TRC] 172.18.0.1:56160 - cid:20 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: [""]
2022/05/09 10:43:35.336765 [TRC] 172.18.0.1:56160 - cid:20 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [MSG _INBOX.0zQx2tiRt8Sya3Nmw7ZJnT.RrCbkjPq 1 631]
2022/05/09 10:43:35.336780 [TRC] ACCOUNT - <<- [PUB $JS.EVENT.ADVISORY.API 1238]
2022/05/09 10:43:35.336791 [TRC] ACCOUNT - <<- MSG_PAYLOAD: ["{\"type\":\"io.nats.jetstream.advisory.v1.api_audit\",\"id\":\"isI2aINuYbNfJPUOv5LVNp\",\"timestamp\":\"2022-05-09T10:43:35.3367337Z\",\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"client\":{\"start\":\"2022-05-09T10:43:35.3356972Z\",\"host\":\"172.18.0.1\",\"id\":20,\"acc\":\"CLIENT\",\"user\":\"client\",\"name\":\"NATS CLI Version 0.0.28\",\"lang\":\"go\",\"ver\":\"1.13.0\",\"rtt\":503300,\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"kind\":\"Client\",\"client_type\":\"nats\"},\"subject\":\"$JS.API.STREAM.INFO.orders\",\"response\":\"{\\\"type\\\":\\\"io.nats.jetstream.api.v1.stream_info_response\\\",\\\"config\\\":{\\\"name\\\":\\\"orders\\\",\\\"subjects\\\":[\\\"orders.*.stream.entry\\\"],\\\"retention\\\":\\\"workqueue\\\",\\\"max_consumers\\\":-1,\\\"max_msgs\\\":-1,\\\"max_bytes\\\":-1,\\\"max_age\\\":0,\\\"max_msgs_per_subject\\\":-1,\\\"max_msg_size\\\":-1,\\\"discard\\\":\\\"old\\\",\\\"storage\\\":\\\"file\\\",\\\"num_replicas\\\":1,\\\"duplicate_window\\\":120000000000,\\\"sealed\\\":false,\\\"deny_delete\\\":false,\\\"deny_purge\\\":false,\\\"allow_rollup_hdrs\\\":false},\\\"created\\\":\\\"2022-05-09T10:43:22.0938638Z\\\",\\\"state\\\":{\\\"messages\\\":1,\\\"bytes\\\":61,\\\"first_seq\\\":1,\\\"first_ts\\\":\\\"2022-05-09T10:43:27.4617122Z\\\",\\\"last_seq\\\":1,\\\"last_ts\\\":\\\"2022-05-09T10:43:27.4617122Z\\\",\\\"num_subjects\\\":1,\\\"consumer_count\\\":0}}\"}"]
2022/05/09 10:43:35.339204 [DBG] 172.18.0.1:56160 - cid:20 - "v1.13.0:go:NATS CLI Version 0.0.28" - Client connection closed: Client Closed
2022/05/09 10:43:35.339235 [TRC] 172.18.0.1:56160 - cid:20 - "v1.13.0:go:NATS CLI Version 0.0.28" - <-> [DELSUB 1]
2022/05/09 10:43:37.775520 [DBG] 172.18.0.1:56164 - cid:21 - Client connection created
2022/05/09 10:43:37.775967 [TRC] 172.18.0.1:56164 - cid:21 - <<- [CONNECT {"verbose":false,"pedantic":false,"user":"client2","pass":"[REDACTED]","tls_required":false,"name":"NATS CLI Version 0.0.28","lang":"go","version":"1.13.0","protocol":1,"echo":true,"headers":true,"no_responders":true}]
2022/05/09 10:43:37.776022 [TRC] 172.18.0.1:56164 - cid:21 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PING]
2022/05/09 10:43:37.776030 [TRC] 172.18.0.1:56164 - cid:21 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PONG]
2022/05/09 10:43:37.776352 [TRC] 172.18.0.1:56164 - cid:21 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [SUB _INBOX.TFEQTmZNUD0HO8feHWyJPO.* 1]
2022/05/09 10:43:37.776371 [TRC] 172.18.0.1:56164 - cid:21 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB $JS.API.STREAM.INFO.orders _INBOX.TFEQTmZNUD0HO8feHWyJPO.Y4MKoMkj 0]
2022/05/09 10:43:37.776374 [TRC] 172.18.0.1:56164 - cid:21 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: [""]
2022/05/09 10:43:37.776486 [TRC] 172.18.0.1:56164 - cid:21 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [MSG _INBOX.TFEQTmZNUD0HO8feHWyJPO.Y4MKoMkj 1 631]
2022/05/09 10:43:37.776501 [TRC] ACCOUNT - <<- [PUB $JS.EVENT.ADVISORY.API 1238]
2022/05/09 10:43:37.776519 [TRC] ACCOUNT - <<- MSG_PAYLOAD: ["{\"type\":\"io.nats.jetstream.advisory.v1.api_audit\",\"id\":\"isI2aINuYbNfJPUOv5LVOR\",\"timestamp\":\"2022-05-09T10:43:37.776454Z\",\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"client\":{\"start\":\"2022-05-09T10:43:37.775484Z\",\"host\":\"172.18.0.1\",\"id\":21,\"acc\":\"CLIENT2\",\"user\":\"client2\",\"name\":\"NATS CLI Version 0.0.28\",\"lang\":\"go\",\"ver\":\"1.13.0\",\"rtt\":494900,\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"kind\":\"Client\",\"client_type\":\"nats\"},\"subject\":\"$JS.API.STREAM.INFO.orders\",\"response\":\"{\\\"type\\\":\\\"io.nats.jetstream.api.v1.stream_info_response\\\",\\\"config\\\":{\\\"name\\\":\\\"orders\\\",\\\"subjects\\\":[\\\"orders.*.stream.entry\\\"],\\\"retention\\\":\\\"workqueue\\\",\\\"max_consumers\\\":-1,\\\"max_msgs\\\":-1,\\\"max_bytes\\\":-1,\\\"max_age\\\":0,\\\"max_msgs_per_subject\\\":-1,\\\"max_msg_size\\\":-1,\\\"discard\\\":\\\"old\\\",\\\"storage\\\":\\\"file\\\",\\\"num_replicas\\\":1,\\\"duplicate_window\\\":120000000000,\\\"sealed\\\":false,\\\"deny_delete\\\":false,\\\"deny_purge\\\":false,\\\"allow_rollup_hdrs\\\":false},\\\"created\\\":\\\"2022-05-09T10:43:24.8666674Z\\\",\\\"state\\\":{\\\"messages\\\":1,\\\"bytes\\\":61,\\\"first_seq\\\":1,\\\"first_ts\\\":\\\"2022-05-09T10:43:27.4616661Z\\\",\\\"last_seq\\\":1,\\\"last_ts\\\":\\\"2022-05-09T10:43:27.4616661Z\\\",\\\"num_subjects\\\":1,\\\"consumer_count\\\":0}}\"}"]
2022/05/09 10:43:37.778852 [DBG] 172.18.0.1:56164 - cid:21 - "v1.13.0:go:NATS CLI Version 0.0.28" - Client connection closed: Client Closed
2022/05/09 10:43:37.778896 [TRC] 172.18.0.1:56164 - cid:21 - "v1.13.0:go:NATS CLI Version 0.0.28" - <-> [DELSUB 1]
2022/05/09 10:43:40.899995 [DBG] 172.18.0.1:56168 - cid:22 - Client connection created
2022/05/09 10:43:40.900392 [TRC] 172.18.0.1:56168 - cid:22 - <<- [CONNECT {"verbose":false,"pedantic":false,"user":"client","pass":"[REDACTED]","tls_required":false,"name":"NATS CLI Version 0.0.28","lang":"go","version":"1.13.0","protocol":1,"echo":true,"headers":true,"no_responders":true}]
2022/05/09 10:43:40.900439 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PING]
2022/05/09 10:43:40.900453 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PONG]
2022/05/09 10:43:40.900804 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [SUB _INBOX.DJtJgmbIqbVNo7wF7G9BJ8.* 1]
2022/05/09 10:43:40.900823 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB $JS.API.STREAM.INFO.orders _INBOX.DJtJgmbIqbVNo7wF7G9BJ8.f4t2rgx4 0]
2022/05/09 10:43:40.900826 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: [""]
2022/05/09 10:43:40.900930 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [MSG _INBOX.DJtJgmbIqbVNo7wF7G9BJ8.f4t2rgx4 1 631]
2022/05/09 10:43:40.900953 [TRC] ACCOUNT - <<- [PUB $JS.EVENT.ADVISORY.API 1238]
2022/05/09 10:43:40.900974 [TRC] ACCOUNT - <<- MSG_PAYLOAD: ["{\"type\":\"io.nats.jetstream.advisory.v1.api_audit\",\"id\":\"isI2aINuYbNfJPUOv5LVP3\",\"timestamp\":\"2022-05-09T10:43:40.9008998Z\",\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"client\":{\"start\":\"2022-05-09T10:43:40.8999515Z\",\"host\":\"172.18.0.1\",\"id\":22,\"acc\":\"CLIENT\",\"user\":\"client\",\"name\":\"NATS CLI Version 0.0.28\",\"lang\":\"go\",\"ver\":\"1.13.0\",\"rtt\":451600,\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"kind\":\"Client\",\"client_type\":\"nats\"},\"subject\":\"$JS.API.STREAM.INFO.orders\",\"response\":\"{\\\"type\\\":\\\"io.nats.jetstream.api.v1.stream_info_response\\\",\\\"config\\\":{\\\"name\\\":\\\"orders\\\",\\\"subjects\\\":[\\\"orders.*.stream.entry\\\"],\\\"retention\\\":\\\"workqueue\\\",\\\"max_consumers\\\":-1,\\\"max_msgs\\\":-1,\\\"max_bytes\\\":-1,\\\"max_age\\\":0,\\\"max_msgs_per_subject\\\":-1,\\\"max_msg_size\\\":-1,\\\"discard\\\":\\\"old\\\",\\\"storage\\\":\\\"file\\\",\\\"num_replicas\\\":1,\\\"duplicate_window\\\":120000000000,\\\"sealed\\\":false,\\\"deny_delete\\\":false,\\\"deny_purge\\\":false,\\\"allow_rollup_hdrs\\\":false},\\\"created\\\":\\\"2022-05-09T10:43:22.0938638Z\\\",\\\"state\\\":{\\\"messages\\\":1,\\\"bytes\\\":61,\\\"first_seq\\\":1,\\\"first_ts\\\":\\\"2022-05-09T10:43:27.4617122Z\\\",\\\"last_seq\\\":1,\\\"last_ts\\\":\\\"2022-05-09T10:43:27.4617122Z\\\",\\\"num_subjects\\\":1,\\\"consumer_count\\\":0}}\"}"]
2022/05/09 10:43:40.902932 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [SUB _INBOX.DJtJgmbIqbVNo7wF7G9BKc 2]
2022/05/09 10:43:40.902949 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB $JS.API.CONSUMER.DURABLE.CREATE.orders.jsm_stream_pager_28001652093020902735600 _INBOX.DJtJgmbIqbVNo7wF7G9BJ8.hOpybWc5 222]
2022/05/09 10:43:40.902955 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: ["{\"stream_name\":\"orders\",\"config\":{\"description\":\"JSM Stream Pager\",\"ack_policy\":\"explicit\",\"ack_wait\":30000000000,\"deliver_policy\":\"all\",\"durable_name\":\"jsm_stream_pager_28001652093020902735600\",\"replay_policy\":\"instant\"}}"]
2022/05/09 10:43:40.903316 [TRC] JETSTREAM - <<- [SUB $JSC.CI.CLIENT.orders.jsm_stream_pager_28001652093020902735600 41]
2022/05/09 10:43:40.903438 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [MSG _INBOX.DJtJgmbIqbVNo7wF7G9BJ8.hOpybWc5 1 674]
2022/05/09 10:43:40.903458 [TRC] ACCOUNT - <<- [PUB $JS.EVENT.ADVISORY.API 1593]
2022/05/09 10:43:40.903484 [TRC] ACCOUNT - <<- MSG_PAYLOAD: ["{\"type\":\"io.nats.jetstream.advisory.v1.api_audit\",\"id\":\"isI2aINuYbNfJPUOv5LVQH\",\"timestamp\":\"2022-05-09T10:43:40.9034196Z\",\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"client\":{\"start\":\"2022-05-09T10:43:40.8999515Z\",\"host\":\"172.18.0.1\",\"id\":22,\"acc\":\"CLIENT\",\"user\":\"client\",\"name\":\"NATS CLI Version 0.0.28\",\"lang\":\"go\",\"ver\":\"1.13.0\",\"rtt\":451600,\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"kind\":\"Client\",\"client_type\":\"nats\"},\"subject\":\"$JS.API.CONSUMER.DURABLE.CREATE.orders.jsm_stream_pager_28001652093020902735600\",\"request\":\"{\\\"stream_name\\\":\\\"orders\\\",\\\"config\\\":{\\\"description\\\":\\\"JSM Stream Pager\\\",\\\"ack_policy\\\":\\\"explicit\\\",\\\"ack_wait\\\":30000000000,\\\"deliver_policy\\\":\\\"all\\\",\\\"durable_name\\\":\\\"jsm_stream_pager_28001652093020902735600\\\",\\\"replay_policy\\\":\\\"instant\\\"}}\",\"response\":\"{\\\"type\\\":\\\"io.nats.jetstream.api.v1.consumer_create_response\\\",\\\"stream_name\\\":\\\"orders\\\",\\\"name\\\":\\\"jsm_stream_pager_28001652093020902735600\\\",\\\"created\\\":\\\"2022-05-09T10:43:40.9030466Z\\\",\\\"config\\\":{\\\"durable_name\\\":\\\"jsm_stream_pager_28001652093020902735600\\\",\\\"description\\\":\\\"JSM Stream Pager\\\",\\\"deliver_policy\\\":\\\"all\\\",\\\"ack_policy\\\":\\\"explicit\\\",\\\"ack_wait\\\":30000000000,\\\"max_deliver\\\":-1,\\\"replay_policy\\\":\\\"instant\\\",\\\"max_waiting\\\":512,\\\"max_ack_pending\\\":1000},\\\"delivered\\\":{\\\"consumer_seq\\\":0,\\\"stream_seq\\\":0},\\\"ack_floor\\\":{\\\"consumer_seq\\\":0,\\\"stream_seq\\\":0},\\\"num_ack_pending\\\":0,\\\"num_redelivered\\\":0,\\\"num_waiting\\\":0,\\\"num_pending\\\":1,\\\"cluster\\\":{\\\"leader\\\":\\\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\\\"}}\"}"]
2022/05/09 10:43:40.904762 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB $JS.API.CONSUMER.MSG.NEXT.orders.jsm_stream_pager_28001652093020902735600 _INBOX.DJtJgmbIqbVNo7wF7G9BKc 27]
2022/05/09 10:43:40.904774 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: ["{\"batch\":10,\"no_wait\":true}"]
2022/05/09 10:43:40.904869 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [MSG orders.client.stream.entry 2 $JS.ACK.orders.jsm_stream_pager_28001652093020902735600.1.1.1.1652093007461712200.0 5]
2022/05/09 10:43:40.904890 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [HMSG _INBOX.DJtJgmbIqbVNo7wF7G9BKc 2 32 32]
2022/05/09 10:43:40.905243 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB $JS.ACK.orders.jsm_stream_pager_28001652093020902735600.1.1.1.1652093007461712200.0 4]
2022/05/09 10:43:40.905254 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: ["+ACK"]
2022/05/09 10:43:42.877012 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [UNSUB 2 ]
2022/05/09 10:43:42.877029 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - <-> [DELSUB 2]
2022/05/09 10:43:42.877042 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB $JS.API.CONSUMER.DELETE.orders.jsm_stream_pager_28001652093020902735600 _INBOX.DJtJgmbIqbVNo7wF7G9BJ8.gK8VMIN0 0]
2022/05/09 10:43:42.877049 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: [""]
2022/05/09 10:43:42.877123 [TRC] JETSTREAM - <-> [DELSUB 1]
2022/05/09 10:43:42.877149 [TRC] JETSTREAM - <-> [DELSUB 2]
2022/05/09 10:43:42.877172 [TRC] JETSTREAM - <-> [DELSUB 41]
2022/05/09 10:43:42.877183 [DBG] JETSTREAM - JetStream connection closed: Client Closed
2022/05/09 10:43:42.877206 [DBG] JETSTREAM - JetStream connection closed: Client Closed
2022/05/09 10:43:42.877415 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [MSG _INBOX.DJtJgmbIqbVNo7wF7G9BJ8.gK8VMIN0 1 75]
2022/05/09 10:43:42.877439 [TRC] ACCOUNT - <<- [PUB $JS.EVENT.ADVISORY.API 657]
2022/05/09 10:43:42.877449 [TRC] ACCOUNT - <<- MSG_PAYLOAD: ["{\"type\":\"io.nats.jetstream.advisory.v1.api_audit\",\"id\":\"isI2aINuYbNfJPUOv5LVRV\",\"timestamp\":\"2022-05-09T10:43:42.8773945Z\",\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"client\":{\"start\":\"2022-05-09T10:43:40.8999515Z\",\"host\":\"172.18.0.1\",\"id\":22,\"acc\":\"CLIENT\",\"user\":\"client\",\"name\":\"NATS CLI Version 0.0.28\",\"lang\":\"go\",\"ver\":\"1.13.0\",\"rtt\":451600,\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"kind\":\"Client\",\"client_type\":\"nats\"},\"subject\":\"$JS.API.CONSUMER.DELETE.orders.jsm_stream_pager_28001652093020902735600\",\"response\":\"{\\\"type\\\":\\\"io.nats.jetstream.api.v1.consumer_delete_response\\\",\\\"success\\\":true}\"}"]
2022/05/09 10:43:42.878507 [DBG] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - Client connection closed: Client Closed
2022/05/09 10:43:42.878537 [TRC] 172.18.0.1:56168 - cid:22 - "v1.13.0:go:NATS CLI Version 0.0.28" - <-> [DELSUB 1]
2022/05/09 10:43:47.639166 [DBG] 172.18.0.1:56172 - cid:25 - Client connection created
2022/05/09 10:43:47.639578 [TRC] 172.18.0.1:56172 - cid:25 - <<- [CONNECT {"verbose":false,"pedantic":false,"user":"client2","pass":"[REDACTED]","tls_required":false,"name":"NATS CLI Version 0.0.28","lang":"go","version":"1.13.0","protocol":1,"echo":true,"headers":true,"no_responders":true}]
2022/05/09 10:43:47.639639 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PING]
2022/05/09 10:43:47.639642 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PONG]
2022/05/09 10:43:47.639986 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [SUB _INBOX.7ldlm5g0CaXbcFKEXVdT8Y.* 1]
2022/05/09 10:43:47.640003 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB $JS.API.STREAM.INFO.orders _INBOX.7ldlm5g0CaXbcFKEXVdT8Y.fraBYxFD 0]
2022/05/09 10:43:47.640006 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: [""]
2022/05/09 10:43:47.640108 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [MSG _INBOX.7ldlm5g0CaXbcFKEXVdT8Y.fraBYxFD 1 631]
2022/05/09 10:43:47.640125 [TRC] ACCOUNT - <<- [PUB $JS.EVENT.ADVISORY.API 1239]
2022/05/09 10:43:47.640145 [TRC] ACCOUNT - <<- MSG_PAYLOAD: ["{\"type\":\"io.nats.jetstream.advisory.v1.api_audit\",\"id\":\"isI2aINuYbNfJPUOv5LVS7\",\"timestamp\":\"2022-05-09T10:43:47.6400821Z\",\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"client\":{\"start\":\"2022-05-09T10:43:47.639131Z\",\"host\":\"172.18.0.1\",\"id\":25,\"acc\":\"CLIENT2\",\"user\":\"client2\",\"name\":\"NATS CLI Version 0.0.28\",\"lang\":\"go\",\"ver\":\"1.13.0\",\"rtt\":458000,\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"kind\":\"Client\",\"client_type\":\"nats\"},\"subject\":\"$JS.API.STREAM.INFO.orders\",\"response\":\"{\\\"type\\\":\\\"io.nats.jetstream.api.v1.stream_info_response\\\",\\\"config\\\":{\\\"name\\\":\\\"orders\\\",\\\"subjects\\\":[\\\"orders.*.stream.entry\\\"],\\\"retention\\\":\\\"workqueue\\\",\\\"max_consumers\\\":-1,\\\"max_msgs\\\":-1,\\\"max_bytes\\\":-1,\\\"max_age\\\":0,\\\"max_msgs_per_subject\\\":-1,\\\"max_msg_size\\\":-1,\\\"discard\\\":\\\"old\\\",\\\"storage\\\":\\\"file\\\",\\\"num_replicas\\\":1,\\\"duplicate_window\\\":120000000000,\\\"sealed\\\":false,\\\"deny_delete\\\":false,\\\"deny_purge\\\":false,\\\"allow_rollup_hdrs\\\":false},\\\"created\\\":\\\"2022-05-09T10:43:24.8666674Z\\\",\\\"state\\\":{\\\"messages\\\":1,\\\"bytes\\\":61,\\\"first_seq\\\":1,\\\"first_ts\\\":\\\"2022-05-09T10:43:27.4616661Z\\\",\\\"last_seq\\\":1,\\\"last_ts\\\":\\\"2022-05-09T10:43:27.4616661Z\\\",\\\"num_subjects\\\":1,\\\"consumer_count\\\":0}}\"}"]
2022/05/09 10:43:47.642233 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [SUB _INBOX.7ldlm5g0CaXbcFKEXVdTB5 2]
2022/05/09 10:43:47.642249 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB $JS.API.CONSUMER.DURABLE.CREATE.orders.jsm_stream_pager_28191652093027642063200 _INBOX.7ldlm5g0CaXbcFKEXVdT8Y.SPoBjI4l 222]
2022/05/09 10:43:47.642258 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: ["{\"stream_name\":\"orders\",\"config\":{\"description\":\"JSM Stream Pager\",\"ack_policy\":\"explicit\",\"ack_wait\":30000000000,\"deliver_policy\":\"all\",\"durable_name\":\"jsm_stream_pager_28191652093027642063200\",\"replay_policy\":\"instant\"}}"]
2022/05/09 10:43:47.642500 [TRC] JETSTREAM - <<- [SUB $JSC.CI.CLIENT2.orders.jsm_stream_pager_28191652093027642063200 42]
2022/05/09 10:43:47.642568 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [MSG _INBOX.7ldlm5g0CaXbcFKEXVdT8Y.SPoBjI4l 1 674]
2022/05/09 10:43:47.642575 [TRC] ACCOUNT - <<- [PUB $JS.EVENT.ADVISORY.API 1594]
2022/05/09 10:43:47.642600 [TRC] ACCOUNT - <<- MSG_PAYLOAD: ["{\"type\":\"io.nats.jetstream.advisory.v1.api_audit\",\"id\":\"isI2aINuYbNfJPUOv5LVTL\",\"timestamp\":\"2022-05-09T10:43:47.6425484Z\",\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"client\":{\"start\":\"2022-05-09T10:43:47.639131Z\",\"host\":\"172.18.0.1\",\"id\":25,\"acc\":\"CLIENT2\",\"user\":\"client2\",\"name\":\"NATS CLI Version 0.0.28\",\"lang\":\"go\",\"ver\":\"1.13.0\",\"rtt\":458000,\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"kind\":\"Client\",\"client_type\":\"nats\"},\"subject\":\"$JS.API.CONSUMER.DURABLE.CREATE.orders.jsm_stream_pager_28191652093027642063200\",\"request\":\"{\\\"stream_name\\\":\\\"orders\\\",\\\"config\\\":{\\\"description\\\":\\\"JSM Stream Pager\\\",\\\"ack_policy\\\":\\\"explicit\\\",\\\"ack_wait\\\":30000000000,\\\"deliver_policy\\\":\\\"all\\\",\\\"durable_name\\\":\\\"jsm_stream_pager_28191652093027642063200\\\",\\\"replay_policy\\\":\\\"instant\\\"}}\",\"response\":\"{\\\"type\\\":\\\"io.nats.jetstream.api.v1.consumer_create_response\\\",\\\"stream_name\\\":\\\"orders\\\",\\\"name\\\":\\\"jsm_stream_pager_28191652093027642063200\\\",\\\"created\\\":\\\"2022-05-09T10:43:47.6423067Z\\\",\\\"config\\\":{\\\"durable_name\\\":\\\"jsm_stream_pager_28191652093027642063200\\\",\\\"description\\\":\\\"JSM Stream Pager\\\",\\\"deliver_policy\\\":\\\"all\\\",\\\"ack_policy\\\":\\\"explicit\\\",\\\"ack_wait\\\":30000000000,\\\"max_deliver\\\":-1,\\\"replay_policy\\\":\\\"instant\\\",\\\"max_waiting\\\":512,\\\"max_ack_pending\\\":1000},\\\"delivered\\\":{\\\"consumer_seq\\\":0,\\\"stream_seq\\\":0},\\\"ack_floor\\\":{\\\"consumer_seq\\\":0,\\\"stream_seq\\\":0},\\\"num_ack_pending\\\":0,\\\"num_redelivered\\\":0,\\\"num_waiting\\\":0,\\\"num_pending\\\":1,\\\"cluster\\\":{\\\"leader\\\":\\\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\\\"}}\"}"]
2022/05/09 10:43:47.644541 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB $JS.API.CONSUMER.MSG.NEXT.orders.jsm_stream_pager_28191652093027642063200 _INBOX.7ldlm5g0CaXbcFKEXVdTB5 27]
2022/05/09 10:43:47.644555 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: ["{\"batch\":10,\"no_wait\":true}"]
2022/05/09 10:43:47.644659 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [MSG orders.client.stream.entry 2 $JS.ACK.orders.jsm_stream_pager_28191652093027642063200.1.1.1.1652093007461666100.0 5]
2022/05/09 10:43:47.644677 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [HMSG _INBOX.7ldlm5g0CaXbcFKEXVdTB5 2 32 32]
2022/05/09 10:43:47.645057 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB $JS.ACK.orders.jsm_stream_pager_28191652093027642063200.1.1.1.1652093007461666100.0 4]
2022/05/09 10:43:47.645071 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: ["+ACK"]
2022/05/09 10:43:49.923881 [DBG] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - Client Ping Timer
2022/05/09 10:43:49.923917 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [PING]
2022/05/09 10:43:49.924620 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PONG]
2022/05/09 10:43:50.277966 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [UNSUB 2 ]
2022/05/09 10:43:50.277983 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <-> [DELSUB 2]
2022/05/09 10:43:50.277998 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- [PUB $JS.API.CONSUMER.DELETE.orders.jsm_stream_pager_28191652093027642063200 _INBOX.7ldlm5g0CaXbcFKEXVdT8Y.jKGL3pkT 0]
2022/05/09 10:43:50.278001 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <<- MSG_PAYLOAD: [""]
2022/05/09 10:43:50.278087 [TRC] JETSTREAM - <-> [DELSUB 1]
2022/05/09 10:43:50.278103 [TRC] JETSTREAM - <-> [DELSUB 2]
2022/05/09 10:43:50.278110 [TRC] JETSTREAM - <-> [DELSUB 42]
2022/05/09 10:43:50.278120 [DBG] JETSTREAM - JetStream connection closed: Client Closed
2022/05/09 10:43:50.278144 [DBG] JETSTREAM - JetStream connection closed: Client Closed
2022/05/09 10:43:50.278359 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - ->> [MSG _INBOX.7ldlm5g0CaXbcFKEXVdT8Y.jKGL3pkT 1 75]
2022/05/09 10:43:50.278370 [TRC] ACCOUNT - <<- [PUB $JS.EVENT.ADVISORY.API 658]
2022/05/09 10:43:50.278386 [TRC] ACCOUNT - <<- MSG_PAYLOAD: ["{\"type\":\"io.nats.jetstream.advisory.v1.api_audit\",\"id\":\"isI2aINuYbNfJPUOv5LVUZ\",\"timestamp\":\"2022-05-09T10:43:50.2783293Z\",\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"client\":{\"start\":\"2022-05-09T10:43:47.639131Z\",\"host\":\"172.18.0.1\",\"id\":25,\"acc\":\"CLIENT2\",\"user\":\"client2\",\"name\":\"NATS CLI Version 0.0.28\",\"lang\":\"go\",\"ver\":\"1.13.0\",\"rtt\":732600,\"server\":\"NB3QVCPPSNCQEAFXOWLMPKJMWAFLR2TAUJDWMOXO5NVCMNMMREPIPPXB\",\"kind\":\"Client\",\"client_type\":\"nats\"},\"subject\":\"$JS.API.CONSUMER.DELETE.orders.jsm_stream_pager_28191652093027642063200\",\"response\":\"{\\\"type\\\":\\\"io.nats.jetstream.api.v1.consumer_delete_response\\\",\\\"success\\\":true}\"}"]
2022/05/09 10:43:50.279343 [DBG] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - Client connection closed: Client Closed
2022/05/09 10:43:50.279367 [TRC] 172.18.0.1:56172 - cid:25 - "v1.13.0:go:NATS CLI Version 0.0.28" - <-> [DELSUB 1]
@kozlovic thank you for the fix!
Defect
nats-server -DV
outputVersions of
nats-server
and affected client libraries used:nats-server: 2.8.2 (also tested with current nightly build) nats-cli: 0.0.28
OS/Container environment:
Windows 10 (WSL2) 4.19.128-microsoft-standard; Ubuntu 20.04.3 LTS Docker Desktop 4.7.2, Engine 20.10.14, Compose 1.29.2
Steps or code to reproduce the issue:
config:
client
withnats --user client --password client sub 'orders.>'
and forclient2
withnats --user client2 --password client2 sub 'orders.>'
seperatelyPUBLIC
account:nats --user public --password public pub 'orders.client.stream.entry' 'test1'
CLIENT
account subscription receives the message, while theCLIENT2
account does not (this is correct behavior)CLIENT
andCLIENT2
accounts:nats --user client --password client stream create orders '--subjects=orders.*.stream.entry' --retention=work --max-consumers=-1 --max-msgs-per-subject=-1 --max-msgs=-1 --max-bytes=-1 --max-age=-1 --max-msg-size=-1 --storage=file --discard=old --replicas=1 --dupe-window="2m0s" --no-allow-rollup --no-deny-delete --no-deny-purge
andnats --user client2 --password client2 stream create orders '--subjects=orders.*.stream.entry' --retention=work --max-consumers=-1 --max-msgs-per-subject=-1 --max-msgs=-1 --max-bytes=-1 --max-age=-1 --max-msg-size=-1 --storage=file --discard=old --replicas=1 --dupe-window="2m0s" --no-allow-rollup --no-deny-delete --no-deny-purge
PUBLIC
again:nats --user public --password public pub 'orders.client.stream.entry' 'test2'
Expected result:
The message shows up in the
orders
stream of accountCLIENT
only and not on theorders
stream of accountCLIENT2
. I check this via runningnats --user client --password client stream info orders
and observing the message count.Actual result:
Both streams in both accounts contain the test message. With my current understanding of accounts, this should not happen, even though both streams listen on the same subject. Since the config for these accounts explicitly imports only one subject, only messages of that subject should be able to reach the stream in this particular account (as it is the case with "normal" subscriptions).
The reason why changing the streams' subjects to
orders.client.stream.entry
ororders.client2.stream.entry
respectively is not the solution here is that a malicious user could just (re-)create a stream withorders.*.stream.entry
and hence would be able to receive all messages.Log: