ydb-platform / nbs

Network Block & File Store
Apache License 2.0
58 stars 21 forks source link

[NBS] check CONNECT and RECONFIGURE return codes when using netlink interface #1832

Closed tpashkin closed 2 months ago

tpashkin commented 2 months ago

Currently we are missing any checks there and assume both commands always succeed, which may not be the case

tpashkin commented 2 months ago

Just checked again with libnl debug turned on – nl_send_sync actually returns error upon receiving nlmsgerr with non-zero status

% export NLDBG=4
% export NLCB=debug
% ./blockstore-nbd --disk-id tp0 --device-mode proxy --netlink --disconnect --reconfigure --connect-device /dev/nbd12
DBG<1>/root/nbs/contrib/restricted/libnl/lib/cache_mngt.c:271  nl_cache_mngt_register: Registered cache operations genl/family
2024-09-05T08:35:34.747988Z :GRPC INFO: contrib/libs/grpc/src/core/lib/iomgr/ev_epoll1_linux.cc:124: grpc epoll fd: 3
2024-09-05T08:35:34.748076Z :BLOCKSTORE_CLIENT INFO: cloud/blockstore/libs/client/client.cpp:689: Connect to localhost:9766
2024-09-05T08:35:34.748289Z :GRPC INFO: contrib/libs/grpc/src/core/lib/event_engine/thread_pool.cc:74: Threads limit changed from 32 to 4
2024-09-05T08:35:34.748297Z :GRPC INFO: contrib/libs/grpc/src/core/lib/event_engine/thread_pool.cc:77: Threads limit:[4]
2024-09-05T08:35:34.748663Z :BLOCKSTORE_CLIENT INFO: cloud/blockstore/libs/client/client.cpp:689: Connect to localhost:9767
2024-09-05T08:35:34.748921Z :BLOCKSTORE_CLIENT INFO: cloud/blockstore/libs/client/session.cpp:533: [d:tp0] MountVolume submit request: read-only access, remote mount
2024-09-05T08:35:34.817887Z :BLOCKSTORE_CLIENT INFO: cloud/blockstore/libs/client/session.cpp:616: NBS server version: 1725518903.unknown-vcs-branch
2024-09-05T08:35:34.817917Z :BLOCKSTORE_CLIENT INFO: cloud/blockstore/libs/client/session.cpp:645: [d:tp0] MountVolume new disk size: 24379392
2024-09-05T08:35:34.818004Z :BLOCKSTORE_NBD INFO: cloud/blockstore/libs/nbd/server.cpp:580: Starting
DBG<4>/root/nbs/contrib/restricted/libnl/lib/object.c:73   nl_object_alloc: Allocated new object 0x555b3fa82f00
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:285  __nlmsg_alloc: msg 0x555b3fac9ec0: Allocated new message, maxlen=4096
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:526  nlmsg_put: msg 0x555b3fac9ec0: Added netlink header type=16, flags=0, pid=0, seq=0
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:433  nlmsg_reserve: msg 0x555b3fac9ec0: Reserved 4 (4) bytes, pad=4, nlmsg_len=20
DBG<2>/root/nbs/contrib/restricted/libnl/lib/genl/genl.c:362  genlmsg_put: msg 0x555b3fac9ec0: Added generic netlink header cmd=3 version=1
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:482  nla_reserve: msg 0x555b3fac9ec0: attr <0x555b3f5c8014> 2: Reserved 8 (4) bytes at offset +4 nlmsg_len=28
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:517  nla_put: msg 0x555b3fac9ec0: attr <0x555b3f5c8014> 2: Wrote 4 bytes at offset +4
-- Debug: Sent Message:
--------------------------   BEGIN NETLINK MESSAGE ---------------------------
  [NETLINK HEADER] 16 octets
    .nlmsg_len = 28
    .type = 16 <genl/family::nlctrl>
    .flags = 5 <REQUEST,ACK>
    .seq = 1725525334
    .port = -1519036765
  [GENERIC NETLINK HEADER] 4 octets
    .cmd = 3
    .version = 1
    .unused = 0
  [ATTR 02] 4 octets
    6e 62 64 00                                     nbd.
---------------------------  END NETLINK MESSAGE   ---------------------------
DBG<4>/root/nbs/contrib/restricted/libnl/lib/nl.c:348  nl_sendmsg: sent 28 bytes
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:841  recvmsgs: Attempting to read from 0x555b3e7ef240
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:850  recvmsgs: recvmsgs(0x555b3e7ef240): Read 180 bytes
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:854  recvmsgs: recvmsgs(0x555b3e7ef240): Processing valid message...
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:285  __nlmsg_alloc: msg 0x555b3fac9f10: Allocated new message, maxlen=180
-- Debug: Received Message:
--------------------------   BEGIN NETLINK MESSAGE ---------------------------
  [NETLINK HEADER] 16 octets
    .nlmsg_len = 180
    .type = 16 <genl/family::nlctrl>
    .flags = 0 <>
    .seq = 1725525334
    .port = -1519036765
  [GENERIC NETLINK HEADER] 4 octets
    .cmd = 1
    .version = 2
    .unused = 0
  [ATTR 02] 4 octets
    6e 62 64 00                                     nbd.
  [ATTR 01] 2 octets
    21 00                                           !.
  [PADDING] 2 octets
    00 00                                           ..
  [ATTR 03] 4 octets
    01 00 00 00                                     ....
  [ATTR 04] 4 octets
    00 00 00 00                                     ....
  [ATTR 05] 4 octets
    0a 00 00 00                                     ....
  [ATTR 06] 80 octets
    14 00 01 00 08 00 01 00 01 00 00 00 08 00 02 00 ................
    0a 00 00 00 14 00 02 00 08 00 01 00 02 00 00 00 ................
    08 00 02 00 0a 00 00 00 14 00 03 00 08 00 01 00 ................
    03 00 00 00 08 00 02 00 0a 00 00 00 14 00 04 00 ................
    08 00 01 00 05 00 00 00 08 00 02 00 0a 00 00 00 ................
  [ATTR 07] 32 octets
    20 00 01 00 08 00 02 00 07 00 00 00 11 00 01 00  ...............
    6e 62 64 5f 6d 63 5f 67 72 6f 75 70 00 00 00 00 nbd_mc_group....
---------------------------  END NETLINK MESSAGE   ---------------------------
DBG<4>/root/nbs/contrib/restricted/libnl/lib/msg.c:573  nlmsg_free: Returned message reference 0x555b3fac9f10, 0 remaining
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:580  nlmsg_free: msg 0x555b3fac9f10: Freed
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:841  recvmsgs: Attempting to read from 0x555b3e7ef240
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:850  recvmsgs: recvmsgs(0x555b3e7ef240): Read 36 bytes
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:854  recvmsgs: recvmsgs(0x555b3e7ef240): Processing valid message...
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:285  __nlmsg_alloc: msg 0x555b3fac9f10: Allocated new message, maxlen=36
-- Debug: Received Message:
--------------------------   BEGIN NETLINK MESSAGE ---------------------------
  [NETLINK HEADER] 16 octets
    .nlmsg_len = 36
    .type = 2 <ERROR>
    .flags = 256 <ROOT>
    .seq = 1725525334
    .port = -1519036765
  [ERRORMSG] 20 octets
    .error = 0 "Success"
  [ORIGINAL MESSAGE] 16 octets
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:285  __nlmsg_alloc: msg 0x555b3fac9f60: Allocated new message, maxlen=4096
    .nlmsg_len = 16
    .type = 16 <0x10>
    .flags = 5 <REQUEST,ACK>
    .seq = 1725525334
    .port = -1519036765
DBG<4>/root/nbs/contrib/restricted/libnl/lib/msg.c:573  nlmsg_free: Returned message reference 0x555b3fac9f60, 0 remaining
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:580  nlmsg_free: msg 0x555b3fac9f60: Freed
---------------------------  END NETLINK MESSAGE   ---------------------------
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:902  recvmsgs: recvmsgs(0x555b3e7ef240): Increased expected sequence number to 1725525335
DBG<4>/root/nbs/contrib/restricted/libnl/lib/msg.c:573  nlmsg_free: Returned message reference 0x555b3fac9f10, 0 remaining
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:580  nlmsg_free: msg 0x555b3fac9f10: Freed
DBG<4>/root/nbs/contrib/restricted/libnl/lib/msg.c:573  nlmsg_free: Returned message reference 0x555b3fac9ec0, 0 remaining
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:580  nlmsg_free: msg 0x555b3fac9ec0: Freed
DBG<4>/root/nbs/contrib/restricted/libnl/lib/object.c:228  nl_object_put: Returned object reference 0x555b3fa82f00, 0 remaining
DBG<4>/root/nbs/contrib/restricted/libnl/lib/object.c:194  nl_object_free: Freed object 0x555b3fa82f00
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:285  __nlmsg_alloc: msg 0x555b3fac9ec0: Allocated new message, maxlen=4096
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:526  nlmsg_put: msg 0x555b3fac9ec0: Added netlink header type=33, flags=0, pid=0, seq=0
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:433  nlmsg_reserve: msg 0x555b3fac9ec0: Reserved 4 (4) bytes, pad=4, nlmsg_len=20
DBG<2>/root/nbs/contrib/restricted/libnl/lib/genl/genl.c:362  genlmsg_put: msg 0x555b3fac9ec0: Added generic netlink header cmd=5 version=0
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:482  nla_reserve: msg 0x555b3fac9ec0: attr <0x555b3f5c8014> 1: Reserved 8 (4) bytes at offset +4 nlmsg_len=28
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:517  nla_put: msg 0x555b3fac9ec0: attr <0x555b3f5c8014> 1: Wrote 4 bytes at offset +4
-- Debug: Sent Message:
--------------------------   BEGIN NETLINK MESSAGE ---------------------------
  [NETLINK HEADER] 16 octets
    .nlmsg_len = 28
    .type = 33 <0x21>
    .flags = 5 <REQUEST,ACK>
    .seq = 1725525335
    .port = -1519036765
  [GENERIC NETLINK HEADER] 4 octets
    .cmd = 5
    .version = 0
    .unused = 0
  [PAYLOAD] 8 octets
    08 00 01 00 0c 00 00 00                         ........
---------------------------  END NETLINK MESSAGE   ---------------------------
DBG<4>/root/nbs/contrib/restricted/libnl/lib/nl.c:348  nl_sendmsg: sent 28 bytes
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:841  recvmsgs: Attempting to read from 0x555b3e7ef240
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:850  recvmsgs: recvmsgs(0x555b3e7ef240): Read 44 bytes
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:854  recvmsgs: recvmsgs(0x555b3e7ef240): Processing valid message...
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:285  __nlmsg_alloc: msg 0x555b3fac9f10: Allocated new message, maxlen=44
-- Debug: Received Message:
--------------------------   BEGIN NETLINK MESSAGE ---------------------------
  [NETLINK HEADER] 16 octets
    .nlmsg_len = 44
    .type = 33 <0x21>
    .flags = 0 <>
    .seq = 1725525335
    .port = -1519036765
  [GENERIC NETLINK HEADER] 4 octets
    .cmd = 5
    .version = 1
    .unused = 0
  [PAYLOAD] 24 octets
    18 00 09 00 14 00 01 00 08 00 01 00 0c 00 00 00 ................
    05 00 02 00 00 00 00 00                         ........
---------------------------  END NETLINK MESSAGE   ---------------------------
DBG<4>/root/nbs/contrib/restricted/libnl/lib/object.c:73   nl_object_alloc: Allocated new object 0x555b3fa82f00
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:285  __nlmsg_alloc: msg 0x555b3fac9f60: Allocated new message, maxlen=4096
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:526  nlmsg_put: msg 0x555b3fac9f60: Added netlink header type=16, flags=0, pid=0, seq=0
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:433  nlmsg_reserve: msg 0x555b3fac9f60: Reserved 4 (4) bytes, pad=4, nlmsg_len=20
DBG<2>/root/nbs/contrib/restricted/libnl/lib/genl/genl.c:362  genlmsg_put: msg 0x555b3fac9f60: Added generic netlink header cmd=3 version=1
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:482  nla_reserve: msg 0x555b3fac9f60: attr <0x555b3f5c9014> 2: Reserved 8 (4) bytes at offset +4 nlmsg_len=28
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:517  nla_put: msg 0x555b3fac9f60: attr <0x555b3f5c9014> 2: Wrote 4 bytes at offset +4
-- Debug: Sent Message:
--------------------------   BEGIN NETLINK MESSAGE ---------------------------
  [NETLINK HEADER] 16 octets
    .nlmsg_len = 28
    .type = 16 <genl/family::nlctrl>
    .flags = 5 <REQUEST,ACK>
    .seq = 1725525334
    .port = -936028509
  [GENERIC NETLINK HEADER] 4 octets
    .cmd = 3
    .version = 1
    .unused = 0
  [ATTR 02] 4 octets
    6e 62 64 00                                     nbd.
---------------------------  END NETLINK MESSAGE   ---------------------------
DBG<4>/root/nbs/contrib/restricted/libnl/lib/nl.c:348  nl_sendmsg: sent 28 bytes
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:841  recvmsgs: Attempting to read from 0x555b3e7ef300
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:850  recvmsgs: recvmsgs(0x555b3e7ef300): Read 180 bytes
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:854  recvmsgs: recvmsgs(0x555b3e7ef300): Processing valid message...
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:285  __nlmsg_alloc: msg 0x555b3fac9fb0: Allocated new message, maxlen=180
-- Debug: Received Message:
--------------------------   BEGIN NETLINK MESSAGE ---------------------------
  [NETLINK HEADER] 16 octets
    .nlmsg_len = 180
    .type = 16 <genl/family::nlctrl>
    .flags = 0 <>
    .seq = 1725525334
    .port = -936028509
  [GENERIC NETLINK HEADER] 4 octets
    .cmd = 1
    .version = 2
    .unused = 0
  [ATTR 02] 4 octets
    6e 62 64 00                                     nbd.
  [ATTR 01] 2 octets
    21 00                                           !.
  [PADDING] 2 octets
    00 00                                           ..
  [ATTR 03] 4 octets
    01 00 00 00                                     ....
  [ATTR 04] 4 octets
    00 00 00 00                                     ....
  [ATTR 05] 4 octets
    0a 00 00 00                                     ....
  [ATTR 06] 80 octets
    14 00 01 00 08 00 01 00 01 00 00 00 08 00 02 00 ................
    0a 00 00 00 14 00 02 00 08 00 01 00 02 00 00 00 ................
    08 00 02 00 0a 00 00 00 14 00 03 00 08 00 01 00 ................
    03 00 00 00 08 00 02 00 0a 00 00 00 14 00 04 00 ................
    08 00 01 00 05 00 00 00 08 00 02 00 0a 00 00 00 ................
  [ATTR 07] 32 octets
    20 00 01 00 08 00 02 00 07 00 00 00 11 00 01 00  ...............
    6e 62 64 5f 6d 63 5f 67 72 6f 75 70 00 00 00 00 nbd_mc_group....
---------------------------  END NETLINK MESSAGE   ---------------------------
DBG<4>/root/nbs/contrib/restricted/libnl/lib/msg.c:573  nlmsg_free: Returned message reference 0x555b3fac9fb0, 0 remaining
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:580  nlmsg_free: msg 0x555b3fac9fb0: Freed
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:841  recvmsgs: Attempting to read from 0x555b3e7ef300
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:850  recvmsgs: recvmsgs(0x555b3e7ef300): Read 36 bytes
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:854  recvmsgs: recvmsgs(0x555b3e7ef300): Processing valid message...
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:285  __nlmsg_alloc: msg 0x555b3fac9fb0: Allocated new message, maxlen=36
-- Debug: Received Message:
--------------------------   BEGIN NETLINK MESSAGE ---------------------------
  [NETLINK HEADER] 16 octets
    .nlmsg_len = 36
    .type = 2 <ERROR>
    .flags = 256 <ROOT>
    .seq = 1725525334
    .port = -936028509
  [ERRORMSG] 20 octets
    .error = 0 "Success"
  [ORIGINAL MESSAGE] 16 octets
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:285  __nlmsg_alloc: msg 0x555b3faca000: Allocated new message, maxlen=4096
    .nlmsg_len = 16
    .type = 16 <0x10>
    .flags = 5 <REQUEST,ACK>
    .seq = 1725525334
    .port = -936028509
DBG<4>/root/nbs/contrib/restricted/libnl/lib/msg.c:573  nlmsg_free: Returned message reference 0x555b3faca000, 0 remaining
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:580  nlmsg_free: msg 0x555b3faca000: Freed
---------------------------  END NETLINK MESSAGE   ---------------------------
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:902  recvmsgs: recvmsgs(0x555b3e7ef300): Increased expected sequence number to 1725525335
DBG<4>/root/nbs/contrib/restricted/libnl/lib/msg.c:573  nlmsg_free: Returned message reference 0x555b3fac9fb0, 0 remaining
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:580  nlmsg_free: msg 0x555b3fac9fb0: Freed
DBG<4>/root/nbs/contrib/restricted/libnl/lib/msg.c:573  nlmsg_free: Returned message reference 0x555b3fac9f60, 0 remaining
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:580  nlmsg_free: msg 0x555b3fac9f60: Freed
DBG<4>/root/nbs/contrib/restricted/libnl/lib/object.c:228  nl_object_put: Returned object reference 0x555b3fa82f00, 0 remaining
DBG<4>/root/nbs/contrib/restricted/libnl/lib/object.c:194  nl_object_free: Freed object 0x555b3fa82f00
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:285  __nlmsg_alloc: msg 0x555b3fac9f60: Allocated new message, maxlen=4096
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:526  nlmsg_put: msg 0x555b3fac9f60: Added netlink header type=33, flags=0, pid=0, seq=0
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:433  nlmsg_reserve: msg 0x555b3fac9f60: Reserved 4 (4) bytes, pad=4, nlmsg_len=20
DBG<2>/root/nbs/contrib/restricted/libnl/lib/genl/genl.c:362  genlmsg_put: msg 0x555b3fac9f60: Added generic netlink header cmd=3 version=0
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:482  nla_reserve: msg 0x555b3fac9f60: attr <0x555b3f5c9014> 1: Reserved 8 (4) bytes at offset +4 nlmsg_len=28
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:517  nla_put: msg 0x555b3fac9f60: attr <0x555b3f5c9014> 1: Wrote 4 bytes at offset +4
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:482  nla_reserve: msg 0x555b3fac9f60: attr <0x555b3f5c901c> 2: Reserved 12 (8) bytes at offset +12 nlmsg_len=40
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:517  nla_put: msg 0x555b3fac9f60: attr <0x555b3f5c901c> 2: Wrote 8 bytes at offset +12
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:482  nla_reserve: msg 0x555b3fac9f60: attr <0x555b3f5c9028> 3: Reserved 12 (8) bytes at offset +24 nlmsg_len=52
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:517  nla_put: msg 0x555b3fac9f60: attr <0x555b3f5c9028> 3: Wrote 8 bytes at offset +24
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:482  nla_reserve: msg 0x555b3fac9f60: attr <0x555b3f5c9034> 5: Reserved 12 (8) bytes at offset +36 nlmsg_len=64
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:517  nla_put: msg 0x555b3fac9f60: attr <0x555b3f5c9034> 5: Wrote 8 bytes at offset +36
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:482  nla_reserve: msg 0x555b3fac9f60: attr <0x555b3f5c9040> 4: Reserved 12 (8) bytes at offset +48 nlmsg_len=76
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:517  nla_put: msg 0x555b3fac9f60: attr <0x555b3f5c9040> 4: Wrote 8 bytes at offset +48
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:482  nla_reserve: msg 0x555b3fac9f60: attr <0x555b3f5c904c> 8: Reserved 12 (8) bytes at offset +60 nlmsg_len=88
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:517  nla_put: msg 0x555b3fac9f60: attr <0x555b3f5c904c> 8: Wrote 8 bytes at offset +60
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:482  nla_reserve: msg 0x555b3fac9f60: attr <0x555b3f5c9058> 32775: Reserved 4 (0) bytes at offset +72 nlmsg_len=92
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:914  nla_nest_start: msg 0x555b3fac9f60: attr <0x555b3f5c9058> 32775: starting nesting
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:482  nla_reserve: msg 0x555b3fac9f60: attr <0x555b3f5c905c> 32769: Reserved 4 (0) bytes at offset +76 nlmsg_len=96
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:914  nla_nest_start: msg 0x555b3fac9f60: attr <0x555b3f5c905c> 32769: starting nesting
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:482  nla_reserve: msg 0x555b3fac9f60: attr <0x555b3f5c9060> 1: Reserved 8 (4) bytes at offset +80 nlmsg_len=104
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:517  nla_put: msg 0x555b3fac9f60: attr <0x555b3f5c9060> 1: Wrote 4 bytes at offset +80
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:955  _nest_end: msg 0x555b3fac9f60: attr <0x555b3f5c905c> 32769: closing nesting, len=12
DBG<2>/root/nbs/contrib/restricted/libnl/lib/attr.c:955  _nest_end: msg 0x555b3fac9f60: attr <0x555b3f5c9058> 32775: closing nesting, len=16
-- Debug: Sent Message:
--------------------------   BEGIN NETLINK MESSAGE ---------------------------
  [NETLINK HEADER] 16 octets
    .nlmsg_len = 104
    .type = 33 <0x21>
    .flags = 5 <REQUEST,ACK>
    .seq = 1725525335
    .port = -936028509
  [GENERIC NETLINK HEADER] 4 octets
    .cmd = 3
    .version = 0
    .unused = 0
  [PAYLOAD] 84 octets
    08 00 01 00 0c 00 00 00 0c 00 02 00 00 00 00 40 ...............@
    17 00 00 00 0c 00 03 00 00 02 00 00 00 00 00 00 ................
    0c 00 05 00 61 00 00 00 00 00 00 00 0c 00 04 00 ....a...........
    80 51 01 00 00 00 00 00 0c 00 08 00 10 0e 00 00 .Q..............
    00 00 00 00 10 00 07 80 0c 00 01 80 08 00 01 00 ................
    0d 00 00 00                                     ....
---------------------------  END NETLINK MESSAGE   ---------------------------
DBG<4>/root/nbs/contrib/restricted/libnl/lib/nl.c:348  nl_sendmsg: sent 104 bytes
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:841  recvmsgs: Attempting to read from 0x555b3e7ef300
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:850  recvmsgs: recvmsgs(0x555b3e7ef300): Read 124 bytes
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:854  recvmsgs: recvmsgs(0x555b3e7ef300): Processing valid message...
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:285  __nlmsg_alloc: msg 0x555b3fac9fb0: Allocated new message, maxlen=124
-- Debug: Received Message:
--------------------------   BEGIN NETLINK MESSAGE ---------------------------
  [NETLINK HEADER] 16 octets
    .nlmsg_len = 124
    .type = 2 <ERROR>
    .flags = 0 <>
    .seq = 1725525335
    .port = -936028509
  [ERRORMSG] 20 octets
    .error = -22 "Invalid argument"
  [ORIGINAL MESSAGE] 16 octets
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:285  __nlmsg_alloc: msg 0x555b3faca000: Allocated new message, maxlen=4096
    .nlmsg_len = 16
    .type = 33 <0x21>
    .flags = 5 <REQUEST,ACK>
    .seq = 1725525335
    .port = -936028509
DBG<4>/root/nbs/contrib/restricted/libnl/lib/msg.c:573  nlmsg_free: Returned message reference 0x555b3faca000, 0 remaining
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:580  nlmsg_free: msg 0x555b3faca000: Freed
---------------------------  END NETLINK MESSAGE   ---------------------------
DBG<3>/root/nbs/contrib/restricted/libnl/lib/nl.c:902  recvmsgs: recvmsgs(0x555b3e7ef300): Increased expected sequence number to 1725525336
DBG<4>/root/nbs/contrib/restricted/libnl/lib/nl.c:980  recvmsgs: recvmsgs(0x555b3e7ef300): RTNETLINK responded with 22 (Invalid argument)
-- Error received: Invalid argument
-- Original message: type=0x21 length=104 flags=<REQUEST,ACK> sequence-nr=1725525335 pid=3358938787
DBG<4>/root/nbs/contrib/restricted/libnl/lib/msg.c:573  nlmsg_free: Returned message reference 0x555b3fac9fb0, 0 remaining
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:580  nlmsg_free: msg 0x555b3fac9fb0: Freed
DBG<4>/root/nbs/contrib/restricted/libnl/lib/msg.c:573  nlmsg_free: Returned message reference 0x555b3fac9f60, 0 remaining
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:580  nlmsg_free: msg 0x555b3fac9f60: Freed
DBG<4>/root/nbs/contrib/restricted/libnl/lib/msg.c:573  nlmsg_free: Returned message reference 0x555b3fac9f10, 0 remaining
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:580  nlmsg_free: msg 0x555b3fac9f10: Freed
DBG<4>/root/nbs/contrib/restricted/libnl/lib/msg.c:573  nlmsg_free: Returned message reference 0x555b3fac9ec0, 0 remaining
DBG<2>/root/nbs/contrib/restricted/libnl/lib/msg.c:580  nlmsg_free: msg 0x555b3fac9ec0: Freed
(yexception) cloud/blockstore/tools/nbd/bootstrap.cpp:312: unable to configure /dev/nbd12: Invalid input data or parameter
2024-09-05T08:35:34.830118Z :BLOCKSTORE_NBD INFO: cloud/blockstore/libs/nbd/server.cpp:593: Shutting down
DBG<1>/root/nbs/contrib/restricted/libnl/lib/cache_mngt.c:308  nl_cache_mngt_unregister: Unregistered cache operations genl/family
tpashkin commented 2 months ago

Closing, actual error is on endpoint-proxy side https://github.com/ydb-platform/nbs/pull/1900