Azure / iotedge

The IoT Edge OSS project
MIT License
1.47k stars 462 forks source link

iot hub goes into error state #7010

Closed sugato007 closed 1 year ago

sugato007 commented 1 year ago

Expected Behavior

azure iot hub module should be in running state

Current Behavior

after the device starts , the iothub module is in running state for sometime and then gets into error state, the docker container for the iot hub module also exits

Device Information

Logs

aziot-edged logs ``` ```
edge-agent logs ``` 6> 2023-04-28 14:13:04.133 +00:00 [INF] - Starting compaction of stores <6> 2023-04-28 14:13:04.133 +00:00 [INF] - Starting compaction of store deploymentConfig <6> 2023-04-28 14:13:04.133 +00:00 [INF] - Starting compaction of store moduleState <6> 2023-04-28 14:13:04.134 +00:00 [INF] - Starting compaction of store default <6> 2023-04-28 14:13:04.134 +00:00 [INF] - Starting compaction of store Metrics <6> 2023-04-28 14:13:06.950 +00:00 [INF] - Starting periodic operation Metrics Scrape... <6> 2023-04-28 14:13:06.950 +00:00 [INF] - Scraping Metrics <6> 2023-04-28 14:13:06.950 +00:00 [INF] - Scraping endpoint http://edgeHub:9600/metrics <6> 2023-04-28 14:13:06.954 +00:00 [INF] - Error scraping endpoint http://edgeHub:9600/metrics - System.Net.Internals.SocketExceptionFactory+ExtendedSocketException (00000005, 0xFFFDFFFF): Name does not resolve at System.Net.Dns.GetHostEntryOrAddressesCore(String hostName, Boolean justAddresses, AddressFamily addressFamily, ValueStopwatch stopwatch) at System.Net.Dns.GetHostEntry(String hostNameOrAddress, AddressFamily family) at Microsoft.Azure.Devices.Edge.Agent.Diagnostics.MetricsScraper.GetUriWithIpAddress(String endpoint) in /mnt/vss/_work/1/s/edge-agent/src/Microsoft.Azure.Devices.Edge.Agent.Diagnostics/MetricsScraper.cs:line 59 at Microsoft.Azure.Devices.Edge.Agent.Diagnostics.MetricsScraper.ScrapeEndpoint(String endpoint, CancellationToken cancellationToken) in /mnt/vss/_work/1/s/edge-agent/src/Microsoft.Azure.Devices.Edge.Agent.Diagnostics/MetricsScraper.cs:line 102 <6> 2023-04-28 14:13:06.954 +00:00 [INF] - Scraping endpoint http://edgeAgent:9600/metrics <6> 2023-04-28 14:13:06.966 +00:00 [INF] - Storing Metrics <6> 2023-04-28 14:13:06.973 +00:00 [INF] - Scraped and Stored Metrics <6> 2023-04-28 14:13:06.973 +00:00 [INF] - Successfully completed periodic operation Metrics Scrape <6> 2023-04-28 14:13:16.445 +00:00 [INF] - Starting periodic operation refresh twin config... <6> 2023-04-28 14:13:16.926 +00:00 [INF] - Obtained Edge agent twin from IoTHub with desired properties version 3 and reported properties version 94. <6> 2023-04-28 14:13:16.928 +00:00 [INF] - Successfully completed periodic operation refresh twin config <6> 2023-04-28 14:21:44.408 +00:00 [INF] - Updated reported properties <6> 2023-04-28 14:22:44.938 +00:00 [INF] - Updated reported properties <6> 2023-04-28 14:22:51.724 +00:00 [INF] - Updated reported properties <6> 2023-04-28 14:46:54.255 +00:00 [INF] - Received direct method call - ping <6> 2023-04-28 14:46:54.255 +00:00 [INF] - Received request ping with payload <6> 2023-04-28 14:46:54.255 +00:00 [INF] - Successfully handled request ping <6> 2023-04-28 14:46:54.984 +00:00 [INF] - Received direct method call - GetModuleLogs <6> 2023-04-28 14:46:54.984 +00:00 [INF] - Received request GetModuleLogs with payload <6> 2023-04-28 14:46:54.984 +00:00 [INF] - Processing request to get logs for {"schemaVersion":"1.0","items":{"id":"\\bedgeHub\\b","filter":{"tail":1500,"since":"15m","until":null,"loglevel":null,"regex":""}},"encoding":1,"contentType":1} <6> 2023-04-28 14:46:55.012 +00:00 [INF] - Initiating streaming logs for edgeHub <6> 2023-04-28 14:46:55.025 +00:00 [INF] - Received 20 bytes of logs for edgeHub <6> 2023-04-28 14:46:55.025 +00:00 [INF] - Successfully handled request GetModuleLogs <6> 2023-04-28 14:47:00.379 +00:00 [INF] - Received direct method call - GetModuleLogs <6> 2023-04-28 14:47:00.379 +00:00 [INF] - Received request GetModuleLogs with payload <6> 2023-04-28 14:47:00.379 +00:00 [INF] - Processing request to get logs for {"schemaVersion":"1.0","items":{"id":"\\bedgeHub\\b","filter":{"tail":1500,"since":"60m","until":null,"loglevel":null,"regex":""}},"encoding":1,"contentType":1} <6> 2023-04-28 14:47:00.404 +00:00 [INF] - Initiating streaming logs for edgeHub <6> 2023-04-28 14:47:00.429 +00:00 [INF] - Received 3710 bytes of logs for edgeHub <6> 2023-04-28 14:47:00.429 +00:00 [INF] - Successfully handled request GetModuleLogs <6> 2023-04-28 14:49:32.405 +00:00 [INF] - Received direct method call - ping <6> 2023-04-28 14:49:32.405 +00:00 [INF] - Received request ping with payload <6> 2023-04-28 14:49:32.405 +00:00 [INF] - Successfully handled request ping <6> 2023-04-28 14:49:33.151 +00:00 [INF] - Received direct method call - GetModuleLogs <6> 2023-04-28 14:49:33.151 +00:00 [INF] - Received request GetModuleLogs with payload <6> 2023-04-28 14:49:33.152 +00:00 [INF] - Processing request to get logs for {"schemaVersion":"1.0","items":{"id":"\\bedgeAgent\\b","filter":{"tail":1500,"since":"15m","until":null,"loglevel":null,"regex":""}},"encoding":1,"contentType":1} <6> 2023-04-28 14:49:33.161 +00:00 [INF] - Initiating streaming logs for edgeAgent <6> 2023-04-28 14:49:33.169 +00:00 [INF] - Received 448 bytes of logs for edgeAgent <6> 2023-04-28 14:49:33.169 +00:00 [INF] - Successfully handled request GetModuleLogs <6> 2023-04-28 14:49:42.079 +00:00 [INF] - Received direct method call - GetModuleLogs <6> 2023-04-28 14:49:42.079 +00:00 [INF] - Received request GetModuleLogs with payload <6> 2023-04-28 14:49:42.079 +00:00 [INF] - Processing request to get logs for {"schemaVersion":"1.0","items":{"id":"\\bedgeAgent\\b","filter":{"tail":1500,"since":"60m","until":null,"loglevel":null,"regex":""}},"encoding":1,"contentType":1} ```
edge-hub logs ``` 2023-04-28 14:21:42 Starting Edge Hub 2023-04-28 14:21:42 Starting Edge Hub 2023-04-28 14:21:42 Changing ownership of storage folder: /tmp/edgeHub to 13623 2023-04-28 14:21:42 Changing ownership of backup folder: /tmp/edgeHub_backup to 13623 2023-04-28 14:21:42.641 +00:00 Edge Hub Main() <6> 2023-04-28 14:21:43.966 +00:00 [INF] - Installing certificates [CN=iotedged workload ca:10/24/2023 10:07:14],[CN=Honeywell FC Device CBLD Intermediate CA - QA, OU=HCE, O=HONEYWELL, L=BANGALORE, S=KARNATAKA, C=IN:01/25/2043 10:45:39],[E=Jayashree.Madanala@honeywell.com, CN=Honeywell FC Device CBLD CA - QA, OU=HCE, O=HONEYWELL, L=BANGALORE, S=KARNATAKA, C=IN:01/25/2043 10:38:53] to Root <6> 2023-04-28 14:21:44.047 +00:00 [INF] - Installing certificates [CN=iotedged workload ca:10/24/2023 10:07:14],[CN=Honeywell FC Device CBLD Intermediate CA - QA, OU=HCE, O=HONEYWELL, L=BANGALORE, S=KARNATAKA, C=IN:01/25/2043 10:45:39],[E=Jayashree.Madanala@honeywell.com, CN=Honeywell FC Device CBLD CA - QA, OU=HCE, O=HONEYWELL, L=BANGALORE, S=KARNATAKA, C=IN:01/25/2043 10:38:53] to Root <6> 2023-04-28 14:21:44.063 +00:00 [INF] - Enabling SSL protocols: Tls12 <6> 2023-04-28 14:21:44.219 +00:00 [INF] - Experimental features configuration: {"Enabled":false,"DisableCloudSubscriptions":false,"DisableConnectivityCheck":false} <6> 2023-04-28 14:21:44.751 +00:00 [INF] - Created persistent store at /tmp/edgeHub <6> 2023-04-28 14:21:44.824 +00:00 [INF] - Initializing Edge Hub <6> 2023-04-28 14:21:44.824 +00:00 [INF] - █████╗ ███████╗██╗ ██╗██████╗ ███████╗ ██╔══██╗╚══███╔╝██║ ██║██╔══██╗██╔════╝ ███████║ ███╔╝ ██║ ██║██████╔╝█████╗ ██╔══██║ ███╔╝ ██║ ██║██╔══██╗██╔══╝ ██║ ██║███████╗╚██████╔╝██║ ██║███████╗ ╚═╝ ╚═╝╚══════╝ ╚═════╝ ╚═╝ ╚═╝╚══════╝ ██╗ ██████╗ ████████╗ ███████╗██████╗ ██████╗ ███████╗ ██║██╔═══██╗╚══██╔══╝ ██╔════╝██╔══██╗██╔════╝ ██╔════╝ ██║██║ ██║ ██║ █████╗ ██║ ██║██║ ███╗█████╗ ██║██║ ██║ ██║ ██╔══╝ ██║ ██║██║ ██║██╔══╝ ██║╚██████╔╝ ██║ ███████╗██████╔╝╚██████╔╝███████╗ ╚═╝ ╚═════╝ ╚═╝ ╚══════╝╚═════╝ ╚═════╝ ╚══════╝ <6> 2023-04-28 14:21:44.826 +00:00 [INF] - Version - 1.4.2.61356014 (bb9a26162c4c88b3ef9a50d33632ab78bd4247d6) <6> 2023-04-28 14:21:44.826 +00:00 [INF] - OptimizeForPerformance=True <6> 2023-04-28 14:21:44.826 +00:00 [INF] - MessageAckTimeoutSecs=30 <6> 2023-04-28 14:21:44.827 +00:00 [INF] - Loaded server certificate with expiration date of "2023-05-28T14:21:43.0000000+00:00" <6> 2023-04-28 14:21:44.837 +00:00 [INF] - Using Asp Net server for metrics <6> 2023-04-28 14:21:44.897 +00:00 [INF] - Created new message store <6> 2023-04-28 14:21:44.899 +00:00 [INF] - Started task to cleanup processed and stale messages <6> 2023-04-28 14:21:44.987 +00:00 [INF] - Created DeviceConnectivityManager with connected check frequency 00:05:00 and disconnected check frequency 00:02:00 <6> 2023-04-28 14:21:45.047 +00:00 [INF] - Add node: eeea781a19f13a1cb666a99a1bf22dc1 <6> 2023-04-28 14:21:45.048 +00:00 [INF] - Add node: eeea781a19f13a1cb666a99a1bf22dc1/$edgeAgent <6> 2023-04-28 14:21:45.048 +00:00 [INF] - Add node: eeea781a19f13a1cb666a99a1bf22dc1/$edgeHub <6> 2023-04-28 14:21:45.048 +00:00 [INF] - Add node: eeea781a19f13a1cb666a99a1bf22dc1/IoTHubDeviceUpdate <6> 2023-04-28 14:21:45.049 +00:00 [INF] - Add node: eeea781a19f13a1cb666a99a1bf22dc1/sisdb7610 <6> 2023-04-28 14:21:45.049 +00:00 [INF] - Add node: eeea781a19f13a1cb666a99a1bf22dc1/vse7610 <6> 2023-04-28 14:21:45.050 +00:00 [INF] - Created device scope identities cache <6> 2023-04-28 14:21:45.059 +00:00 [INF] - Starting refresh of device scope identities cache <6> 2023-04-28 14:21:45.062 +00:00 [INF] - Initialized storing twin manager <6> 2023-04-28 14:21:45.070 +00:00 [INF] - Updated node: eeea781a19f13a1cb666a99a1bf22dc1/$edgeHub <6> 2023-04-28 14:21:45.070 +00:00 [INF] - Initializing configuration <6> 2023-04-28 14:21:45.082 +00:00 [INF] - New device connection for device eeea781a19f13a1cb666a99a1bf22dc1/$edgeHub <6> 2023-04-28 14:21:45.090 +00:00 [INF] - Client eeea781a19f13a1cb666a99a1bf22dc1/$edgeHub connected to edgeHub, processing existing subscriptions. <6> 2023-04-28 14:21:45.128 +00:00 [INF] - Attempting to connect to IoT Hub for client eeea781a19f13a1cb666a99a1bf22dc1/$edgeHub via AMQP... <6> 2023-04-28 14:21:45.143 +00:00 [INF] - Processing pending subscriptions for eeea781a19f13a1cb666a99a1bf22dc1/$edgeHub <6> 2023-04-28 14:21:45.336 +00:00 [INF] - Experimental features configuration: {"Enabled":false,"DisableCloudSubscriptions":false,"DisableConnectivityCheck":false} <6> 2023-04-28 14:21:45.352 +00:00 [INF] - Starting timer to authenticate connections with a period of 300 seconds <4> 2023-04-28 14:21:45.363 +00:00 [WRN] - Empty edge hub configuration received. Ignoring... <6> 2023-04-28 14:21:45.394 +00:00 [INF] - Scheduling server certificate renewal for "2023-05-28T14:19:13.0000850Z". <6> 2023-04-28 14:21:50.500 +00:00 [INF] - Not changed node: eeea781a19f13a1cb666a99a1bf22dc1 <6> 2023-04-28 14:21:50.501 +00:00 [INF] - Not changed node: eeea781a19f13a1cb666a99a1bf22dc1/$edgeAgent <6> 2023-04-28 14:21:50.501 +00:00 [INF] - Updated node: eeea781a19f13a1cb666a99a1bf22dc1/$edgeHub <6> 2023-04-28 14:21:50.529 +00:00 [INF] - Service identity for eeea781a19f13a1cb666a99a1bf22dc1/$edgeHub in device scope was updated. <6> 2023-04-28 14:21:50.529 +00:00 [INF] - Not changed node: eeea781a19f13a1cb666a99a1bf22dc1/vse7610 <6> 2023-04-28 14:21:50.529 +00:00 [INF] - Not changed node: eeea781a19f13a1cb666a99a1bf22dc1/sisdb7610 <6> 2023-04-28 14:21:50.529 +00:00 [INF] - Not changed node: eeea781a19f13a1cb666a99a1bf22dc1/IoTHubDeviceUpdate <6> 2023-04-28 14:21:50.532 +00:00 [INF] - Done refreshing device scope identities cache. Waiting for 60 minutes. <4> 2023-04-28 14:22:45.274 +00:00 [WRN] - Error creating cloud connection for client eeea781a19f13a1cb666a99a1bf22dc1/$edgeHub System.TimeoutException: The operation timed out. ---> Microsoft.Azure.Devices.Client.Exceptions.IotHubCommunicationException: Transient network error occurred, please retry. ---> System.TimeoutException: The operation did not complete within the allocated time 00:01:00 for object fc-non-epm-iothub-qa.azure-devices.net:5671. at Microsoft.Azure.Amqp.ExceptionDispatcher.Throw(Exception exception) at Microsoft.Azure.Amqp.AsyncResult.End[TAsyncResult](IAsyncResult result) at Microsoft.Azure.Amqp.Transport.AmqpTransportInitiator.ConnectAsyncResult.End(IAsyncResult result) at Microsoft.Azure.Amqp.Transport.AmqpTransportInitiator.<>c.b__17_1(IAsyncResult r) at System.Threading.Tasks.TaskFactory`1.FromAsyncCoreLogic(IAsyncResult iar, Func`2 endFunction, Action`1 endAction, Task`1 promise, Boolean requiresSynchronization) --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpIoTTransport.InitializeAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpIoTConnector.OpenConnectionAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpConnectionHolder.EnsureConnectionAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpConnectionHolder.OpenSessionAsync(DeviceIdentity deviceIdentity, TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpUnit.EnsureSessionIsOpenAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpUnit.OpenAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpTransportHandler.OpenAsync(CancellationToken cancellationToken) at Microsoft.Azure.Devices.Client.Transport.ProtocolRoutingDelegatingHandler.OpenAsync(CancellationToken cancellationToken) at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.<>c__DisplayClass27_0.<b__0>d.MoveNext() --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.ExecuteWithErrorHandlingAsync[T](Func`1 asyncOperation) --- End of inner exception stack trace --- at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.ExecuteWithErrorHandlingAsync[T](Func`1 asyncOperation) at Microsoft.Azure.Devices.Client.Transport.RetryDelegatingHandler.<>c__DisplayClass38_0.<b__0>d.MoveNext() --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Client.Transport.RetryDelegatingHandler.EnsureOpenedAsync(CancellationToken cancellationToken) at Microsoft.Azure.Devices.Client.InternalClient.OpenAsync() --- End of inner exception stack trace --- at Microsoft.Azure.Devices.Client.InternalClient.OpenAsync() at Microsoft.Azure.Devices.Edge.Util.TaskEx.TimeoutAfter(Task task, TimeSpan timeout, Action action) in /mnt/vss/_work/1/s/edge-util/src/Microsoft.Azure.Devices.Edge.Util/TaskEx.cs:line 158 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ModuleClientWrapper.OpenAsync() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ModuleClientWrapper.cs:line 56 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.<>c__DisplayClass30_0.<b__0>d.MoveNext() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 194 --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.InvokeFunc[T](Func`1 func, String operation, Boolean useForConnectivityCheck) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 146 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.InvokeFunc[T](Func`1 func, String operation, Boolean useForConnectivityCheck) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 182 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.OpenAsync() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 62 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnection.ConnectToIoTHub(ITokenProvider newTokenProvider) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnection.cs:line 137 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnection.CreateNewCloudProxyAsync(ITokenProvider newTokenProvider) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnection.cs:line 112 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnection.Create(IIdentity identity, Action`2 connectionStatusChangedHandler, ITransportSettings[] transportSettings, IMessageConverterProvider messageConverterProvider, IClientProvider clientProvider, ICloudListener cloudListener, ITokenProvider tokenProvider, TimeSpan idleTimeout, Boolean closeOnIdleTimeout, TimeSpan operationTimeout, TimeSpan cloudConnectionHangingTimeout, String productInfo, Option`1 modelId) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnection.cs:line 101 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnectionProvider.TryCreateCloudConnectionFromServiceIdentity(IIdentity identity, Action`2 connectionStatusChangedHandler, Boolean refreshOutOfDateCache, CloudListener cloudListener, String authChain) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnectionProvider.cs:line 285 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnectionProvider.ConnectInternalWithDeviceStateTracking(IIdentity identity, Action`2 connectionStatusChangedHandler, Boolean refreshCachedIdentity) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnectionProvider.cs:line 256 <6> 2023-04-28 14:22:45.301 +00:00 [INF] - Error getting cloud connection for device eeea781a19f13a1cb666a99a1bf22dc1/$edgeHub System.TimeoutException: The operation timed out. ---> Microsoft.Azure.Devices.Client.Exceptions.IotHubCommunicationException: Transient network error occurred, please retry. ---> System.TimeoutException: The operation did not complete within the allocated time 00:01:00 for object fc-non-epm-iothub-qa.azure-devices.net:5671. at Microsoft.Azure.Amqp.ExceptionDispatcher.Throw(Exception exception) at Microsoft.Azure.Amqp.AsyncResult.End[TAsyncResult](IAsyncResult result) at Microsoft.Azure.Amqp.Transport.AmqpTransportInitiator.ConnectAsyncResult.End(IAsyncResult result) at Microsoft.Azure.Amqp.Transport.AmqpTransportInitiator.<>c.b__17_1(IAsyncResult r) at System.Threading.Tasks.TaskFactory`1.FromAsyncCoreLogic(IAsyncResult iar, Func`2 endFunction, Action`1 endAction, Task`1 promise, Boolean requiresSynchronization) --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpIoTTransport.InitializeAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpIoTConnector.OpenConnectionAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpConnectionHolder.EnsureConnectionAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpConnectionHolder.OpenSessionAsync(DeviceIdentity deviceIdentity, TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpUnit.EnsureSessionIsOpenAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpUnit.OpenAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpTransportHandler.OpenAsync(CancellationToken cancellationToken) at Microsoft.Azure.Devices.Client.Transport.ProtocolRoutingDelegatingHandler.OpenAsync(CancellationToken cancellationToken) at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.<>c__DisplayClass27_0.<b__0>d.MoveNext() --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.ExecuteWithErrorHandlingAsync[T](Func`1 asyncOperation) --- End of inner exception stack trace --- at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.ExecuteWithErrorHandlingAsync[T](Func`1 asyncOperation) at Microsoft.Azure.Devices.Client.Transport.RetryDelegatingHandler.<>c__DisplayClass38_0.<b__0>d.MoveNext() --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Client.Transport.RetryDelegatingHandler.EnsureOpenedAsync(CancellationToken cancellationToken) at Microsoft.Azure.Devices.Client.InternalClient.OpenAsync() --- End of inner exception stack trace --- at Microsoft.Azure.Devices.Client.InternalClient.OpenAsync() at Microsoft.Azure.Devices.Edge.Util.TaskEx.TimeoutAfter(Task task, TimeSpan timeout, Action action) in /mnt/vss/_work/1/s/edge-util/src/Microsoft.Azure.Devices.Edge.Util/TaskEx.cs:line 158 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ModuleClientWrapper.OpenAsync() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ModuleClientWrapper.cs:line 56 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.<>c__DisplayClass30_0.<b__0>d.MoveNext() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 194 --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.InvokeFunc[T](Func`1 func, String operation, Boolean useForConnectivityCheck) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 146 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.InvokeFunc[T](Func`1 func, String operation, Boolean useForConnectivityCheck) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 182 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.OpenAsync() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 62 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnection.ConnectToIoTHub(ITokenProvider newTokenProvider) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnection.cs:line 137 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnection.CreateNewCloudProxyAsync(ITokenProvider newTokenProvider) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnection.cs:line 112 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnection.Create(IIdentity identity, Action`2 connectionStatusChangedHandler, ITransportSettings[] transportSettings, IMessageConverterProvider messageConverterProvider, IClientProvider clientProvider, ICloudListener cloudListener, ITokenProvider tokenProvider, TimeSpan idleTimeout, Boolean closeOnIdleTimeout, TimeSpan operationTimeout, TimeSpan cloudConnectionHangingTimeout, String productInfo, Option`1 modelId) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnection.cs:line 101 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnectionProvider.TryCreateCloudConnectionFromServiceIdentity(IIdentity identity, Action`2 connectionStatusChangedHandler, Boolean refreshOutOfDateCache, CloudListener cloudListener, String authChain) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnectionProvider.cs:line 285 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnectionProvider.ConnectInternalWithDeviceStateTracking(IIdentity identity, Action`2 connectionStatusChangedHandler, Boolean refreshCachedIdentity) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnectionProvider.cs:line 256 <6> 2023-04-28 14:22:45.301 +00:00 [INF] - Error getting cloud connection for device eeea781a19f13a1cb666a99a1bf22dc1/$edgeHub System.TimeoutException: The operation timed out. ---> Microsoft.Azure.Devices.Client.Exceptions.IotHubCommunicationException: Transient network error occurred, please retry. ---> System.TimeoutException: The operation did not complete within the allocated time 00:01:00 for object fc-non-epm-iothub-qa.azure-devices.net:5671. at Microsoft.Azure.Amqp.ExceptionDispatcher.Throw(Exception exception) at Microsoft.Azure.Amqp.AsyncResult.End[TAsyncResult](IAsyncResult result) at Microsoft.Azure.Amqp.Transport.AmqpTransportInitiator.ConnectAsyncResult.End(IAsyncResult result) at Microsoft.Azure.Amqp.Transport.AmqpTransportInitiator.<>c.b__17_1(IAsyncResult r) at System.Threading.Tasks.TaskFactory`1.FromAsyncCoreLogic(IAsyncResult iar, Func`2 endFunction, Action`1 endAction, Task`1 promise, Boolean requiresSynchronization) --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpIoTTransport.InitializeAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpIoTConnector.OpenConnectionAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpConnectionHolder.EnsureConnectionAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpConnectionHolder.OpenSessionAsync(DeviceIdentity deviceIdentity, TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpUnit.EnsureSessionIsOpenAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpUnit.OpenAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpTransportHandler.OpenAsync(CancellationToken cancellationToken) at Microsoft.Azure.Devices.Client.Transport.ProtocolRoutingDelegatingHandler.OpenAsync(CancellationToken cancellationToken) at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.<>c__DisplayClass27_0.<b__0>d.MoveNext() --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.ExecuteWithErrorHandlingAsync[T](Func`1 asyncOperation) --- End of inner exception stack trace --- at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.ExecuteWithErrorHandlingAsync[T](Func`1 asyncOperation) at Microsoft.Azure.Devices.Client.Transport.RetryDelegatingHandler.<>c__DisplayClass38_0.<b__0>d.MoveNext() --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Client.Transport.RetryDelegatingHandler.EnsureOpenedAsync(CancellationToken cancellationToken) at Microsoft.Azure.Devices.Client.InternalClient.OpenAsync() --- End of inner exception stack trace --- at Microsoft.Azure.Devices.Client.InternalClient.OpenAsync() at Microsoft.Azure.Devices.Edge.Util.TaskEx.TimeoutAfter(Task task, TimeSpan timeout, Action action) in /mnt/vss/_work/1/s/edge-util/src/Microsoft.Azure.Devices.Edge.Util/TaskEx.cs:line 158 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ModuleClientWrapper.OpenAsync() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ModuleClientWrapper.cs:line 56 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.<>c__DisplayClass30_0.<b__0>d.MoveNext() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 194 --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.InvokeFunc[T](Func`1 func, String operation, Boolean useForConnectivityCheck) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 146 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.InvokeFunc[T](Func`1 func, String operation, Boolean useForConnectivityCheck) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 182 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.OpenAsync() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 62 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnection.ConnectToIoTHub(ITokenProvider newTokenProvider) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnection.cs:line 137 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnection.CreateNewCloudProxyAsync(ITokenProvider newTokenProvider) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnection.cs:line 112 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnection.Create(IIdentity identity, Action`2 connectionStatusChangedHandler, ITransportSettings[] transportSettings, IMessageConverterProvider messageConverterProvider, IClientProvider clientProvider, ICloudListener cloudListener, ITokenProvider tokenProvider, TimeSpan idleTimeout, Boolean closeOnIdleTimeout, TimeSpan operationTimeout, TimeSpan cloudConnectionHangingTimeout, String productInfo, Option`1 modelId) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnection.cs:line 101 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnectionProvider.TryCreateCloudConnectionFromServiceIdentity(IIdentity identity, Action`2 connectionStatusChangedHandler, Boolean refreshOutOfDateCache, CloudListener cloudListener, String authChain) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnectionProvider.cs:line 285 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnectionProvider.ConnectInternalWithDeviceStateTracking(IIdentity identity, Action`2 connectionStatusChangedHandler, Boolean refreshCachedIdentity) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnectionProvider.cs:line 256 <6> 2023-04-28 14:22:45.301 +00:00 [INF] - Error getting cloud connection for device eeea781a19f13a1cb666a99a1bf22dc1/$edgeHub System.TimeoutException: The operation timed out. ---> Microsoft.Azure.Devices.Client.Exceptions.IotHubCommunicationException: Transient network error occurred, please retry. ---> System.TimeoutException: The operation did not complete within the allocated time 00:01:00 for object fc-non-epm-iothub-qa.azure-devices.net:5671. at Microsoft.Azure.Amqp.ExceptionDispatcher.Throw(Exception exception) at Microsoft.Azure.Amqp.AsyncResult.End[TAsyncResult](IAsyncResult result) at Microsoft.Azure.Amqp.Transport.AmqpTransportInitiator.ConnectAsyncResult.End(IAsyncResult result) at Microsoft.Azure.Amqp.Transport.AmqpTransportInitiator.<>c.b__17_1(IAsyncResult r) at System.Threading.Tasks.TaskFactory`1.FromAsyncCoreLogic(IAsyncResult iar, Func`2 endFunction, Action`1 endAction, Task`1 promise, Boolean requiresSynchronization) --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpIoTTransport.InitializeAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpIoTConnector.OpenConnectionAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpConnectionHolder.EnsureConnectionAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpConnectionHolder.OpenSessionAsync(DeviceIdentity deviceIdentity, TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpUnit.EnsureSessionIsOpenAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpUnit.OpenAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpTransportHandler.OpenAsync(CancellationToken cancellationToken) at Microsoft.Azure.Devices.Client.Transport.ProtocolRoutingDelegatingHandler.OpenAsync(CancellationToken cancellationToken) at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.<>c__DisplayClass27_0.<b__0>d.MoveNext() --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.ExecuteWithErrorHandlingAsync[T](Func`1 asyncOperation) --- End of inner exception stack trace --- at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.ExecuteWithErrorHandlingAsync[T](Func`1 asyncOperation) at Microsoft.Azure.Devices.Client.Transport.RetryDelegatingHandler.<>c__DisplayClass38_0.<b__0>d.MoveNext() --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Client.Transport.RetryDelegatingHandler.EnsureOpenedAsync(CancellationToken cancellationToken) at Microsoft.Azure.Devices.Client.InternalClient.OpenAsync() --- End of inner exception stack trace --- at Microsoft.Azure.Devices.Client.InternalClient.OpenAsync() at Microsoft.Azure.Devices.Edge.Util.TaskEx.TimeoutAfter(Task task, TimeSpan timeout, Action action) in /mnt/vss/_work/1/s/edge-util/src/Microsoft.Azure.Devices.Edge.Util/TaskEx.cs:line 158 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ModuleClientWrapper.OpenAsync() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ModuleClientWrapper.cs:line 56 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.<>c__DisplayClass30_0.<b__0>d.MoveNext() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 194 --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.InvokeFunc[T](Func`1 func, String operation, Boolean useForConnectivityCheck) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 146 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.InvokeFunc[T](Func`1 func, String operation, Boolean useForConnectivityCheck) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 182 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.OpenAsync() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 62 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnection.ConnectToIoTHub(ITokenProvider newTokenProvider) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnection.cs:line 137 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnection.CreateNewCloudProxyAsync(ITokenProvider newTokenProvider) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnection.cs:line 112 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnection.Create(IIdentity identity, Action`2 connectionStatusChangedHandler, ITransportSettings[] transportSettings, IMessageConverterProvider messageConverterProvider, IClientProvider clientProvider, ICloudListener cloudListener, ITokenProvider tokenProvider, TimeSpan idleTimeout, Boolean closeOnIdleTimeout, TimeSpan operationTimeout, TimeSpan cloudConnectionHangingTimeout, String productInfo, Option`1 modelId) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnection.cs:line 101 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnectionProvider.TryCreateCloudConnectionFromServiceIdentity(IIdentity identity, Action`2 connectionStatusChangedHandler, Boolean refreshOutOfDateCache, CloudListener cloudListener, String authChain) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnectionProvider.cs:line 285 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnectionProvider.ConnectInternalWithDeviceStateTracking(IIdentity identity, Action`2 connectionStatusChangedHandler, Boolean refreshCachedIdentity) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnectionProvider.cs:line 256 <6> 2023-04-28 14:22:45.301 +00:00 [INF] - Error getting cloud connection for device eeea781a19f13a1cb666a99a1bf22dc1/$edgeHub System.TimeoutException: The operation timed out. ---> Microsoft.Azure.Devices.Client.Exceptions.IotHubCommunicationException: Transient network error occurred, please retry. ---> System.TimeoutException: The operation did not complete within the allocated time 00:01:00 for object fc-non-epm-iothub-qa.azure-devices.net:5671. at Microsoft.Azure.Amqp.ExceptionDispatcher.Throw(Exception exception) at Microsoft.Azure.Amqp.AsyncResult.End[TAsyncResult](IAsyncResult result) at Microsoft.Azure.Amqp.Transport.AmqpTransportInitiator.ConnectAsyncResult.End(IAsyncResult result) at Microsoft.Azure.Amqp.Transport.AmqpTransportInitiator.<>c.b__17_1(IAsyncResult r) at System.Threading.Tasks.TaskFactory`1.FromAsyncCoreLogic(IAsyncResult iar, Func`2 endFunction, Action`1 endAction, Task`1 promise, Boolean requiresSynchronization) --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpIoTTransport.InitializeAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpIoTConnector.OpenConnectionAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpConnectionHolder.EnsureConnectionAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpConnectionHolder.OpenSessionAsync(DeviceIdentity deviceIdentity, TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpUnit.EnsureSessionIsOpenAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.AmqpIoT.AmqpUnit.OpenAsync(TimeSpan timeout) at Microsoft.Azure.Devices.Client.Transport.Amqp.AmqpTransportHandler.OpenAsync(CancellationToken cancellationToken) at Microsoft.Azure.Devices.Client.Transport.ProtocolRoutingDelegatingHandler.OpenAsync(CancellationToken cancellationToken) at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.<>c__DisplayClass27_0.<b__0>d.MoveNext() --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.ExecuteWithErrorHandlingAsync[T](Func`1 asyncOperation) --- End of inner exception stack trace --- at Microsoft.Azure.Devices.Client.Transport.ErrorDelegatingHandler.ExecuteWithErrorHandlingAsync[T](Func`1 asyncOperation) at Microsoft.Azure.Devices.Client.Transport.RetryDelegatingHandler.<>c__DisplayClass38_0.<b__0>d.MoveNext() --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Client.Transport.RetryDelegatingHandler.EnsureOpenedAsync(CancellationToken cancellationToken) at Microsoft.Azure.Devices.Client.InternalClient.OpenAsync() --- End of inner exception stack trace --- at Microsoft.Azure.Devices.Client.InternalClient.OpenAsync() at Microsoft.Azure.Devices.Edge.Util.TaskEx.TimeoutAfter(Task task, TimeSpan timeout, Action action) in /mnt/vss/_work/1/s/edge-util/src/Microsoft.Azure.Devices.Edge.Util/TaskEx.cs:line 158 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ModuleClientWrapper.OpenAsync() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ModuleClientWrapper.cs:line 56 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.<>c__DisplayClass30_0.<b__0>d.MoveNext() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 194 --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.InvokeFunc[T](Func`1 func, String operation, Boolean useForConnectivityCheck) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 146 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.InvokeFunc[T](Func`1 func, String operation, Boolean useForConnectivityCheck) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 182 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.ConnectivityAwareClient.OpenAsync() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/ConnectivityAwareClient.cs:line 62 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnection.ConnectToIoTHub(ITokenProvider newTokenProvider) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnection.cs:line 137 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnection.CreateNewCloudProxyAsync(ITokenProvider newTokenProvider) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnection.cs:line 112 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnection.Create(IIdentity identity, Action`2 connectionStatusChangedHandler, ITransportSettings[] transportSettings, IMessageConverterProvider messageConverterProvider, IClientProvider clientProvider, ICloudListener cloudListener, ITokenProvider tokenProvider, TimeSpan idleTimeout, Boolean closeOnIdleTimeout, TimeSpan operationTimeout, TimeSpan cloudConnectionHangingTimeout, String productInfo, Option`1 modelId) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnection.cs:line 101 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnectionProvider.TryCreateCloudConnectionFromServiceIdentity(IIdentity identity, Action`2 connectionStatusChangedHandler, Boolean refreshOutOfDateCache, CloudListener cloudListener, String authChain) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnectionProvider.cs:line 285 at Microsoft.Azure.Devices.Edge.Hub.CloudProxy.CloudConnectionProvider.ConnectInternalWithDeviceStateTracking(IIdentity identity, Action`2 connectionStatusChangedHandler, Boolean refreshCachedIdentity) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.CloudProxy/CloudConnectionProvider.cs:line 256 <6> 2023-04-28 14:22:45.309 +00:00 [INF] - Processing pending subscriptions for eeea781a19f13a1cb666a99a1bf22dc1/$edgeHub, but no cloud proxy was found <4> 2023-04-28 14:22:45.309 +00:00 [WRN] - Updating reported properties failed eeea781a19f13a1cb666a99a1bf22dc1/$edgeHub <6> 2023-04-28 14:22:45.319 +00:00 [INF] - Processing pending subscriptions for eeea781a19f13a1cb666a99a1bf22dc1/$edgeHub <3> 2023-04-28 14:22:45.413 +00:00 [ERR] - Error getting edge hub config from twin desired properties Microsoft.Azure.Devices.Edge.Util.InvalidSchemaVersionException: EdgeHub config missing SchemaVersion at Microsoft.Azure.Devices.Edge.Hub.Core.Config.EdgeHubConfigParser.GetEdgeHubConfig(String twinJson) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.Core/config/EdgeHubConfigParser.cs:line 85 at Microsoft.Azure.Devices.Edge.Hub.Core.Config.TwinConfigSource.GetConfigInternal() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.Core/config/TwinConfigSource.cs:line 130 at Microsoft.Azure.Devices.Edge.Hub.Core.Config.TwinConfigSource.GetConfigInternal() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.Core/config/TwinConfigSource.cs:line 137 <4> 2023-04-28 14:22:45.414 +00:00 [WRN] - Empty edge hub configuration received. Ignoring... <3> 2023-04-28 14:22:45.416 +00:00 [ERR] - Error initializing edge hub configuration System.InvalidOperationException: Could not obtain twin neither from local store nor from cloud. This happens when there is no upstream connection and this is the first EdgeHub startup, or there is no persistent store to save a previous twin configuration. EdgeHub cannot start without basic configuration stored in twin. Stopping now. at Microsoft.Azure.Devices.Edge.Hub.Core.Config.ConfigUpdater.<>c.b__9_6() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.Core/config/ConfigUpdater.cs:line 67 at Microsoft.Azure.Devices.Edge.Util.Option`1.Expect[TException](Func`1 exception) in /mnt/vss/_work/1/s/edge-util/src/Microsoft.Azure.Devices.Edge.Util/Option.cs:line 117 at Microsoft.Azure.Devices.Edge.Hub.Core.Config.ConfigUpdater.<>c__DisplayClass9_0.<b__4>d.MoveNext() in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.Core/config/ConfigUpdater.cs:line 67 --- End of stack trace from previous location --- at Microsoft.Azure.Devices.Edge.Hub.Core.Config.ConfigUpdater.Init(IConfigSource configProvider) in /mnt/vss/_work/1/s/edge-hub/core/src/Microsoft.Azure.Devices.Edge.Hub.Core/config/ConfigUpdater.cs:line 56 <3> 2023-04-28 14:22:45.416 +00:00 [ERR] - Error starting protocol heads: Could not obtain twin neither from local store nor from cloud. This happens when there is no upstream connection and this is the first EdgeHub startup, or there is no persistent store to save a previous twin configuration. EdgeHub cannot start without basic configuration stored in twin. Stopping now. <6> 2023-04-28 14:22:45.416 +00:00 [INF] - Stopping the protocol heads... <6> 2023-04-28 14:22:45.417 +00:00 [INF] - Closing protocol heads - (MQTT, AMQP, HTTP) <6> 2023-04-28 14:22:45.419 +00:00 [INF] - Stopping MQTT protocol head <6> 2023-04-28 14:22:45.419 +00:00 [INF] - Stopped MQTT protocol head <6> 2023-04-28 14:22:45.424 +00:00 [INF] - Closing HTTP head <6> 2023-04-28 14:22:45.425 +00:00 [INF] - Closed HTTP head <6> 2023-04-28 14:22:45.425 +00:00 [INF] - Protocol heads stopped. <6> 2023-04-28 14:22:45.434 +00:00 [INF] - Shutdown complete. <6> 2023-04-28 14:22:45.434 +00:00 [INF] - Termination requested, initiating shutdown. <6> 2023-04-28 14:22:45.434 +00:00 [INF] - Waiting for cleanup to finish <6> 2023-04-28 14:22:45.435 +00:00 [INF] - Done with cleanup. Shutting down. ```

Additional Information

in the beginning of device boot or while restarting the edge hub container - status shows running image

after sometime status becomes error image

nlcamp commented 1 year ago

Hi @sugato007 - It looks like your edge-hub module is experiencing connectivity issues with IoT Hub. Can you please provide the output from running sudo iotedge check? I'd like to see what the connectivity checks report. Thanks.

sugato007 commented 1 year ago

Hi @nlcamp , here is the output of iotedge check

honadmin@psradv:~$ sudo iotedge check

Configuration checks (aziot-identity-service)
---------------------------------------------
√ keyd configuration is well-formed - OK
√ certd configuration is well-formed - OK
√ tpmd configuration is well-formed - OK
√ identityd configuration is well-formed - OK
√ daemon configurations up-to-date with config.toml - OK
√ identityd config toml file specifies a valid hostname - OK
√ aziot-identity-service package is up-to-date - OK

‼ host time is close to reference time - Warning
    Could not query NTP server
√ production readiness: identity certificates expiry - OK
√ production readiness: EST identity and bootstrap certificates expiry - OK
√ preloaded certificates are valid - OK
√ keyd is running - OK
√ certd is running - OK
√ identityd is running - OK
√ read all preloaded certificates from the Certificates Service - OK
√ read all preloaded key pairs from the Keys Service - OK
√ check all EST server URLs utilize HTTPS - OK
√ ensure all preloaded certificates match preloaded private keys with the same ID - OK

Connectivity checks (aziot-identity-service)
--------------------------------------------
‼ host can connect to and perform TLS handshake with iothub AMQP port - Warning
    Could not retrieve iothub_hostname from provisioning file.
    Please specify the backing IoT Hub name using --iothub-hostname switch if you have that information.
    Since no hostname is provided, all hub connectivity tests will be skipped.
‼ host can connect to and perform TLS handshake with iothub HTTPS / WebSockets port - Warning
    Could not retrieve iothub_hostname from provisioning file.
    Please specify the backing IoT Hub name using --iothub-hostname switch if you have that information.
    Since no hostname is provided, all hub connectivity tests will be skipped.
‼ host can connect to and perform TLS handshake with iothub MQTT port - Warning
    Could not retrieve iothub_hostname from provisioning file.
    Please specify the backing IoT Hub name using --iothub-hostname switch if you have that information.
    Since no hostname is provided, all hub connectivity tests will be skipped.
√ host can connect to and perform TLS handshake with DPS endpoint - OK

Configuration checks
--------------------
√ aziot-edged configuration is well-formed - OK
√ configuration up-to-date with config.toml - OK
√ container engine is installed and functional - OK
√ configuration has correct URIs for daemon mgmt endpoint - OK
√ aziot-edge package is up-to-date - OK
√ container time is close to host time - OK
‼ DNS server - Warning
    Container engine is not configured with DNS server setting, which may impact connectivity to IoT Hub.
    Please see https://aka.ms/iotedge-prod-checklist-dns for best practices.
    You can ignore this warning if you are setting DNS server per module in the Edge deployment.
‼ production readiness: logs policy - Warning
    Container engine is not configured to rotate module logs which may cause it run out of disk space.
    Please see https://aka.ms/iotedge-prod-checklist-logs for best practices.
    You can ignore this warning if you are setting log policy per module in the Edge deployment.
‼ production readiness: Edge Agent's storage directory is persisted on the host filesystem - Warning
    The edgeAgent module is not configured to persist its /tmp/edgeAgent directory on the host filesystem.
    Data might be lost if the module is deleted or updated.
    Please see https://aka.ms/iotedge-storage-host for best practices.
‼ production readiness: Edge Hub's storage directory is persisted on the host filesystem - Warning
    The edgeHub module is not configured to persist its /tmp/edgeHub directory on the host filesystem.
    Data might be lost if the module is deleted or updated.
    Please see https://aka.ms/iotedge-storage-host for best practices.
√ proxy settings are consistent in aziot-edged, aziot-identityd, moby daemon and config.toml - OK

Connectivity checks
-------------------
25 check(s) succeeded.
8 check(s) raised warnings. Re-run with --verbose for more details.
7 check(s) were skipped due to errors from other checks. Re-run with --verbose for more details.
nlcamp commented 1 year ago

@sugato007 - It looks like you're using v1.4.2 for EdgeHub (and likely EdgeAgent as well). There have been some bug fixes since 1.4.2 related to the symptoms you are seeing. Can you update to the latest, which is v1.4.9? To do this you'll need to update the versions for EA and EH that are specified in your deployment.

If you continue to see the same errors, please provide the updated logs for edgeHub and edgeAgent as well as the output from running sudo iotedge system logs and sudo iotedge check.

techipank commented 1 year ago

Hi @nlcamp Could you point me to the list of bug fixes from 1.4.2 to 1.4.9 and was there any bug fix related to our issue or is it some other bug fix. And if possible could you tell me why this issue is there 1.4.2 i mean what is the root cause.Last thing we wanna end up is upgrading to 1.4.9 and facing same issue.

nlcamp commented 1 year ago

The list of bug fixes can be found in our release notes on the following page: https://github.com/Azure/azure-iotedge/releases

The ones that may be relevant to your issue are:

I don't have a root cause determined yet. I wanted to have you update to the latest version to rule out any already fixed bugs. I may also need additional logs from the edge system services (keyd, certd, identityd, edged, etc.).

If you'd prefer not to update yet, you can go ahead and check for the following potential root causes:

  1. Missing iothub_hostname under the [provisioning] section in your /etc/aziot/config.toml if you are using Manual provisioning with symmetric key or X.509 certificate.
  2. Forgetting to run iotedge config apply after updating /etc/aziot/config.toml with the iothub_hostname parameter
  3. Possible network proxy required for EdgeHub communication w/ IoT Hub. See the following doc on how to configure IoT Edge for network proxies if your environment uses one: https://learn.microsoft.com/en-us/azure/iot-edge/how-to-configure-proxy-support?view=iotedge-1.4
techipank commented 1 year ago

HI @nlcamp As suggested by you to upgrade to 1.4.9 we upgraded and i could still see same behaviour

image

Logs

`root@psradv:/home/honadmin# sudo iotedge check

Configuration checks (aziot-identity-service)

√ keyd configuration is well-formed - OK √ certd configuration is well-formed - OK √ tpmd configuration is well-formed - OK √ identityd configuration is well-formed - OK √ daemon configurations up-to-date with config.toml - OK √ identityd config toml file specifies a valid hostname - OK ‼ aziot-identity-service package is up-to-date - Warning Installed aziot-identity-service package has version 1.4.3 but 1.4.4 is the latest stable version available. Please see https://aka.ms/aziot-update-runtime for update instructions. ‼ host time is close to reference time - Warning Could not query NTP server √ production readiness: identity certificates expiry - OK √ production readiness: EST identity and bootstrap certificates expiry - OK √ preloaded certificates are valid - OK √ keyd is running - OK √ certd is running - OK √ identityd is running - OK √ read all preloaded certificates from the Certificates Service - OK √ read all preloaded key pairs from the Keys Service - OK √ check all EST server URLs utilize HTTPS - OK √ ensure all preloaded certificates match preloaded private keys with the same ID - OK

Connectivity checks (aziot-identity-service)

‼ host can connect to and perform TLS handshake with iothub AMQP port - Warning Could not retrieve iothub_hostname from provisioning file. Please specify the backing IoT Hub name using --iothub-hostname switch if you have that information. Since no hostname is provided, all hub connectivity tests will be skipped. ‼ host can connect to and perform TLS handshake with iothub HTTPS / WebSockets port - Warning Could not retrieve iothub_hostname from provisioning file. Please specify the backing IoT Hub name using --iothub-hostname switch if you have that information. Since no hostname is provided, all hub connectivity tests will be skipped. ‼ host can connect to and perform TLS handshake with iothub MQTT port - Warning Could not retrieve iothub_hostname from provisioning file. Please specify the backing IoT Hub name using --iothub-hostname switch if you have that information. Since no hostname is provided, all hub connectivity tests will be skipped. √ host can connect to and perform TLS handshake with DPS endpoint - OK

Configuration checks

√ aziot-edged configuration is well-formed - OK √ configuration up-to-date with config.toml - OK √ container engine is installed and functional - OK √ configuration has correct URIs for daemon mgmt endpoint - OK ‼ aziot-edge package is up-to-date - Warning Installed IoT Edge daemon has version 1.4.9 but 1.4.10 is the latest stable version available. Please see https://aka.ms/iotedge-update-runtime for update instructions. √ container time is close to host time - OK ‼ DNS server - Warning Container engine is not configured with DNS server setting, which may impact connectivity to IoT Hub. Please see https://aka.ms/iotedge-prod-checklist-dns for best practices. You can ignore this warning if you are setting DNS server per module in the Edge deployment. ‼ production readiness: logs policy - Warning Container engine is not configured to rotate module logs which may cause it run out of disk space. Please see https://aka.ms/iotedge-prod-checklist-logs for best practices. You can ignore this warning if you are setting log policy per module in the Edge deployment. ‼ production readiness: Edge Agent's storage directory is persisted on the host filesystem - Warning The edgeAgent module is not configured to persist its /tmp/edgeAgent directory on the host filesystem. Data might be lost if the module is deleted or updated. Please see https://aka.ms/iotedge-storage-host for best practices. ‼ production readiness: Edge Hub's storage directory is persisted on the host filesystem - Warning The edgeHub module is not configured to persist its /tmp/edgeHub directory on the host filesystem. Data might be lost if the module is deleted or updated. Please see https://aka.ms/iotedge-storage-host for best practices. √ proxy settings are consistent in aziot-edged, aziot-identityd, moby daemon and config.toml - OK

Connectivity checks

23 check(s) succeeded. 10 check(s) raised warnings. Re-run with --verbose for more details. 7 check(s) were skipped due to errors from other checks. Re-run with --verbose for more details.`

May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:47 psradv aziot-edged[1290]: 2023-05-03T11:06:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:47 psradv aziot-edged[1290]: 2023-05-03T11:06:47Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "767"} May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1095"} May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:47 psradv aziot-edged[1290]: 2023-05-03T11:06:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:47 psradv aziot-edged[1290]: 2023-05-03T11:06:47Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "795"} May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1123"} May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:47 psradv aziot-edged[1290]: 2023-05-03T11:06:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:47 psradv aziot-edged[1290]: 2023-05-03T11:06:47Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "771"} May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1099"} May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:47 psradv aziot-edged[1290]: 2023-05-03T11:06:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:47 psradv aziot-edged[1290]: 2023-05-03T11:06:47Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "767"} May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1095"} May 03 11:06:47 psradv aziot-keyd[1067]: 2023-05-03T11:06:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:47 psradv aziot-edged[1290]: 2023-05-03T11:06:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:47 psradv aziot-edged[1290]: 2023-05-03T11:06:47Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/sign?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "213"} May 03 11:06:47 psradv aziot-identityd[1056]: 2023-05-03T11:06:47Z [INFO] - <-- GET /identities/modules/$edgeHub?api-version=2020-09-01&type=aziot {"host": "identityd.sock"} May 03 11:06:48 psradv aziot-edged[1290]: 2023-05-03T11:06:48Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1035"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1363"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:48 psradv aziot-edged[1290]: 2023-05-03T11:06:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:48 psradv aziot-edged[1290]: 2023-05-03T11:06:48Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/encrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "994"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - <-- POST /encrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1322"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:48 psradv aziot-edged[1290]: 2023-05-03T11:06:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:48 psradv aziot-edged[1290]: 2023-05-03T11:06:48Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1019"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1347"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:48 psradv aziot-edged[1290]: 2023-05-03T11:06:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:48 psradv aziot-edged[1290]: 2023-05-03T11:06:48Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/encrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "998"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - <-- POST /encrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1326"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:48 psradv aziot-edged[1290]: 2023-05-03T11:06:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:48 psradv aziot-edged[1290]: 2023-05-03T11:06:48Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1023"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1351"} May 03 11:06:48 psradv aziot-keyd[1067]: 2023-05-03T11:06:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:48 psradv aziot-edged[1290]: 2023-05-03T11:06:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:49 psradv aziot-keyd[1067]: 2023-05-03T11:06:49Z [INFO] - <-- POST /encrypt?api-version=2021-05-01 {"content-length": "355", "content-type": "application/json"} May 03 11:06:49 psradv aziot-keyd[1067]: 2023-05-03T11:06:49Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:49 psradv aziot-keyd[1067]: 2023-05-03T11:06:49Z [INFO] - <-- GET /key/aziot_identityd_master_id?api-version=2021-05-01 {"host": "keyd.sock"} May 03 11:06:49 psradv aziot-keyd[1067]: 2023-05-03T11:06:49Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:49 psradv aziot-keyd[1067]: 2023-05-03T11:06:49Z [INFO] - <-- POST /derivedkey?api-version=2021-05-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "336"} May 03 11:06:49 psradv aziot-keyd[1067]: 2023-05-03T11:06:49Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:49 psradv aziot-keyd[1067]: 2023-05-03T11:06:49Z [INFO] - <-- POST /derivedkey/export?api-version=2021-05-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "724"} May 03 11:06:49 psradv aziot-keyd[1067]: 2023-05-03T11:06:49Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:49 psradv aziot-keyd[1067]: 2023-05-03T11:06:49Z [INFO] - <-- POST /derivedkey?api-version=2021-05-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "340"} May 03 11:06:49 psradv aziot-keyd[1067]: 2023-05-03T11:06:49Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:49 psradv aziot-keyd[1067]: 2023-05-03T11:06:49Z [INFO] - <-- POST /derivedkey/export?api-version=2021-05-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "736"} May 03 11:06:49 psradv aziot-keyd[1067]: 2023-05-03T11:06:49Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:49 psradv aziot-identityd[1056]: 2023-05-03T11:06:49Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:49 psradv aziot-keyd[1067]: 2023-05-03T11:06:49Z [INFO] - <-- POST /sign?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "942"} May 03 11:06:49 psradv aziot-keyd[1067]: 2023-05-03T11:06:49Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:49 psradv aziot-edged[1290]: 2023-05-03T11:06:49Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:51 psradv aziot-edged[1290]: 2023-05-03T11:06:51Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/encrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "746"} May 03 11:06:51 psradv aziot-keyd[1067]: 2023-05-03T11:06:51Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:06:51 psradv aziot-keyd[1067]: 2023-05-03T11:06:51Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:51 psradv aziot-keyd[1067]: 2023-05-03T11:06:51Z [INFO] - <-- POST /encrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1074"} May 03 11:06:51 psradv aziot-keyd[1067]: 2023-05-03T11:06:51Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:51 psradv aziot-edged[1290]: 2023-05-03T11:06:51Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:52 psradv aziot-edged[1290]: 2023-05-03T11:06:52Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:06:52 psradv aziot-edged[1290]: 2023-05-03T11:06:52Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:52 psradv aziot-edged[1290]: 2023-05-03T11:06:52Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1023"} May 03 11:06:52 psradv aziot-keyd[1067]: 2023-05-03T11:06:52Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:06:52 psradv aziot-keyd[1067]: 2023-05-03T11:06:52Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:52 psradv aziot-keyd[1067]: 2023-05-03T11:06:52Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1351"} May 03 11:06:52 psradv aziot-keyd[1067]: 2023-05-03T11:06:52Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:52 psradv aziot-edged[1290]: 2023-05-03T11:06:52Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:52 psradv aziot-edged[1290]: 2023-05-03T11:06:52Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1023"} May 03 11:06:52 psradv aziot-keyd[1067]: 2023-05-03T11:06:52Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:06:52 psradv aziot-keyd[1067]: 2023-05-03T11:06:52Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:52 psradv aziot-keyd[1067]: 2023-05-03T11:06:52Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1351"} May 03 11:06:52 psradv aziot-keyd[1067]: 2023-05-03T11:06:52Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:52 psradv aziot-edged[1290]: 2023-05-03T11:06:52Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:06:57 psradv aziot-edged[1290]: 2023-05-03T11:06:57Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:06:57 psradv aziot-edged[1290]: 2023-05-03T11:06:57Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:02 psradv aziot-edged[1290]: 2023-05-03T11:07:02Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:07:02 psradv aziot-edged[1290]: 2023-05-03T11:07:02Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:06 psradv aziot-edged[1290]: 2023-05-03T11:07:06Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/certificate/server?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "66"} May 03 11:07:06 psradv aziot-keyd[1067]: 2023-05-03T11:07:06Z [INFO] - <-- GET /keypair/aziot-edged-ca?api-version=2020-09-01 {"host": "keyd.sock"} May 03 11:07:06 psradv aziot-keyd[1067]: 2023-05-03T11:07:06Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:06 psradv aziot-certd[1086]: 2023-05-03T11:07:06Z [INFO] - <-- POST /certificates?api-version=2020-09-01 {"content-type": "application/json", "host": "certd.sock", "content-length": "1361"} May 03 11:07:06 psradv aziot-keyd[1067]: 2023-05-03T11:07:06Z [INFO] - <-- POST /parameters/algorithm?api-version=2021-05-01 {"content-length": "252", "content-type": "application/json"} May 03 11:07:06 psradv aziot-keyd[1067]: 2023-05-03T11:07:06Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:06 psradv aziot-keyd[1067]: 2023-05-03T11:07:06Z [INFO] - <-- POST /parameters/rsa-modulus?api-version=2021-05-01 {"content-length": "252", "content-type": "application/json"} May 03 11:07:06 psradv aziot-keyd[1067]: 2023-05-03T11:07:06Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:06 psradv aziot-keyd[1067]: 2023-05-03T11:07:06Z [INFO] - <-- POST /parameters/rsa-exponent?api-version=2021-05-01 {"content-length": "252", "content-type": "application/json"} May 03 11:07:06 psradv aziot-keyd[1067]: 2023-05-03T11:07:06Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:06 psradv aziot-keyd[1067]: 2023-05-03T11:07:06Z [INFO] - <-- POST /encrypt?api-version=2021-05-01 {"content-length": "359", "content-type": "application/json"} May 03 11:07:06 psradv aziot-keyd[1067]: 2023-05-03T11:07:06Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:06 psradv aziot-certd[1086]: 2023-05-03T11:07:06Z [INFO] - --> 201 {"content-type": "application/json"} May 03 11:07:06 psradv aziot-edged[1290]: 2023-05-03T11:07:06Z [INFO] - --> 201 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - <-- GET /trust-bundle?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close"} May 03 11:07:07 psradv aziot-certd[1086]: 2023-05-03T11:07:07Z [INFO] - <-- GET /certificates/aziot-edged-trust-bundle?api-version=2020-09-01 {"host": "certd.sock"} May 03 11:07:07 psradv aziot-certd[1086]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "935"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1263"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "775"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1103"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "767"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1095"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "795"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1123"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "771"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1099"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "767"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1095"} May 03 11:07:07 psradv aziot-keyd[1067]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:07 psradv aziot-edged[1290]: 2023-05-03T11:07:07Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/sign?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "213"} May 03 11:07:08 psradv aziot-identityd[1056]: 2023-05-03T11:07:08Z [INFO] - <-- GET /identities/modules/$edgeHub?api-version=2020-09-01&type=aziot {"host": "identityd.sock"} May 03 11:07:08 psradv aziot-edged[1290]: 2023-05-03T11:07:08Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1023"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1351"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:08 psradv aziot-edged[1290]: 2023-05-03T11:07:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:08 psradv aziot-edged[1290]: 2023-05-03T11:07:08Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/encrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "998"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - <-- POST /encrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1326"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:08 psradv aziot-edged[1290]: 2023-05-03T11:07:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:08 psradv aziot-edged[1290]: 2023-05-03T11:07:08Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1023"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1351"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:08 psradv aziot-edged[1290]: 2023-05-03T11:07:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:08 psradv aziot-edged[1290]: 2023-05-03T11:07:08Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/encrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "998"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - <-- POST /encrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1326"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:08 psradv aziot-edged[1290]: 2023-05-03T11:07:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:08 psradv aziot-edged[1290]: 2023-05-03T11:07:08Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1023"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1351"} May 03 11:07:08 psradv aziot-keyd[1067]: 2023-05-03T11:07:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:08 psradv aziot-edged[1290]: 2023-05-03T11:07:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:09 psradv aziot-keyd[1067]: 2023-05-03T11:07:09Z [INFO] - <-- POST /encrypt?api-version=2021-05-01 {"content-length": "355", "content-type": "application/json"} May 03 11:07:09 psradv aziot-keyd[1067]: 2023-05-03T11:07:09Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:09 psradv aziot-keyd[1067]: 2023-05-03T11:07:09Z [INFO] - <-- GET /key/aziot_identityd_master_id?api-version=2021-05-01 {"host": "keyd.sock"} May 03 11:07:09 psradv aziot-keyd[1067]: 2023-05-03T11:07:09Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:09 psradv aziot-keyd[1067]: 2023-05-03T11:07:09Z [INFO] - <-- POST /derivedkey?api-version=2021-05-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "336"} May 03 11:07:09 psradv aziot-keyd[1067]: 2023-05-03T11:07:09Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:09 psradv aziot-keyd[1067]: 2023-05-03T11:07:09Z [INFO] - <-- POST /derivedkey/export?api-version=2021-05-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "724"} May 03 11:07:09 psradv aziot-keyd[1067]: 2023-05-03T11:07:09Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:09 psradv aziot-keyd[1067]: 2023-05-03T11:07:09Z [INFO] - <-- POST /derivedkey?api-version=2021-05-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "340"} May 03 11:07:09 psradv aziot-keyd[1067]: 2023-05-03T11:07:09Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:09 psradv aziot-keyd[1067]: 2023-05-03T11:07:09Z [INFO] - <-- POST /derivedkey/export?api-version=2021-05-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "736"} May 03 11:07:09 psradv aziot-keyd[1067]: 2023-05-03T11:07:09Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:09 psradv aziot-identityd[1056]: 2023-05-03T11:07:09Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:09 psradv aziot-keyd[1067]: 2023-05-03T11:07:09Z [INFO] - <-- POST /sign?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "942"} May 03 11:07:09 psradv aziot-keyd[1067]: 2023-05-03T11:07:09Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:09 psradv aziot-edged[1290]: 2023-05-03T11:07:09Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:11 psradv aziot-edged[1290]: 2023-05-03T11:07:11Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/encrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "746"} May 03 11:07:11 psradv aziot-keyd[1067]: 2023-05-03T11:07:11Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:07:11 psradv aziot-keyd[1067]: 2023-05-03T11:07:11Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:11 psradv aziot-keyd[1067]: 2023-05-03T11:07:11Z [INFO] - <-- POST /encrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1074"} May 03 11:07:11 psradv aziot-keyd[1067]: 2023-05-03T11:07:11Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:11 psradv aziot-edged[1290]: 2023-05-03T11:07:11Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:12 psradv aziot-edged[1290]: 2023-05-03T11:07:12Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:07:12 psradv aziot-edged[1290]: 2023-05-03T11:07:12Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:12 psradv aziot-edged[1290]: 2023-05-03T11:07:12Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1023"} May 03 11:07:13 psradv aziot-keyd[1067]: 2023-05-03T11:07:13Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:07:13 psradv aziot-keyd[1067]: 2023-05-03T11:07:13Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:13 psradv aziot-keyd[1067]: 2023-05-03T11:07:13Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1351"} May 03 11:07:13 psradv aziot-keyd[1067]: 2023-05-03T11:07:13Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:13 psradv aziot-edged[1290]: 2023-05-03T11:07:13Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:13 psradv aziot-edged[1290]: 2023-05-03T11:07:13Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1023"} May 03 11:07:13 psradv aziot-keyd[1067]: 2023-05-03T11:07:13Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:07:13 psradv aziot-keyd[1067]: 2023-05-03T11:07:13Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:13 psradv aziot-keyd[1067]: 2023-05-03T11:07:13Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1351"} May 03 11:07:13 psradv aziot-keyd[1067]: 2023-05-03T11:07:13Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:13 psradv aziot-edged[1290]: 2023-05-03T11:07:13Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:17 psradv aziot-edged[1290]: 2023-05-03T11:07:17Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:07:17 psradv aziot-edged[1290]: 2023-05-03T11:07:17Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:22 psradv aziot-edged[1290]: 2023-05-03T11:07:22Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:07:22 psradv aziot-edged[1290]: 2023-05-03T11:07:22Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:27 psradv aziot-edged[1290]: 2023-05-03T11:07:27Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:07:27 psradv aziot-edged[1290]: 2023-05-03T11:07:27Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:27 psradv aziot-edged[1290]: 2023-05-03T11:07:27Z [INFO] - <-- POST /modules/vse7610/stop?api-version=2022-08-03 {"host": "mgmt.sock:80", "connection": "close", "content-type": "application/json; charset=utf-8", "content-length": "0"} May 03 11:07:27 psradv aziot-edged[1290]: 2023-05-03T11:07:27Z [INFO] - Stopping module vse7610... May 03 11:07:27 psradv aziot-edged[1290]: 2023-05-03T11:07:27Z [INFO] - Stopping listener for module vse7610 May 03 11:07:27 psradv aziot-edged[1290]: 2023-05-03T11:07:27Z [INFO] - Workload API stopped May 03 11:07:27 psradv aziot-edged[1290]: 2023-05-03T11:07:27Z [INFO] - --> 204 {} May 03 11:07:27 psradv aziot-edged[1290]: 2023-05-03T11:07:27Z [INFO] - <-- POST /modules/vse7610/start?api-version=2022-08-03 {"host": "mgmt.sock:80", "connection": "close", "content-type": "application/json; charset=utf-8", "content-length": "0"} May 03 11:07:27 psradv aziot-edged[1290]: 2023-05-03T11:07:27Z [INFO] - Starting module vse7610... May 03 11:07:27 psradv aziot-edged[1290]: 2023-05-03T11:07:27Z [INFO] - Starting new listener for module vse7610 May 03 11:07:27 psradv aziot-edged[1290]: 2023-05-03T11:07:27Z [INFO] - Starting workload API... May 03 11:07:28 psradv aziot-edged[1290]: 2023-05-03T11:07:28Z [INFO] - --> 204 {} May 03 11:07:28 psradv aziot-edged[1290]: 2023-05-03T11:07:28Z [INFO] - <-- POST /modules/%24edgeAgent/genid/638181868231752533/encrypt?api-version=2022-08-03 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "2790"} May 03 11:07:28 psradv aziot-keyd[1067]: 2023-05-03T11:07:28Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:07:28 psradv aziot-keyd[1067]: 2023-05-03T11:07:28Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:28 psradv aziot-keyd[1067]: 2023-05-03T11:07:28Z [INFO] - <-- POST /encrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "3122"} May 03 11:07:28 psradv aziot-keyd[1067]: 2023-05-03T11:07:28Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:28 psradv aziot-edged[1290]: 2023-05-03T11:07:28Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:30 psradv aziot-edged[1290]: 2023-05-03T11:07:30Z [INFO] - Watchdog checking Edge runtime status May 03 11:07:30 psradv aziot-edged[1290]: 2023-05-03T11:07:30Z [INFO] - Edge runtime is running May 03 11:07:33 psradv aziot-edged[1290]: 2023-05-03T11:07:33Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:07:33 psradv aziot-edged[1290]: 2023-05-03T11:07:33Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:38 psradv aziot-edged[1290]: 2023-05-03T11:07:38Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:07:38 psradv aziot-edged[1290]: 2023-05-03T11:07:38Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:43 psradv aziot-edged[1290]: 2023-05-03T11:07:43Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:07:43 psradv aziot-edged[1290]: 2023-05-03T11:07:43Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:48 psradv aziot-edged[1290]: 2023-05-03T11:07:48Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:07:48 psradv aziot-edged[1290]: 2023-05-03T11:07:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:53 psradv aziot-edged[1290]: 2023-05-03T11:07:53Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:07:53 psradv aziot-edged[1290]: 2023-05-03T11:07:53Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:07:58 psradv aziot-edged[1290]: 2023-05-03T11:07:58Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:07:58 psradv aziot-edged[1290]: 2023-05-03T11:07:58Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:03 psradv aziot-edged[1290]: 2023-05-03T11:08:03Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:08:03 psradv aziot-edged[1290]: 2023-05-03T11:08:03Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:08 psradv aziot-edged[1290]: 2023-05-03T11:08:08Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1023"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1351"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:08 psradv aziot-edged[1290]: 2023-05-03T11:08:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:08 psradv aziot-edged[1290]: 2023-05-03T11:08:08Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1023"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1351"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:08 psradv aziot-edged[1290]: 2023-05-03T11:08:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:08 psradv aziot-edged[1290]: 2023-05-03T11:08:08Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/encrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1014"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - <-- POST /encrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1342"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:08 psradv aziot-edged[1290]: 2023-05-03T11:08:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:08 psradv aziot-edged[1290]: 2023-05-03T11:08:08Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1039"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1367"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:08 psradv aziot-edged[1290]: 2023-05-03T11:08:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:08 psradv aziot-edged[1290]: 2023-05-03T11:08:08Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/encrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1014"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - <-- POST /encrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1342"} May 03 11:08:08 psradv aziot-keyd[1067]: 2023-05-03T11:08:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:08 psradv aziot-edged[1290]: 2023-05-03T11:08:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:08 psradv aziot-edged[1290]: 2023-05-03T11:08:08Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:08:08 psradv aziot-edged[1290]: 2023-05-03T11:08:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:14 psradv aziot-edged[1290]: 2023-05-03T11:08:14Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:08:14 psradv aziot-edged[1290]: 2023-05-03T11:08:14Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:19 psradv aziot-edged[1290]: 2023-05-03T11:08:19Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:08:19 psradv aziot-edged[1290]: 2023-05-03T11:08:19Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:24 psradv aziot-edged[1290]: 2023-05-03T11:08:24Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:08:24 psradv aziot-edged[1290]: 2023-05-03T11:08:24Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:29 psradv aziot-edged[1290]: 2023-05-03T11:08:29Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:08:29 psradv aziot-edged[1290]: 2023-05-03T11:08:29Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:30 psradv aziot-edged[1290]: 2023-05-03T11:08:30Z [INFO] - Watchdog checking Edge runtime status May 03 11:08:30 psradv aziot-edged[1290]: 2023-05-03T11:08:30Z [INFO] - Edge runtime is running May 03 11:08:33 psradv aziot-edged[1290]: 2023-05-03T11:08:33Z [INFO] - <-- GET /systeminfo/resources?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:08:33 psradv aziot-edged[1290]: 2023-05-03T11:08:33Z [INFO] - Querying system resources... May 03 11:08:34 psradv aziot-edged[1290]: 2023-05-03T11:08:34Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:08:36 psradv aziot-edged[1290]: 2023-05-03T11:08:36Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:36 psradv aziot-edged[1290]: 2023-05-03T11:08:36Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:41 psradv aziot-edged[1290]: 2023-05-03T11:08:41Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:08:41 psradv aziot-edged[1290]: 2023-05-03T11:08:41Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:46 psradv aziot-edged[1290]: 2023-05-03T11:08:46Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:08:46 psradv aziot-edged[1290]: 2023-05-03T11:08:46Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:51 psradv aziot-edged[1290]: 2023-05-03T11:08:51Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:08:51 psradv aziot-edged[1290]: 2023-05-03T11:08:51Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:08:56 psradv aziot-edged[1290]: 2023-05-03T11:08:56Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:08:56 psradv aziot-edged[1290]: 2023-05-03T11:08:56Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:09:01 psradv aziot-edged[1290]: 2023-05-03T11:09:01Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:09:01 psradv aziot-edged[1290]: 2023-05-03T11:09:01Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:09:06 psradv aziot-edged[1290]: 2023-05-03T11:09:06Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:09:06 psradv aziot-edged[1290]: 2023-05-03T11:09:06Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:09:11 psradv aziot-edged[1290]: 2023-05-03T11:09:11Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:09:11 psradv aziot-edged[1290]: 2023-05-03T11:09:11Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:09:16 psradv aziot-edged[1290]: 2023-05-03T11:09:16Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:09:16 psradv aziot-edged[1290]: 2023-05-03T11:09:16Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:09:21 psradv aziot-edged[1290]: 2023-05-03T11:09:21Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:09:21 psradv aziot-edged[1290]: 2023-05-03T11:09:21Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:09:26 psradv aziot-edged[1290]: 2023-05-03T11:09:26Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:09:26 psradv aziot-edged[1290]: 2023-05-03T11:09:26Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:09:30 psradv aziot-edged[1290]: 2023-05-03T11:09:30Z [INFO] - Watchdog checking Edge runtime status May 03 11:09:30 psradv aziot-edged[1290]: 2023-05-03T11:09:30Z [INFO] - Edge runtime is running May 03 11:09:31 psradv aziot-edged[1290]: 2023-05-03T11:09:31Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:09:31 psradv aziot-edged[1290]: 2023-05-03T11:09:31Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:09:36 psradv aziot-edged[1290]: 2023-05-03T11:09:36Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:09:36 psradv aziot-edged[1290]: 2023-05-03T11:09:36Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:09:41 psradv aziot-edged[1290]: 2023-05-03T11:09:41Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:09:41 psradv aziot-edged[1290]: 2023-05-03T11:09:41Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:09:46 psradv aziot-edged[1290]: 2023-05-03T11:09:46Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:09:46 psradv aziot-edged[1290]: 2023-05-03T11:09:46Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:09:51 psradv aziot-edged[1290]: 2023-05-03T11:09:51Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:09:51 psradv aziot-edged[1290]: 2023-05-03T11:09:51Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:09:56 psradv aziot-edged[1290]: 2023-05-03T11:09:56Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:09:56 psradv aziot-edged[1290]: 2023-05-03T11:09:56Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:01 psradv aziot-edged[1290]: 2023-05-03T11:10:01Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:10:01 psradv aziot-edged[1290]: 2023-05-03T11:10:01Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:06 psradv aziot-edged[1290]: 2023-05-03T11:10:06Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:10:07 psradv aziot-edged[1290]: 2023-05-03T11:10:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:12 psradv aziot-edged[1290]: 2023-05-03T11:10:12Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:10:12 psradv aziot-edged[1290]: 2023-05-03T11:10:12Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:17 psradv aziot-edged[1290]: 2023-05-03T11:10:17Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:10:17 psradv aziot-edged[1290]: 2023-05-03T11:10:17Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:22 psradv aziot-edged[1290]: 2023-05-03T11:10:22Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:10:22 psradv aziot-edged[1290]: 2023-05-03T11:10:22Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:27 psradv aziot-edged[1290]: 2023-05-03T11:10:27Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:10:27 psradv aziot-edged[1290]: 2023-05-03T11:10:27Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:30 psradv aziot-edged[1290]: 2023-05-03T11:10:30Z [INFO] - Watchdog checking Edge runtime status May 03 11:10:30 psradv aziot-edged[1290]: 2023-05-03T11:10:30Z [INFO] - Edge runtime is running May 03 11:10:32 psradv aziot-edged[1290]: 2023-05-03T11:10:32Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:10:32 psradv aziot-edged[1290]: 2023-05-03T11:10:32Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:37 psradv aziot-edged[1290]: 2023-05-03T11:10:37Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:10:37 psradv aziot-edged[1290]: 2023-05-03T11:10:37Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:42 psradv aziot-edged[1290]: 2023-05-03T11:10:42Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:10:42 psradv aziot-edged[1290]: 2023-05-03T11:10:42Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:47 psradv aziot-edged[1290]: 2023-05-03T11:10:47Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:10:47 psradv aziot-edged[1290]: 2023-05-03T11:10:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:52 psradv aziot-edged[1290]: 2023-05-03T11:10:52Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:10:52 psradv aziot-edged[1290]: 2023-05-03T11:10:52Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:57 psradv aziot-edged[1290]: 2023-05-03T11:10:57Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:10:57 psradv aziot-edged[1290]: 2023-05-03T11:10:57Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:57 psradv aziot-edged[1290]: 2023-05-03T11:10:57Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/certificate/server?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "67"} May 03 11:10:57 psradv aziot-keyd[1067]: 2023-05-03T11:10:57Z [INFO] - <-- GET /keypair/aziot-edged-ca?api-version=2020-09-01 {"host": "keyd.sock"} May 03 11:10:57 psradv aziot-keyd[1067]: 2023-05-03T11:10:57Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:57 psradv aziot-certd[1086]: 2023-05-03T11:10:57Z [INFO] - <-- POST /certificates?api-version=2020-09-01 {"content-type": "application/json", "host": "certd.sock", "content-length": "1361"} May 03 11:10:57 psradv aziot-keyd[1067]: 2023-05-03T11:10:57Z [INFO] - <-- POST /parameters/algorithm?api-version=2021-05-01 {"content-length": "252", "content-type": "application/json"} May 03 11:10:57 psradv aziot-keyd[1067]: 2023-05-03T11:10:57Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:57 psradv aziot-keyd[1067]: 2023-05-03T11:10:57Z [INFO] - <-- POST /parameters/rsa-modulus?api-version=2021-05-01 {"content-length": "252", "content-type": "application/json"} May 03 11:10:57 psradv aziot-keyd[1067]: 2023-05-03T11:10:57Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:57 psradv aziot-keyd[1067]: 2023-05-03T11:10:57Z [INFO] - <-- POST /parameters/rsa-exponent?api-version=2021-05-01 {"content-length": "252", "content-type": "application/json"} May 03 11:10:57 psradv aziot-keyd[1067]: 2023-05-03T11:10:57Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:57 psradv aziot-keyd[1067]: 2023-05-03T11:10:57Z [INFO] - <-- POST /encrypt?api-version=2021-05-01 {"content-length": "359", "content-type": "application/json"} May 03 11:10:58 psradv aziot-keyd[1067]: 2023-05-03T11:10:58Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:58 psradv aziot-certd[1086]: 2023-05-03T11:10:58Z [INFO] - --> 201 {"content-type": "application/json"} May 03 11:10:58 psradv aziot-edged[1290]: 2023-05-03T11:10:58Z [INFO] - --> 201 {"content-type": "application/json"} May 03 11:10:58 psradv aziot-edged[1290]: 2023-05-03T11:10:58Z [INFO] - <-- GET /trust-bundle?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close"} May 03 11:10:58 psradv aziot-certd[1086]: 2023-05-03T11:10:58Z [INFO] - <-- GET /certificates/aziot-edged-trust-bundle?api-version=2020-09-01 {"host": "certd.sock"} May 03 11:10:58 psradv aziot-certd[1086]: 2023-05-03T11:10:58Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:58 psradv aziot-edged[1290]: 2023-05-03T11:10:58Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "935"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1263"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "775"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1103"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "767"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1095"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "795"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1123"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "771"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1099"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "767"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1095"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/sign?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "213"} May 03 11:10:59 psradv aziot-identityd[1056]: 2023-05-03T11:10:59Z [INFO] - <-- GET /identities/modules/$edgeHub?api-version=2020-09-01&type=aziot {"host": "identityd.sock"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1035"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1363"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/encrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "994"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /encrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1322"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1019"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1347"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/encrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "998"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /encrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1326"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1023"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1351"} May 03 11:10:59 psradv aziot-keyd[1067]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:10:59 psradv aziot-edged[1290]: 2023-05-03T11:10:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:00 psradv aziot-keyd[1067]: 2023-05-03T11:11:00Z [INFO] - <-- POST /encrypt?api-version=2021-05-01 {"content-length": "355", "content-type": "application/json"} May 03 11:11:01 psradv aziot-keyd[1067]: 2023-05-03T11:11:01Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:01 psradv aziot-keyd[1067]: 2023-05-03T11:11:01Z [INFO] - <-- GET /key/aziot_identityd_master_id?api-version=2021-05-01 {"host": "keyd.sock"} May 03 11:11:01 psradv aziot-keyd[1067]: 2023-05-03T11:11:01Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:01 psradv aziot-keyd[1067]: 2023-05-03T11:11:01Z [INFO] - <-- POST /derivedkey?api-version=2021-05-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "336"} May 03 11:11:01 psradv aziot-keyd[1067]: 2023-05-03T11:11:01Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:01 psradv aziot-keyd[1067]: 2023-05-03T11:11:01Z [INFO] - <-- POST /derivedkey/export?api-version=2021-05-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "724"} May 03 11:11:01 psradv aziot-keyd[1067]: 2023-05-03T11:11:01Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:01 psradv aziot-keyd[1067]: 2023-05-03T11:11:01Z [INFO] - <-- POST /derivedkey?api-version=2021-05-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "340"} May 03 11:11:01 psradv aziot-keyd[1067]: 2023-05-03T11:11:01Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:01 psradv aziot-keyd[1067]: 2023-05-03T11:11:01Z [INFO] - <-- POST /derivedkey/export?api-version=2021-05-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "736"} May 03 11:11:01 psradv aziot-keyd[1067]: 2023-05-03T11:11:01Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:01 psradv aziot-identityd[1056]: 2023-05-03T11:11:01Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:01 psradv aziot-keyd[1067]: 2023-05-03T11:11:01Z [INFO] - <-- POST /sign?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "942"} May 03 11:11:01 psradv aziot-keyd[1067]: 2023-05-03T11:11:01Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:01 psradv aziot-edged[1290]: 2023-05-03T11:11:01Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:02 psradv aziot-edged[1290]: 2023-05-03T11:11:02Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:11:02 psradv aziot-edged[1290]: 2023-05-03T11:11:02Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:03 psradv aziot-edged[1290]: 2023-05-03T11:11:03Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/encrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "746"} May 03 11:11:03 psradv aziot-keyd[1067]: 2023-05-03T11:11:03Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:11:03 psradv aziot-keyd[1067]: 2023-05-03T11:11:03Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:03 psradv aziot-keyd[1067]: 2023-05-03T11:11:03Z [INFO] - <-- POST /encrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1074"} May 03 11:11:03 psradv aziot-keyd[1067]: 2023-05-03T11:11:03Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:03 psradv aziot-edged[1290]: 2023-05-03T11:11:03Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:04 psradv aziot-edged[1290]: 2023-05-03T11:11:04Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1023"} May 03 11:11:04 psradv aziot-keyd[1067]: 2023-05-03T11:11:04Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:11:04 psradv aziot-keyd[1067]: 2023-05-03T11:11:04Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:04 psradv aziot-keyd[1067]: 2023-05-03T11:11:04Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1351"} May 03 11:11:04 psradv aziot-keyd[1067]: 2023-05-03T11:11:04Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:04 psradv aziot-edged[1290]: 2023-05-03T11:11:04Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:04 psradv aziot-edged[1290]: 2023-05-03T11:11:04Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1023"} May 03 11:11:04 psradv aziot-keyd[1067]: 2023-05-03T11:11:04Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:11:04 psradv aziot-keyd[1067]: 2023-05-03T11:11:04Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:04 psradv aziot-keyd[1067]: 2023-05-03T11:11:04Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1351"} May 03 11:11:04 psradv aziot-keyd[1067]: 2023-05-03T11:11:04Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:04 psradv aziot-edged[1290]: 2023-05-03T11:11:04Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:07 psradv aziot-edged[1290]: 2023-05-03T11:11:07Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:11:07 psradv aziot-edged[1290]: 2023-05-03T11:11:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:12 psradv aziot-edged[1290]: 2023-05-03T11:11:12Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:11:12 psradv aziot-edged[1290]: 2023-05-03T11:11:12Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:17 psradv aziot-edged[1290]: 2023-05-03T11:11:17Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:11:17 psradv aziot-edged[1290]: 2023-05-03T11:11:17Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:22 psradv aziot-edged[1290]: 2023-05-03T11:11:22Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:11:22 psradv aziot-edged[1290]: 2023-05-03T11:11:22Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:27 psradv aziot-edged[1290]: 2023-05-03T11:11:27Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:11:27 psradv aziot-edged[1290]: 2023-05-03T11:11:27Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:30 psradv aziot-edged[1290]: 2023-05-03T11:11:30Z [INFO] - Watchdog checking Edge runtime status May 03 11:11:30 psradv aziot-edged[1290]: 2023-05-03T11:11:30Z [INFO] - Edge runtime is running May 03 11:11:32 psradv aziot-edged[1290]: 2023-05-03T11:11:32Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:11:32 psradv aziot-edged[1290]: 2023-05-03T11:11:32Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:37 psradv aziot-edged[1290]: 2023-05-03T11:11:37Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:11:37 psradv aziot-edged[1290]: 2023-05-03T11:11:37Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:42 psradv aziot-edged[1290]: 2023-05-03T11:11:42Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:11:42 psradv aziot-edged[1290]: 2023-05-03T11:11:42Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:47 psradv aziot-edged[1290]: 2023-05-03T11:11:47Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:11:47 psradv aziot-edged[1290]: 2023-05-03T11:11:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:52 psradv aziot-edged[1290]: 2023-05-03T11:11:52Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:11:52 psradv aziot-edged[1290]: 2023-05-03T11:11:52Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:57 psradv aziot-edged[1290]: 2023-05-03T11:11:57Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:11:57 psradv aziot-edged[1290]: 2023-05-03T11:11:57Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:59 psradv aziot-edged[1290]: 2023-05-03T11:11:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1023"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1351"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:59 psradv aziot-edged[1290]: 2023-05-03T11:11:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:59 psradv aziot-edged[1290]: 2023-05-03T11:11:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1023"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1351"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:59 psradv aziot-edged[1290]: 2023-05-03T11:11:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:59 psradv aziot-edged[1290]: 2023-05-03T11:11:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/encrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1014"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - <-- POST /encrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1342"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:59 psradv aziot-edged[1290]: 2023-05-03T11:11:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:59 psradv aziot-edged[1290]: 2023-05-03T11:11:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/decrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1039"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - <-- POST /decrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1367"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:59 psradv aziot-edged[1290]: 2023-05-03T11:11:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:59 psradv aziot-edged[1290]: 2023-05-03T11:11:59Z [INFO] - <-- POST /modules/%24edgeHub/genid/638181868231752533/encrypt?api-version=2020-07-07 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "1014"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - <-- POST /encrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "1342"} May 03 11:11:59 psradv aziot-keyd[1067]: 2023-05-03T11:11:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:11:59 psradv aziot-edged[1290]: 2023-05-03T11:11:59Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:12:02 psradv aziot-edged[1290]: 2023-05-03T11:12:02Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:12:02 psradv aziot-edged[1290]: 2023-05-03T11:12:02Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:12:08 psradv aziot-edged[1290]: 2023-05-03T11:12:08Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:12:08 psradv aziot-edged[1290]: 2023-05-03T11:12:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:12:13 psradv aziot-edged[1290]: 2023-05-03T11:12:13Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:12:13 psradv aziot-edged[1290]: 2023-05-03T11:12:13Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:12:18 psradv aziot-edged[1290]: 2023-05-03T11:12:18Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:12:18 psradv aziot-edged[1290]: 2023-05-03T11:12:18Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:12:23 psradv aziot-edged[1290]: 2023-05-03T11:12:23Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:12:23 psradv aziot-edged[1290]: 2023-05-03T11:12:23Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:12:28 psradv aziot-edged[1290]: 2023-05-03T11:12:28Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:12:28 psradv aziot-edged[1290]: 2023-05-03T11:12:28Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:12:30 psradv aziot-edged[1290]: 2023-05-03T11:12:30Z [INFO] - Watchdog checking Edge runtime status May 03 11:12:30 psradv aziot-edged[1290]: 2023-05-03T11:12:30Z [INFO] - Edge runtime is running May 03 11:12:33 psradv aziot-edged[1290]: 2023-05-03T11:12:33Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:12:33 psradv aziot-edged[1290]: 2023-05-03T11:12:33Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:12:38 psradv aziot-edged[1290]: 2023-05-03T11:12:38Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:12:38 psradv aziot-edged[1290]: 2023-05-03T11:12:38Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:12:43 psradv aziot-edged[1290]: 2023-05-03T11:12:43Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:12:43 psradv aziot-edged[1290]: 2023-05-03T11:12:43Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:12:48 psradv aziot-edged[1290]: 2023-05-03T11:12:48Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:12:48 psradv aziot-edged[1290]: 2023-05-03T11:12:48Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:12:53 psradv aziot-edged[1290]: 2023-05-03T11:12:53Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:12:53 psradv aziot-edged[1290]: 2023-05-03T11:12:53Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:12:58 psradv aziot-edged[1290]: 2023-05-03T11:12:58Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:12:58 psradv aziot-edged[1290]: 2023-05-03T11:12:58Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:13:03 psradv aziot-edged[1290]: 2023-05-03T11:13:03Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:13:03 psradv aziot-edged[1290]: 2023-05-03T11:13:03Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:13:08 psradv aziot-edged[1290]: 2023-05-03T11:13:08Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:13:08 psradv aziot-edged[1290]: 2023-05-03T11:13:08Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:13:13 psradv aziot-edged[1290]: 2023-05-03T11:13:13Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:13:13 psradv aziot-edged[1290]: 2023-05-03T11:13:13Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:13:18 psradv aziot-edged[1290]: 2023-05-03T11:13:18Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:13:18 psradv aziot-edged[1290]: 2023-05-03T11:13:18Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:13:23 psradv aziot-edged[1290]: 2023-05-03T11:13:23Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:13:23 psradv aziot-edged[1290]: 2023-05-03T11:13:23Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:13:28 psradv aziot-edged[1290]: 2023-05-03T11:13:28Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:13:28 psradv aziot-edged[1290]: 2023-05-03T11:13:28Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:13:28 psradv aziot-edged[1290]: 2023-05-03T11:13:28Z [INFO] - <-- POST /modules/vse7610/stop?api-version=2022-08-03 {"host": "mgmt.sock:80", "connection": "close", "content-type": "application/json; charset=utf-8", "content-length": "0"} May 03 11:13:28 psradv aziot-edged[1290]: 2023-05-03T11:13:28Z [INFO] - Stopping module vse7610... May 03 11:13:28 psradv aziot-edged[1290]: 2023-05-03T11:13:28Z [INFO] - Stopping listener for module vse7610 May 03 11:13:28 psradv aziot-edged[1290]: 2023-05-03T11:13:28Z [INFO] - Workload API stopped May 03 11:13:28 psradv aziot-edged[1290]: 2023-05-03T11:13:28Z [INFO] - --> 204 {} May 03 11:13:28 psradv aziot-edged[1290]: 2023-05-03T11:13:28Z [INFO] - <-- POST /modules/vse7610/start?api-version=2022-08-03 {"host": "mgmt.sock:80", "connection": "close", "content-type": "application/json; charset=utf-8", "content-length": "0"} May 03 11:13:28 psradv aziot-edged[1290]: 2023-05-03T11:13:28Z [INFO] - Starting module vse7610... May 03 11:13:28 psradv aziot-edged[1290]: 2023-05-03T11:13:28Z [INFO] - Starting new listener for module vse7610 May 03 11:13:28 psradv aziot-edged[1290]: 2023-05-03T11:13:28Z [INFO] - Starting workload API... May 03 11:13:28 psradv aziot-edged[1290]: 2023-05-03T11:13:28Z [INFO] - --> 204 {} May 03 11:13:28 psradv aziot-edged[1290]: 2023-05-03T11:13:28Z [INFO] - <-- POST /modules/%24edgeAgent/genid/638181868231752533/encrypt?api-version=2022-08-03 {"accept": "application/json", "host": "workload.sock:80", "connection": "close", "content-type": "application/json", "content-length": "2790"} May 03 11:13:28 psradv aziot-keyd[1067]: 2023-05-03T11:13:28Z [INFO] - <-- POST /key?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "74"} May 03 11:13:28 psradv aziot-keyd[1067]: 2023-05-03T11:13:28Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:13:28 psradv aziot-keyd[1067]: 2023-05-03T11:13:28Z [INFO] - <-- POST /encrypt?api-version=2020-09-01 {"content-type": "application/json", "host": "keyd.sock", "content-length": "3122"} May 03 11:13:28 psradv aziot-keyd[1067]: 2023-05-03T11:13:28Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:13:28 psradv aziot-edged[1290]: 2023-05-03T11:13:28Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:13:30 psradv aziot-edged[1290]: 2023-05-03T11:13:30Z [INFO] - Watchdog checking Edge runtime status May 03 11:13:30 psradv aziot-edged[1290]: 2023-05-03T11:13:30Z [INFO] - Edge runtime is running May 03 11:13:33 psradv aziot-edged[1290]: 2023-05-03T11:13:33Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:13:33 psradv aziot-edged[1290]: 2023-05-03T11:13:33Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:13:36 psradv aziot-edged[1290]: 2023-05-03T11:13:36Z [INFO] - <-- GET /systeminfo/resources?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:13:36 psradv aziot-edged[1290]: 2023-05-03T11:13:36Z [INFO] - Querying system resources... May 03 11:13:39 psradv aziot-edged[1290]: 2023-05-03T11:13:39Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:13:41 psradv aziot-edged[1290]: 2023-05-03T11:13:41Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:13:41 psradv aziot-edged[1290]: 2023-05-03T11:13:41Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:13:46 psradv aziot-edged[1290]: 2023-05-03T11:13:46Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:13:46 psradv aziot-edged[1290]: 2023-05-03T11:13:46Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:13:51 psradv aziot-edged[1290]: 2023-05-03T11:13:51Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:13:51 psradv aziot-edged[1290]: 2023-05-03T11:13:51Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:13:56 psradv aziot-edged[1290]: 2023-05-03T11:13:56Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:13:56 psradv aziot-edged[1290]: 2023-05-03T11:13:56Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:01 psradv aziot-edged[1290]: 2023-05-03T11:14:01Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:14:01 psradv aziot-edged[1290]: 2023-05-03T11:14:01Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:06 psradv aziot-edged[1290]: 2023-05-03T11:14:06Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:14:06 psradv aziot-edged[1290]: 2023-05-03T11:14:06Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:11 psradv aziot-edged[1290]: 2023-05-03T11:14:11Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:14:11 psradv aziot-edged[1290]: 2023-05-03T11:14:11Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:16 psradv aziot-edged[1290]: 2023-05-03T11:14:16Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:14:16 psradv aziot-edged[1290]: 2023-05-03T11:14:16Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:21 psradv aziot-edged[1290]: 2023-05-03T11:14:21Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:14:21 psradv aziot-edged[1290]: 2023-05-03T11:14:21Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:26 psradv aziot-edged[1290]: 2023-05-03T11:14:26Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:14:26 psradv aziot-edged[1290]: 2023-05-03T11:14:26Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:30 psradv aziot-edged[1290]: 2023-05-03T11:14:30Z [INFO] - Watchdog checking Edge runtime status May 03 11:14:30 psradv aziot-edged[1290]: 2023-05-03T11:14:30Z [INFO] - Edge runtime is running May 03 11:14:31 psradv aziot-edged[1290]: 2023-05-03T11:14:31Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:14:31 psradv aziot-edged[1290]: 2023-05-03T11:14:31Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:37 psradv aziot-edged[1290]: 2023-05-03T11:14:37Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:14:37 psradv aziot-edged[1290]: 2023-05-03T11:14:37Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:41 psradv aziot-certd[1086]: 2023-05-03T11:14:41Z [INFO] - <-- GET /certificates/aziot-edged-trust-bundle?api-version=2020-09-01 {"host": "certd.sock"} May 03 11:14:41 psradv aziot-certd[1086]: 2023-05-03T11:14:41Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:41 psradv aziot-certd[1086]: 2023-05-03T11:14:41Z [INFO] - <-- GET /certificates/est-bootstrap-id?api-version=2020-09-01 {"host": "certd.sock"} May 03 11:14:41 psradv aziot-certd[1086]: 2023-05-03T11:14:41Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:41 psradv aziot-certd[1086]: 2023-05-03T11:14:41Z [INFO] - <-- GET /certificates/est-server-ca-1?api-version=2020-09-01 {"host": "certd.sock"} May 03 11:14:41 psradv aziot-certd[1086]: 2023-05-03T11:14:41Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:41 psradv aziot-keyd[1067]: 2023-05-03T11:14:41Z [INFO] - <-- GET /keypair/est-bootstrap-id?api-version=2021-05-01 {"host": "keyd.sock"} May 03 11:14:41 psradv aziot-keyd[1067]: 2023-05-03T11:14:41Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:41 psradv aziot-keyd[1067]: 2023-05-03T11:14:41Z [INFO] - <-- POST /parameters/algorithm?api-version=2021-05-01 {"content-length": "256", "content-type": "application/json"} May 03 11:14:41 psradv aziot-keyd[1067]: 2023-05-03T11:14:41Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:41 psradv aziot-keyd[1067]: 2023-05-03T11:14:41Z [INFO] - <-- POST /parameters/rsa-modulus?api-version=2021-05-01 {"content-length": "256", "content-type": "application/json"} May 03 11:14:41 psradv aziot-keyd[1067]: 2023-05-03T11:14:41Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:41 psradv aziot-keyd[1067]: 2023-05-03T11:14:41Z [INFO] - <-- POST /parameters/rsa-exponent?api-version=2021-05-01 {"content-length": "256", "content-type": "application/json"} May 03 11:14:41 psradv aziot-keyd[1067]: 2023-05-03T11:14:41Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:42 psradv aziot-edged[1290]: 2023-05-03T11:14:42Z [INFO] - <-- GET /modules/?api-version=2018-06-28 {"host": "unix:///var/run/iotedge/mgmt.sock", "connection": "Close"} May 03 11:14:42 psradv aziot-edged[1290]: 2023-05-03T11:14:42Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:42 psradv aziot-edged[1290]: 2023-05-03T11:14:42Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:14:42 psradv aziot-edged[1290]: 2023-05-03T11:14:42Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:47 psradv aziot-edged[1290]: 2023-05-03T11:14:47Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:14:47 psradv aziot-edged[1290]: 2023-05-03T11:14:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:52 psradv aziot-edged[1290]: 2023-05-03T11:14:52Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:14:52 psradv aziot-edged[1290]: 2023-05-03T11:14:52Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:14:57 psradv aziot-edged[1290]: 2023-05-03T11:14:57Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:14:57 psradv aziot-edged[1290]: 2023-05-03T11:14:57Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:15:02 psradv aziot-edged[1290]: 2023-05-03T11:15:02Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:15:02 psradv aziot-edged[1290]: 2023-05-03T11:15:02Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:15:07 psradv aziot-edged[1290]: 2023-05-03T11:15:07Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:15:07 psradv aziot-edged[1290]: 2023-05-03T11:15:07Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:15:12 psradv aziot-edged[1290]: 2023-05-03T11:15:12Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:15:12 psradv aziot-edged[1290]: 2023-05-03T11:15:12Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:15:17 psradv aziot-edged[1290]: 2023-05-03T11:15:17Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:15:17 psradv aziot-edged[1290]: 2023-05-03T11:15:17Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:15:22 psradv aziot-edged[1290]: 2023-05-03T11:15:22Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:15:22 psradv aziot-edged[1290]: 2023-05-03T11:15:22Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:15:27 psradv aziot-edged[1290]: 2023-05-03T11:15:27Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:15:27 psradv aziot-edged[1290]: 2023-05-03T11:15:27Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:15:30 psradv aziot-edged[1290]: 2023-05-03T11:15:30Z [INFO] - Watchdog checking Edge runtime status May 03 11:15:30 psradv aziot-edged[1290]: 2023-05-03T11:15:30Z [INFO] - Edge runtime is running May 03 11:15:32 psradv aziot-edged[1290]: 2023-05-03T11:15:32Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:15:32 psradv aziot-edged[1290]: 2023-05-03T11:15:32Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:15:37 psradv aziot-edged[1290]: 2023-05-03T11:15:37Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:15:37 psradv aziot-edged[1290]: 2023-05-03T11:15:37Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:15:42 psradv aziot-edged[1290]: 2023-05-03T11:15:42Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:15:42 psradv aziot-edged[1290]: 2023-05-03T11:15:42Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:15:47 psradv aziot-edged[1290]: 2023-05-03T11:15:47Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:15:47 psradv aziot-edged[1290]: 2023-05-03T11:15:47Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:15:52 psradv aziot-edged[1290]: 2023-05-03T11:15:52Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:15:52 psradv aziot-edged[1290]: 2023-05-03T11:15:52Z [INFO] - --> 200 {"content-type": "application/json"} May 03 11:15:57 psradv aziot-edged[1290]: 2023-05-03T11:15:57Z [INFO] - <-- GET /modules?api-version=2022-08-03 {"accept": "application/json", "host": "mgmt.sock:80", "connection": "close"} May 03 11:15:57 psradv aziot-edged[1290]: 2023-05-03T11:15:57Z [INFO] - --> 200 {"content-type": "application/json"}

nlcamp commented 1 year ago

@techipank - Thanks for upgrading to rule out old bugs that have since been fixed.

Can you try the other changes I mentioned in my last comment (copied below for convenience)?

  1. Check if iothub_hostname is missing under the [provisioning] section in your /etc/aziot/config.toml if you are using Manual provisioning with symmetric key or X.509 certificate.
  2. Confirm you've run iotedge config apply after updating /etc/aziot/config.toml with the iothub_hostname parameter
  3. Is it possible your network configuration uses a proxy? See the following doc on how to configure IoT Edge for network proxies if your environment uses one: https://learn.microsoft.com/en-us/azure/iot-edge/how-to-configure-proxy-support?view=iotedge-1.4
techipank commented 1 year ago

HI @nlcamp Please find below

  1. We are using DPS Provisioning with x.509 certificates, and i don't find an entry for iothub_hotname, and it is not manual provisioning.
  2. Yes we did applied iotedge config apply but there is no entry for iothub_hostname.
  3. No we are not behind any proxy although gateway is behind corporate firewall.
nlcamp commented 1 year ago

Hi @techipank - Thanks for the information. I missed that you were using DPS provisioning and not Manual provisioning.

Looking again at the edgeHub logs, I believe the issue may be your firewall blocking outbound traffic over the AMQP port 5671. Can you check your firewall settings and see if is blocking this traffic. Alternatively, you can configure EdgeHub (and EdgeAgent) to use AMQP over websockets by setting their UpstreamProtocol to AMQPWS: https://learn.microsoft.com/en-us/azure/iot-edge/production-checklist?view=iotedge-1.4#choose-upstream-protocol

The following documents have additional information about configuring your firewall for iotedge communication:

  1. https://learn.microsoft.com/en-us/azure/iot-edge/production-checklist?view=iotedge-1.4#allow-connections-from-iot-edge-devices
  2. https://learn.microsoft.com/en-us/azure/iot-edge/troubleshoot?view=iotedge-1.4#check-your-firewall-and-port-configuration-rules
konichi3 commented 1 year ago

@sugato007 Were you able to configure EdgeHub per Noel above?

konichi3 commented 1 year ago

Closing due to lack of activity. @sugato007