search

microsoft / do-client

Delivery Optimization client components
MIT License
24 stars 20 forks source link

DO-Agent uses to mutch RAM #62

Closed Voxel07 closed 2 years ago

Voxel07 commented 3 years ago

When the deployment is restarted after a field installation, the agent sometimes can't download the file and runs out of memory.

This happened before, when the DU-Agent was restarted during the download phase. This was fixed by removing old sandboxes and restarting do-service before starting the new download. The download can now be aborted and restarted as many times as wanted. But if DU-Agent isn't restarted after a failed Download, something goes wrong with DO-Agent

The Problem is, that this isn´t happening all the time. Sometimes the download succeeds many times in a row and then crashes again randomly. If I run top alongside, then there is always memory left.

DU-LOG

root@fsimx8mm:~# su -m adu -c "AducIotAgent -l 0"
2021-08-26T12:53:33.1530Z [I] Agent (linux; 0.7.0-public-preview) starting. [main]
2021-08-26T12:53:33.1531Z [I] Agent built with handlers: fus/fsupdate. [main]
2021-08-26T12:53:33.1550Z [I] Attempting to create connection to IotHub using type: ADUC_ConnType_Device  [ADUC_DeviceClient_Create]
2021-08-26T12:53:33.1551Z [I] Initalizing PnP components. [ADUC_PnP_Components_Create]
2021-08-26T12:53:33.1552Z [I] ADUC agent started. Using IoT Hub Client SDK 1.6.0 [AzureDeviceUpdateCoreInterface_Create]
2021-08-26T12:53:33.1552Z [I] Calling ADUC_Register [ADUC_MethodCall_Register]
2021-08-26T12:53:33.1552Z [I] IoTHub Device Twin callback registered. [ADUC_DeviceClient_Create]
2021-08-26T12:53:33.1562Z [I] Agent running. [main]
2021-08-26T12:53:33.8327Z [D] IotHub connection status: 0, reason:6 [ADUC_ConnectionStatus_Callback]
2021-08-26T12:53:34.2350Z [D] ComponentName:azureDeviceUpdateAgent, propertyName:service [ADUC_PnP_ComponentClient_PropertyUpdate_Callback]
2021-08-26T12:53:34.2352Z [D] OrchestratorUpdateCallback received property JSON string ({"action":0,"updateManifest":"{\"manifestVersion\":\"2.0\",\"updateId\":{\"provider\":\"FuS\",\"name\":\"Firmware\",\"version\":\"1.0\"},\"updateType\":\"fus\/fsupdate:firmware\",\"installedCriteria\":\"20211012\",\"files\":{\"51c625e22164c1c1\":{\"fileName\":\"rauc_update_nand-V20211012.artifact\",\"sizeInBytes\":120944697,\"hashes\":{\"sha256\":\"7fYzv8\/WdIL5hq3S+sXe9YqLRuXGsfTvKngmZLhXgL8=\"}}},\"createdDateTime\":\"2021-08-24T02:46:57Z\"}","updateManifestSignature":"eyJhbGciOiJSUzI1NiIsInNqd2siOiJleUpoYkdjaU9pSlNVekkxTmlJc0ltdHBaQ0k2SWtGRVZTNHlNREEzTURJdVVpSjkuZXlKcmRIa2lPaUpTVTBFaUxDSnVJam9pYkV4bWMwdHZPRmwwWW1Oak1sRXpUalV3VlhSTVNXWlhVVXhXVTBGRlltTm9LMFl2WTJVM1V6Rlpja3BvV0U5VGNucFRaa051VEhCVmFYRlFWSGMwZWxndmRHbEJja0ZGZFhrM1JFRmxWVzVGU0VWamVEZE9hM2QzZVRVdk9IcExaV3AyWTBWWWNFRktMMlV6UWt0SE5FVTBiMjVtU0ZGRmNFOXplSGRQUzBWbFJ6QkhkamwzVjB3emVsUmpUblprUzFoUFJGaEdNMVZRWlVveGIwZGlVRkZ0Y3pKNmJVTktlRUppZEZOSldVbDBiWFpwWTNneVpXdGtWbnBYUm5jdmRrdFVUblZMYXpob2NVczNTRkptYWs5VlMzVkxXSGxqSzNsSVVVa3dZVVpDY2pKNmEyc3plR2d4ZEVWUFN6azRWMHBtZUdKamFsQnpSRTgyWjNwWmVtdFlla05OZW1Fd1R6QkhhV0pDWjB4QlZGUTVUV1k0V1ZCd1dVY3lhblpQWVVSVmIwTlJiakpWWTFWU1RtUnNPR2hLWW5scWJscHZNa3B5SzFVNE5IbDFjVTlyTjBZMFdubFRiMEoyTkdKWVNrZ3lXbEpTV2tab0wzVlRiSE5XT1hkU2JWbG9XWEoyT1RGRVdtbHhhemhJVWpaRVUyeHVabTVsZFRJNFJsUm9SVzF0YjNOVlRUTnJNbGxNYzBKak5FSnZkWEIwTTNsaFNEaFpia3BVTnpSMU16TjFlakU1TDAxNlZIVnFTMmMzVkdGcE1USXJXR0owYmxwRU9XcFVSMkY1U25Sc2FFWmxWeXRJUXpVM1FYUkJSbHBvY1ZsM2VVZHJXQ3M0TTBGaFVGaGFOR0V4VHpoMU1qTk9WVWQxTWtGd04yOU5NVTR3ZVVKS0swbHNUM29pTENKbElqb2lRVkZCUWlJc0ltRnNaeUk2SWxKVE1qVTJJaXdpYTJsa0lqb2lRVVJWTGpJeE1EWXdPUzVTTGxNaWZRLlJLS2VBZE02dGFjdWZpSVU3eTV2S3dsNFpQLURMNnEteHlrTndEdkljZFpIaTBIa2RIZ1V2WnoyZzZCTmpLS21WTU92dXp6TjhEczhybXo1dnMwT1RJN2tYUG1YeDZFLUYyUXVoUXNxT3J5LS1aN2J3TW5LYTNkZk1sbkthWU9PdURtV252RWMyR0hWdVVTSzREbmw0TE9vTTQxOVlMNThWTDAtSEthU18xYmNOUDhXYjVZR08xZXh1RmpiVGtIZkNIU0duVThJeUFjczlGTjhUT3JETHZpVEtwcWtvM3RiSUwxZE1TN3NhLWJkZExUVWp6TnVLTmFpNnpIWTdSanZGbjhjUDN6R2xjQnN1aVQ0XzVVaDZ0M05rZW1UdV9tZjdtZUFLLTBTMTAzMFpSNnNTR281azgtTE1sX0ZaUmh4djNFZFNtR2RBUTNlMDVMRzNnVVAyNzhTQWVzWHhNQUlHWmcxUFE3aEpoZGZHdmVGanJNdkdTSVFEM09wRnEtZHREcEFXbUo2Zm5sZFA1UWxYek5tQkJTMlZRQUtXZU9BYjh0Yjl5aVhsemhtT1dLRjF4SzlseHpYUG9GNmllOFRUWlJ4T0hxTjNiSkVISkVoQmVLclh6YkViV2tFNm4zTEoxbkd5M1htUlVFcER0Umdpa0tBUzZybFhFT0VneXNjIn0.eyJzaGEyNTYiOiJRWi9tTkRwR1FXYkliQy9pbk5jTVM5Z2lQMFVhNCswZnVMdG5zeXhKK0RjPSJ9.TIx2GdQpr118Q7SXtYTUC4OuwxXbJUcFnKpwQ7WdFKbqQL8kFpuapZloqKPVnhBEnzgcWrEjHiwnkbLCM1fekwmpvj5npz9Hmwp6bz1HwKOiyNZtjH2LSi9DuKo2Eux91nRBqbuurl9SU0R_Cyize-sbG-YvmZMv9Yk0ygRqcEEO-oFy-THcavJvVRTPhlJsnvDlrdgle81iezBIlXgQADvR69b04ScmMuHq-Bdsqc42-_hqLT9oTwIRODlOZftL52N2oUsHoo38y7kzwCGAURAXeTsWcV1-5Q9p7ODp1oksmm8tS_4PQ8S7oZHwWj_twq6H4ee6yfk-9vKP-P5oKllxSVMcX7ZrMRD4RB7dq8Osj1fPcUMaHyXV6i6h0ZK8Ee6RsDeoe2On-PLGVA02ynpm2xipOZJ1VgCU2Erl5cOgsWsLaB96hCHJQ6LrnX2_lGdpsS2YM98bnCsjarQ8PCWK6mFJhafkYvaVkvHBkdg-eKsYqgaKxJbc3m1M2diY","fileUrls":{"51c625e22164c1c1":"http:\/\/deviceupdateinsta [OrchestratorUpdateCallback]
2021-08-26T12:53:34.2374Z [I] Perform startup tasks. [ADUC_Workflow_HandleStartupWorkflowData]
2021-08-26T12:53:34.2374Z [I] Calling IsInstalledCallback to check if content is installed. [ADUC_MethodCall_IsInstalled]
2021-08-26T12:53:34.2374Z [I] IsInstalledCallback called [IsInstalledCallback]
2021-08-26T12:53:34.2374Z [I] IsInstalled called workflowId: , installed criteria: 20211012 [IsInstalled]
2021-08-26T12:53:34.2375Z [I] fsupdate_handler_create-called. [fus_fsupdate_CreateFunc]
2021-08-26T12:53:34.2453Z [I] Installed criteria 20211012 was not installed, the current version is 20211013 [IsInstalled]
2021-08-26T12:53:34.2454Z [I] Calling GetUpdateRebootStateCallback [ADUC_MethodCall_GetUpdateRebootState]
2021-08-26T12:53:34.2454Z [I] GetUpdateRebootStateCallback called [GetUpdateRebootStateCallback]
2021-08-26T12:53:34.2454Z [I] GetUpdateRebootState called [GetUpdateRebootState]
2021-08-26T12:53:34.2454Z [I] GetUpdateRebootState [GetUpdateRebootState]
2021-08-26T12:53:34.2455Z [I] Starting FS-Updater [ADUC_LaunchChildProcess]
2021-08-26T12:53:34.5959Z [I] Arg 0 = -urs [ADUC_LaunchChildProcess]
No update reboot pending
2021-08-26T12:53:38.4033Z [I] Child process terminated normally, signal 0 [ADUC_LaunchChildProcess]
2021-08-26T12:53:38.4035Z [I] FS-Update returned NO_UPDATE_REBOOT_PENDING [GetUpdateRebootState]
2021-08-26T12:53:38.4035Z [I] Update was not installed [ADUC_Workflow_HandleStartupWorkflowData]
2021-08-26T12:53:38.4035Z [I] There's a pending 'download' action request. [ADUC_Workflow_HandleStartupWorkflowData]
2021-08-26T12:53:38.4035Z [I] Calling IsInstalledCallback to check if content is installed. [ADUC_MethodCall_IsInstalled]
2021-08-26T12:53:38.4035Z [I] IsInstalledCallback called [IsInstalledCallback]
2021-08-26T12:53:38.4036Z [I] IsInstalled called workflowId: , installed criteria: 20211012 [IsInstalled]
2021-08-26T12:53:38.4037Z [I] Installed criteria 20211012 was not installed, the current version is 20211013 [IsInstalled]
2021-08-26T12:53:38.4037Z [I] Processing 'Download' action [ADUC_Workflow_HandleUpdateAction]
2021-08-26T12:53:38.4037Z [I] Start the workflow - downloading, with WorkflowId 210826125338 [ADUC_Workflow_HandleUpdateAction]
2021-08-26T12:53:38.4038Z [I] UpdateAction: Prepare - calling PrepareCallback [ADUC_MethodCall_Prepare]
2021-08-26T12:53:38.4038Z [I] PrepareCallback called [PrepareCallback]
2021-08-26T12:53:38.4039Z [I] {210826125338} Received Metadata, UpdateType: fus/fsupdate:firmware, UpdateTypeName: fus/fsupdate, UpdateTypeVersion: firmware, FileCount: 1 [Prepare]
2021-08-26T12:53:38.4039Z [I] fsupdate_handler_create-called. [fus_fsupdate_CreateFunc]
2021-08-26T12:53:38.4039Z [I] Prepare succeeded. [Prepare]
2021-08-26T12:53:38.4039Z [I] UpdateAction: Download [ADUC_MethodCall_Download]
2021-08-26T12:53:38.4039Z [I] Calling SandboxCreateCallback [ADUC_MethodCall_Download]
2021-08-26T12:53:38.4040Z [I] Starting Child Process [ADUC_LaunchChildProcess]
2021-08-26T12:53:38.4040Z [I] Arg 0 = stop [ADUC_LaunchChildProcess]
2021-08-26T12:53:38.4040Z [I] Arg 1 = deliveryoptimization-agent.service [ADUC_LaunchChildProcess]
2021-08-26T12:53:38.4307Z [I] Child process terminated normally, signal 0 [ADUC_LaunchChildProcess]
2021-08-26T12:53:38.4310Z [I] Starting Child Process [ADUC_LaunchChildProcess]
2021-08-26T12:53:38.4310Z [I] Arg 0 = start [ADUC_LaunchChildProcess]
2021-08-26T12:53:38.4311Z [I] Arg 1 = deliveryoptimization-agent.service [ADUC_LaunchChildProcess]
2021-08-26T12:53:38.4529Z [I] Child process terminated normally, signal 0 [ADUC_LaunchChildProcess]
2021-08-26T12:53:38.4531Z [I] Setting sandbox /tmp/aduc-dl-210826125338 [SandboxCreate]
2021-08-26T12:53:38.4532Z [I] Using sandbox /tmp/aduc-dl-210826125338 [ADUC_MethodCall_Download]
2021-08-26T12:53:38.4532Z [I] Setting UpdateState to DownloadStarted [ADUC_SetUpdateStateHelper]
2021-08-26T12:53:38.4533Z [I] Calling DownloadCallback [ADUC_MethodCall_Download]
2021-08-26T12:53:38.4533Z [I] Download thread started [DownloadCallback]
2021-08-26T12:53:38.4535Z [I] OrchestratorPropertyUpdateCallback ended [OrchestratorUpdateCallback]
2021-08-26T12:53:38.4536Z [I] Processing existing Device Twin data after agent started. [ADUC_PnPDeviceTwin_Callback]
2021-08-26T12:53:38.4536Z [D] Notifies components that all callback are subscribed. [ADUC_PnPDeviceTwin_Callback]
2021-08-26T12:53:38.4536Z [I] DeviceInformation component is ready - reporting properties [DeviceInfoInterface_Connected]
2021-08-26T12:53:38.4537Z [I] Property manufacturer changed to FUS [RefreshDeviceInfoInterfaceData]
2021-08-26T12:53:38.4538Z [I] Property model changed to IMX8MM [RefreshDeviceInfoInterfaceData]
2021-08-26T12:53:38.4538Z [I] Property osName changed to Linux [RefreshDeviceInfoInterfaceData]
2021-08-26T12:53:38.4538Z [I] Property swVersion changed to 5.4.70-F+S [RefreshDeviceInfoInterfaceData]
2021-08-26T12:53:38.4538Z [I] Property processorArchitecture changed to aarch64 [RefreshDeviceInfoInterfaceData]
2021-08-26T12:53:38.4540Z [D] Downloading 1 files to /tmp/aduc-dl-210826125338 [Download]
2021-08-26T12:53:38.4548Z [I] Downloading File 'rauc_update_nand-V20211012.artifact' from 'http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact' to '/tmp/aduc-dl-210826125338/rauc_update_nand-V20211012.artifact' [Download]
sh: /usr/bin/lscpu: No such file or directory
2021-08-26T12:53:38.4573Z [I] Property totalMemory changed to 1006292 [RefreshDeviceInfoInterfaceData]
2021-08-26T12:53:38.4574Z [I] Property totalStorage changed to 108160 [RefreshDeviceInfoInterfaceData]
2021-08-26T12:53:52.8065Z [I] Validating file hash [Download]
2021-08-26T12:53:56.1579Z [I] fsupdate_handler_create-called. [fus_fsupdate_CreateFunc]
2021-08-26T12:53:56.1580Z [I] Download called - no-op for fsupdate [Download]
2021-08-26T12:53:56.1580Z [I] Content Handler Download resultCode: 1, extendedCode: 0 [Download]
2021-08-26T12:53:56.1581Z [I] ProgressCallback: workflowId: 210826125338; Id 51c625e22164c1c1; State: Completed; Bytes: 120944697/120944697 [DownloadProgressCallback]
2021-08-26T12:53:56.1581Z [I] Download resultCode: 1, extendedCode: 0 [Download]
2021-08-26T12:53:56.1581Z [I] Action 'Download' complete. Result: 1, 0 [ADUC_Workflow_WorkCompletionCallback]
2021-08-26T12:53:56.1581Z [I] WorkCompletionCallback: Download succeeded. Going to state DownloadSucceeded [ADUC_Workflow_WorkCompletionCallback]
2021-08-26T12:53:56.1581Z [I] Setting UpdateState to DownloadSucceeded [ADUC_SetUpdateStateHelper]
2021-08-26T12:53:56.1581Z [I] Reporting state: DownloadSucceeded (2) [AzureDeviceUpdateCoreInterface_ReportStateAndResultAsync]
2021-08-26T12:54:05.1619Z [D] ComponentName:azureDeviceUpdateAgent, propertyName:service [ADUC_PnP_ComponentClient_PropertyUpdate_Callback]
2021-08-26T12:54:05.1622Z [D] OrchestratorUpdateCallback received property JSON string ({"action":1,"updateManifest":"{\"manifestVersion\":\"2.0\",\"updateId\":{\"provider\":\"FuS\",\"name\":\"Firmware\",\"version\":\"1.0\"},\"updateType\":\"fus\/fsupdate:firmware\",\"installedCriteria\":\"20211012\",\"files\":{\"51c625e22164c1c1\":{\"fileName\":\"rauc_update_nand-V20211012.artifact\",\"sizeInBytes\":120944697,\"hashes\":{\"sha256\":\"7fYzv8\/WdIL5hq3S+sXe9YqLRuXGsfTvKngmZLhXgL8=\"}}},\"createdDateTime\":\"2021-08-24T02:46:57Z\"}","updateManifestSignature":"eyJhbGciOiJSUzI1NiIsInNqd2siOiJleUpoYkdjaU9pSlNVekkxTmlJc0ltdHBaQ0k2SWtGRVZTNHlNREEzTURJdVVpSjkuZXlKcmRIa2lPaUpTVTBFaUxDSnVJam9pYkV4bWMwdHZPRmwwWW1Oak1sRXpUalV3VlhSTVNXWlhVVXhXVTBGRlltTm9LMFl2WTJVM1V6Rlpja3BvV0U5VGNucFRaa051VEhCVmFYRlFWSGMwZWxndmRHbEJja0ZGZFhrM1JFRmxWVzVGU0VWamVEZE9hM2QzZVRVdk9IcExaV3AyWTBWWWNFRktMMlV6UWt0SE5FVTBiMjVtU0ZGRmNFOXplSGRQUzBWbFJ6QkhkamwzVjB3emVsUmpUblprUzFoUFJGaEdNMVZRWlVveGIwZGlVRkZ0Y3pKNmJVTktlRUppZEZOSldVbDBiWFpwWTNneVpXdGtWbnBYUm5jdmRrdFVUblZMYXpob2NVczNTRkptYWs5VlMzVkxXSGxqSzNsSVVVa3dZVVpDY2pKNmEyc3plR2d4ZEVWUFN6azRWMHBtZUdKamFsQnpSRTgyWjNwWmVtdFlla05OZW1Fd1R6QkhhV0pDWjB4QlZGUTVUV1k0V1ZCd1dVY3lhblpQWVVSVmIwTlJiakpWWTFWU1RtUnNPR2hLWW5scWJscHZNa3B5SzFVNE5IbDFjVTlyTjBZMFdubFRiMEoyTkdKWVNrZ3lXbEpTV2tab0wzVlRiSE5XT1hkU2JWbG9XWEoyT1RGRVdtbHhhemhJVWpaRVUyeHVabTVsZFRJNFJsUm9SVzF0YjNOVlRUTnJNbGxNYzBKak5FSnZkWEIwTTNsaFNEaFpia3BVTnpSMU16TjFlakU1TDAxNlZIVnFTMmMzVkdGcE1USXJXR0owYmxwRU9XcFVSMkY1U25Sc2FFWmxWeXRJUXpVM1FYUkJSbHBvY1ZsM2VVZHJXQ3M0TTBGaFVGaGFOR0V4VHpoMU1qTk9WVWQxTWtGd04yOU5NVTR3ZVVKS0swbHNUM29pTENKbElqb2lRVkZCUWlJc0ltRnNaeUk2SWxKVE1qVTJJaXdpYTJsa0lqb2lRVVJWTGpJeE1EWXdPUzVTTGxNaWZRLlJLS2VBZE02dGFjdWZpSVU3eTV2S3dsNFpQLURMNnEteHlrTndEdkljZFpIaTBIa2RIZ1V2WnoyZzZCTmpLS21WTU92dXp6TjhEczhybXo1dnMwT1RJN2tYUG1YeDZFLUYyUXVoUXNxT3J5LS1aN2J3TW5LYTNkZk1sbkthWU9PdURtV252RWMyR0hWdVVTSzREbmw0TE9vTTQxOVlMNThWTDAtSEthU18xYmNOUDhXYjVZR08xZXh1RmpiVGtIZkNIU0duVThJeUFjczlGTjhUT3JETHZpVEtwcWtvM3RiSUwxZE1TN3NhLWJkZExUVWp6TnVLTmFpNnpIWTdSanZGbjhjUDN6R2xjQnN1aVQ0XzVVaDZ0M05rZW1UdV9tZjdtZUFLLTBTMTAzMFpSNnNTR281azgtTE1sX0ZaUmh4djNFZFNtR2RBUTNlMDVMRzNnVVAyNzhTQWVzWHhNQUlHWmcxUFE3aEpoZGZHdmVGanJNdkdTSVFEM09wRnEtZHREcEFXbUo2Zm5sZFA1UWxYek5tQkJTMlZRQUtXZU9BYjh0Yjl5aVhsemhtT1dLRjF4SzlseHpYUG9GNmllOFRUWlJ4T0hxTjNiSkVISkVoQmVLclh6YkViV2tFNm4zTEoxbkd5M1htUlVFcER0Umdpa0tBUzZybFhFT0VneXNjIn0.eyJzaGEyNTYiOiJRWi9tTkRwR1FXYkliQy9pbk5jTVM5Z2lQMFVhNCswZnVMdG5zeXhKK0RjPSJ9.TIx2GdQpr118Q7SXtYTUC4OuwxXbJUcFnKpwQ7WdFKbqQL8kFpuapZloqKPVnhBEnzgcWrEjHiwnkbLCM1fekwmpvj5npz9Hmwp6bz1HwKOiyNZtjH2LSi9DuKo2Eux91nRBqbuurl9SU0R_Cyize-sbG-YvmZMv9Yk0ygRqcEEO-oFy-THcavJvVRTPhlJsnvDlrdgle81iezBIlXgQADvR69b04ScmMuHq-Bdsqc42-_hqLT9oTwIRODlOZftL52N2oUsHoo38y7kzwCGAURAXeTsWcV1-5Q9p7ODp1oksmm8tS_4PQ8S7oZHwWj_twq6H4ee6yfk-9vKP-P5oKllxSVMcX7ZrMRD4RB7dq8Osj1fPcUMaHyXV6i6h0ZK8Ee6RsDeoe2On-PLGVA02ynpm2xipOZJ1VgCU2Erl5cOgsWsLaB96hCHJQ6LrnX2_lGdpsS2YM98bnCsjarQ8PCWK6mFJhafkYvaVkvHBkdg-eKsYqgaKxJbc3m1M2diY","fileUrls":null}), property version (703) [OrchestratorUpdateCallback]
2021-08-26T12:54:05.1644Z [I] Processing 'Install' action [ADUC_Workflow_HandleUpdateAction]
2021-08-26T12:54:05.1644Z [I] UpdateAction: Install [ADUC_MethodCall_Install]
2021-08-26T12:54:05.1644Z [I] Setting UpdateState to InstallStarted [ADUC_SetUpdateStateHelper]
2021-08-26T12:54:05.1644Z [I] Calling InstallCallback [ADUC_MethodCall_Install]
2021-08-26T12:54:05.1644Z [I] Install thread started [InstallCallback]
2021-08-26T12:54:05.1647Z [I] OrchestratorPropertyUpdateCallback ended [OrchestratorUpdateCallback]
2021-08-26T12:54:05.1649Z [I] Installing from /tmp/aduc-dl-210826125338 [Install]
2021-08-26T12:54:05.1650Z [I] Installing image file: 'rauc_update_nand-V20211012.artifact' type: 'firmware' [Install]
///
Failing Update on purpose
///
2021-08-26T12:55:15.8479Z [I] Child process terminated normally, signal 1 [ADUC_LaunchChildProcess]
2021-08-26T12:55:15.8595Z [E] Install failed, extendedResultCode = 1 [Install]
2021-08-26T12:55:15.8747Z [I] Action 'Install' complete. Result: 0, 1 [ADUC_Workflow_WorkCompletionCallback]
2021-08-26T12:55:15.8748Z [E] Install failed. error 0, 1 - Expecting service to send Cancel action [ADUC_Workflow_WorkCompletionCallback]
2021-08-26T12:55:15.8748Z [I] Setting UpdateState to Failed [ADUC_SetUpdateStateHelper]
2021-08-26T12:55:15.8749Z [I] Reporting state: 255, Failed (255); HTTP 500; result 0, 1 [AzureDeviceUpdateCoreInterface_ReportStateAndResultAsync]
2021-08-26T12:55:15.8750Z [I] Calling SandboxDestroyCallback [ADUC_MethodCall_Idle]
2021-08-26T12:55:15.8750Z [I] Destroying sandbox /tmp/aduc-dl-210826125338. workflowId: 210826125338 [SandboxDestroy]
2021-08-26T12:55:15.8752Z [I] UpdateAction: Idle. Ending workflow with WorkflowId: 210826125338 [ADUC_MethodCall_Idle]
2021-08-26T12:55:15.8752Z [W] Idle UpdateAction called in unexpected state: InstallStarted! [ADUC_MethodCall_Idle]
2021-08-26T12:55:15.8752Z [I] Calling IdleCallback [ADUC_MethodCall_Idle]
2021-08-26T12:55:15.8753Z [I] Now idle. workflowId:  [Idle]
2021-08-26T12:55:15.8753Z [I] Setting UpdateState to Idle [ADUC_SetUpdateStateHelper]
2021-08-26T12:55:15.8753Z [I] Reporting state: 0, Idle (0); HTTP 200; result 1, 0 [AzureDeviceUpdateCoreInterface_ReportStateAndResultAsync]
2021-08-26T12:55:15.8753Z [I] UpdateAction: Idle. WorkFolder not set. -> SandboxDestroy was not called [ADUC_MethodCall_Idle]
2021-08-26T12:55:15.8754Z [I] Calling IdleCallback [ADUC_MethodCall_Idle]
2021-08-26T12:55:15.8754Z [I] Now idle. workflowId:  [Idle]

////
Restarting failed devices in Iot-Hub
///

 2021-08-26T12:56:16.7908Z [D] ComponentName:azureDeviceUpdateAgent, propertyName:service [ADUC_PnP_ComponentClient_PropertyUpdate_Callback]
2021-08-26T12:56:16.7911Z [D] OrchestratorUpdateCallback received property JSON string ({"action":0,"updateManifest":"{\"manifestVersion\":\"2.0\",\"updateId\":{\"provider\":\"FuS\",\"name\":\"Firmware\",\"version\":\"1.0\"},\"updateType\":\"fus\/fsupdate:firmware\",\"installedCriteria\":\"20211012\",\"files\":{\"51c625e22164c1c1\":{\"fileName\":\"rauc_update_nand-V20211012.artifact\",\"sizeInBytes\":120944697,\"hashes\":{\"sha256\":\"7fYzv8\/WdIL5hq3S+sXe9YqLRuXGsfTvKngmZLhXgL8=\"}}},\"createdDateTime\":\"2021-08-24T02:46:57Z\"}","updateManifestSignature":"eyJhbGciOiJSUzI1NiIsInNqd2siOiJleUpoYkdjaU9pSlNVekkxTmlJc0ltdHBaQ0k2SWtGRVZTNHlNREEzTURJdVVpSjkuZXlKcmRIa2lPaUpTVTBFaUxDSnVJam9pYkV4bWMwdHZPRmwwWW1Oak1sRXpUalV3VlhSTVNXWlhVVXhXVTBGRlltTm9LMFl2WTJVM1V6Rlpja3BvV0U5VGNucFRaa051VEhCVmFYRlFWSGMwZWxndmRHbEJja0ZGZFhrM1JFRmxWVzVGU0VWamVEZE9hM2QzZVRVdk9IcExaV3AyWTBWWWNFRktMMlV6UWt0SE5FVTBiMjVtU0ZGRmNFOXplSGRQUzBWbFJ6QkhkamwzVjB3emVsUmpUblprUzFoUFJGaEdNMVZRWlVveGIwZGlVRkZ0Y3pKNmJVTktlRUppZEZOSldVbDBiWFpwWTNneVpXdGtWbnBYUm5jdmRrdFVUblZMYXpob2NVczNTRkptYWs5VlMzVkxXSGxqSzNsSVVVa3dZVVpDY2pKNmEyc3plR2d4ZEVWUFN6azRWMHBtZUdKamFsQnpSRTgyWjNwWmVtdFlla05OZW1Fd1R6QkhhV0pDWjB4QlZGUTVUV1k0V1ZCd1dVY3lhblpQWVVSVmIwTlJiakpWWTFWU1RtUnNPR2hLWW5scWJscHZNa3B5SzFVNE5IbDFjVTlyTjBZMFdubFRiMEoyTkdKWVNrZ3lXbEpTV2tab0wzVlRiSE5XT1hkU2JWbG9XWEoyT1RGRVdtbHhhemhJVWpaRVUyeHVabTVsZFRJNFJsUm9SVzF0YjNOVlRUTnJNbGxNYzBKak5FSnZkWEIwTTNsaFNEaFpia3BVTnpSMU16TjFlakU1TDAxNlZIVnFTMmMzVkdGcE1USXJXR0owYmxwRU9XcFVSMkY1U25Sc2FFWmxWeXRJUXpVM1FYUkJSbHBvY1ZsM2VVZHJXQ3M0TTBGaFVGaGFOR0V4VHpoMU1qTk9WVWQxTWtGd04yOU5NVTR3ZVVKS0swbHNUM29pTENKbElqb2lRVkZCUWlJc0ltRnNaeUk2SWxKVE1qVTJJaXdpYTJsa0lqb2lRVVJWTGpJeE1EWXdPUzVTTGxNaWZRLlJLS2VBZE02dGFjdWZpSVU3eTV2S3dsNFpQLURMNnEteHlrTndEdkljZFpIaTBIa2RIZ1V2WnoyZzZCTmpLS21WTU92dXp6TjhEczhybXo1dnMwT1RJN2tYUG1YeDZFLUYyUXVoUXNxT3J5LS1aN2J3TW5LYTNkZk1sbkthWU9PdURtV252RWMyR0hWdVVTSzREbmw0TE9vTTQxOVlMNThWTDAtSEthU18xYmNOUDhXYjVZR08xZXh1RmpiVGtIZkNIU0duVThJeUFjczlGTjhUT3JETHZpVEtwcWtvM3RiSUwxZE1TN3NhLWJkZExUVWp6TnVLTmFpNnpIWTdSanZGbjhjUDN6R2xjQnN1aVQ0XzVVaDZ0M05rZW1UdV9tZjdtZUFLLTBTMTAzMFpSNnNTR281azgtTE1sX0ZaUmh4djNFZFNtR2RBUTNlMDVMRzNnVVAyNzhTQWVzWHhNQUlHWmcxUFE3aEpoZGZHdmVGanJNdkdTSVFEM09wRnEtZHREcEFXbUo2Zm5sZFA1UWxYek5tQkJTMlZRQUtXZU9BYjh0Yjl5aVhsemhtT1dLRjF4SzlseHpYUG9GNmllOFRUWlJ4T0hxTjNiSkVISkVoQmVLclh6YkViV2tFNm4zTEoxbkd5M1htUlVFcER0Umdpa0tBUzZybFhFT0VneXNjIn0.eyJzaGEyNTYiOiJRWi9tTkRwR1FXYkliQy9pbk5jTVM5Z2lQMFVhNCswZnVMdG5zeXhKK0RjPSJ9.TIx2GdQpr118Q7SXtYTUC4OuwxXbJUcFnKpwQ7WdFKbqQL8kFpuapZloqKPVnhBEnzgcWrEjHiwnkbLCM1fekwmpvj5npz9Hmwp6bz1HwKOiyNZtjH2LSi9DuKo2Eux91nRBqbuurl9SU0R_Cyize-sbG-YvmZMv9Yk0ygRqcEEO-oFy-THcavJvVRTPhlJsnvDlrdgle81iezBIlXgQADvR69b04ScmMuHq-Bdsqc42-_hqLT9oTwIRODlOZftL52N2oUsHoo38y7kzwCGAURAXeTsWcV1-5Q9p7ODp1oksmm8tS_4PQ8S7oZHwWj_twq6H4ee6yfk-9vKP-P5oKllxSVMcX7ZrMRD4RB7dq8Osj1fPcUMaHyXV6i6h0ZK8Ee6RsDeoe2On-PLGVA02ynpm2xipOZJ1VgCU2Erl5cOgsWsLaB96hCHJQ6LrnX2_lGdpsS2YM98bnCsjarQ8PCWK6mFJhafkYvaVkvHBkdg-eKsYqgaKxJbc3m1M2diY","fileUrls":{"51c625e22164c1c1":"http:\/\/deviceupdateinsta [OrchestratorUpdateCallback]
2021-08-26T12:56:16.8117Z [I] Calling IsInstalledCallback to check if content is installed. [ADUC_MethodCall_IsInstalled]
2021-08-26T12:56:16.8117Z [I] IsInstalledCallback called [IsInstalledCallback]
2021-08-26T12:56:16.8118Z [I] IsInstalled called workflowId: , installed criteria: 20211012 [IsInstalled]
2021-08-26T12:56:16.8980Z [I] Installed criteria 20211012 was not installed, the current version is 20211013 [IsInstalled]
2021-08-26T12:56:16.8981Z [I] Processing 'Download' action [ADUC_Workflow_HandleUpdateAction]
2021-08-26T12:56:16.8981Z [I] Start the workflow - downloading, with WorkflowId 210826125616 [ADUC_Workflow_HandleUpdateAction]
2021-08-26T12:56:16.8981Z [I] UpdateAction: Prepare - calling PrepareCallback [ADUC_MethodCall_Prepare]
2021-08-26T12:56:16.8982Z [I] PrepareCallback called [PrepareCallback]
2021-08-26T12:56:16.8982Z [I] {210826125616} Received Metadata, UpdateType: fus/fsupdate:firmware, UpdateTypeName: fus/fsupdate, UpdateTypeVersion: firmware, FileCount: 1 [Prepare]
2021-08-26T12:56:16.8983Z [I] fsupdate_handler_create-called. [fus_fsupdate_CreateFunc]
2021-08-26T12:56:16.8983Z [I] Prepare succeeded. [Prepare]
2021-08-26T12:56:16.8983Z [I] UpdateAction: Download [ADUC_MethodCall_Download]
2021-08-26T12:56:16.8984Z [I] Calling SandboxCreateCallback [ADUC_MethodCall_Download]
2021-08-26T12:56:16.8984Z [I] Starting Child Process [ADUC_LaunchChildProcess]
2021-08-26T12:56:16.8984Z [I] Arg 0 = stop [ADUC_LaunchChildProcess]
2021-08-26T12:56:16.8985Z [I] Arg 1 = deliveryoptimization-agent.service [ADUC_LaunchChildProcess]
2021-08-26T12:56:17.3684Z [I] Child process terminated normally, signal 0 [ADUC_LaunchChildProcess]
2021-08-26T12:56:17.3688Z [I] Starting Child Process [ADUC_LaunchChildProcess]
2021-08-26T12:56:17.3688Z [I] Arg 0 = start [ADUC_LaunchChildProcess]
2021-08-26T12:56:17.3688Z [I] Arg 1 = deliveryoptimization-agent.service [ADUC_LaunchChildProcess]
2021-08-26T12:56:17.3917Z [I] Child process terminated normally, signal 0 [ADUC_LaunchChildProcess]
2021-08-26T12:56:17.3919Z [I] Setting sandbox /tmp/aduc-dl-210826125616 [SandboxCreate]
2021-08-26T12:56:17.3920Z [I] Using sandbox /tmp/aduc-dl-210826125616 [ADUC_MethodCall_Download]
2021-08-26T12:56:17.3920Z [I] Setting UpdateState to DownloadStarted [ADUC_SetUpdateStateHelper]
2021-08-26T12:56:17.3921Z [I] Calling DownloadCallback [ADUC_MethodCall_Download]
2021-08-26T12:56:17.3921Z [I] Download thread started [DownloadCallback]
2021-08-26T12:56:17.3924Z [I] OrchestratorPropertyUpdateCallback ended [OrchestratorUpdateCallback]
2021-08-26T12:56:17.3925Z [D] Downloading 1 files to /tmp/aduc-dl-210826125616 [Download]
2021-08-26T12:56:17.3925Z [I] Downloading File 'rauc_update_nand-V20211012.artifact' from 'http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact' to '/tmp/aduc-dl-210826125616/rauc_update_nand-V20211012.artifact' [Download]
kthreadd invoked oom-killer: gfp_mask=0x2dc2(GFP_KERNEL|__GFP_HIGHMEM|__GFP_NOWARN|__GFP_ZERO), order=0, oom_score_adj=0
CPU: 2 PID: 2 Comm: kthreadd Not tainted 5.4.70-F+S #1
Hardware name: F&S PicoCoreMX8MM (DT)
Call trace:
 dump_backtrace+0x0/0x140
 show_stack+0x14/0x20
 dump_stack+0xb4/0x114
 dump_header+0x44/0x1ec
 oom_kill_process+0x1d4/0x1d8
 out_of_memory+0x170/0x4e0
 __alloc_pages_slowpath+0x954/0x9f8
 __alloc_pages_nodemask+0x21c/0x280
 __vmalloc_node_range+0xfc/0x348
 copy_process+0x420/0x14a0
 _do_fork+0x7c/0x328
 kernel_thread+0x58/0x78
 kthreadd+0x160/0x2f0
 ret_from_fork+0x10/0x1c
Mem-Info:
active_anon:6420 inactive_anon:57403 isolated_anon:0
 active_file:104 inactive_file:156 isolated_file:0
 unevictable:2 dirty:0 writeback:0 unstable:0
 slab_reclaimable:3981 slab_unreclaimable:8321
 mapped:337 shmem:57404 pagetables:272 bounce:0
 free:136156 free_pcp:64 free_cma:130930
Node 0 active_anon:25680kB inactive_anon:229612kB active_file:372kB inactive_file:516kB unevictable:8kB isolated(anon):0kB isolated(file):0kB mapped:1348kB dirty:0kB writeback:0kB shmem:229616kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 4096kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
Node 0 DMA32 free:544044kB min:22528kB low:28160kB high:33792kB active_anon:25680kB inactive_anon:229612kB active_file:148kB inactive_file:188kB unevictable:8kB writepending:0kB present:1048576kB managed:1006292kB mlocked:0kB kernel_stack:2880kB pagetables:1088kB bounce:0kB free_pcp:468kB local_pcp:0kB free_cma:523720kB
lowmem_reserve[]: 0 0 0
Node 0 DMA32: 235*4kB (UME) 574*8kB (UMEC) 122*16kB (UME) 45*32kB (MEC) 17*64kB (ME) 9*128kB (MEC) 4*256kB (MEC) 2*512kB (UE) 2*1024kB (UC) 2*2048kB (MC) 128*4096kB (MC) = 543644kB
Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=32768kB
Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=64kB
57670 total pagecache pages
0 pages in swap cache
Swap cache stats: add 0, delete 0, find 0/0
Free swap  = 0kB
Total swap = 0kB
262144 pages RAM
0 pages HighMem/MovableOnly
10571 pages reserved
163840 pages cma reserved
0 pages hwpoisoned
Tasks state (memory values in pages):
[  pid  ]   uid  tgid total_vm      rss pgtables_bytes swapents oom_score_adj name
[    250]     0   250     4454      419    69632        0          -250 systemd-journal
[    267]     0   267     3257      282    49152        0         -1000 systemd-udevd
[    295]   994   295     4079      126    57344        0             0 systemd-network
[    307]   992   307    20408      618    65536        0             0 systemd-timesyn
[    320]   993   320     1926       99    53248        0             0 systemd-resolve
[    350]   998   350     1210       78    49152        0             0 avahi-daemon
[    351]     0   351      799       29    40960        0             0 klogd
[    352]   998   352     1178       62    49152        0             0 avahi-daemon
[    353]     0   353      799       20    49152        0             0 syslogd
[    354]   997   354     1123      129    49152        0          -900 dbus-daemon
[    356]     0   356     2149      177    61440        0             0 ofonod
[    365]     0   365     1924      116    57344        0             0 systemd-logind
[    366]     0   366     1140      100    49152        0             0 login
[    367]     0   367     1252       26    49152        0             0 agetty
[    412]     0   412     2329      253    57344        0             0 systemd
[    413]     0   413     2830      445    53248        0             0 (sd-pam)
[    420]     0   420      913      116    49152        0             0 sh
[    424]     0   424     1003       75    49152        0             0 su
[    425]   800   425    25218      400    86016        0             0 AducIotAgent
[    485]     0   485    78019      883    94208        0             0 rauc
[    568]   801   568   597743     1322   438272        0             0 deliveryoptimiz
oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/system.slice/deliveryoptimization-agent.service,task=deliveryoptimiz,pid=568,uid=801
Out of memory: Killed process 568 (deliveryoptimiz) total-vm:2390972kB, anon-rss:5288kB, file-rss:0kB, shmem-rss:0kB, UID:801 pgtables:428kB oom_score_adj:0
oom_reaper: reaped process 568 (deliveryoptimiz), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
2021-08-26T12:56:30.4754Z [I] Caught DO exception, msg: unrecognized error, code: -2133848063 [Download]
2021-08-26T12:56:30.4755Z [I] ProgressCallback: workflowId: 210826125616; Id 51c625e22164c1c1; State: Error; Bytes: 104857600/104857600 [DownloadProgressCallback]
2021-08-26T12:56:30.4755Z [I] Download resultCode: 0, extendedCode: -791670783 [Download]
2021-08-26T12:56:30.4755Z [I] Action 'Download' complete. Result: 0, -791670783 [ADUC_Workflow_WorkCompletionCallback]
2021-08-26T12:56:30.4756Z [E] Download failed. error 0, -791670783 - Expecting service to send Cancel action [ADUC_Workflow_WorkCompletionCallback]
2021-08-26T12:56:30.4756Z [I] Setting UpdateState to Failed [ADUC_SetUpdateStateHelper]
2021-08-26T12:56:30.4756Z [I] Reporting state: 255, Failed (255); HTTP 500; result 0, -791670783 [AzureDeviceUpdateCoreInterface_ReportStateAndResultAsync]
2021-08-26T12:56:30.4757Z [I] Calling SandboxDestroyCallback [ADUC_MethodCall_Idle]
2021-08-26T12:56:30.4757Z [I] Destroying sandbox /tmp/aduc-dl-210826125616. workflowId: 210826125616 [SandboxDestroy]
2021-08-26T12:56:30.5144Z [I] UpdateAction: Idle. Ending workflow with WorkflowId: 210826125616 [ADUC_MethodCall_Idle]
2021-08-26T12:56:30.5145Z [W] Idle UpdateAction called in unexpected state: DownloadStarted! [ADUC_MethodCall_Idle]
2021-08-26T12:56:30.5145Z [I] Calling IdleCallback [ADUC_MethodCall_Idle]
2021-08-26T12:56:30.5145Z [I] Now idle. workflowId:  [Idle]
2021-08-26T12:56:30.5145Z [I] Setting UpdateState to Idle [ADUC_SetUpdateStateHelper]
2021-08-26T12:56:30.5145Z [I] Reporting state: 0, Idle (0); HTTP 200; result 1, 0 [AzureDeviceUpdateCoreInterface_ReportStateAndResultAsync]
2021-08-26T12:56:30.5146Z [I] UpdateAction: Idle. WorkFolder not set. -> SandboxDestroy was not called [ADUC_MethodCall_Idle]
2021-08-26T12:56:30.5146Z [W] Idle UpdateAction called in unexpected state: DownloadStarted! [ADUC_MethodCall_Idle]
2021-08-26T12:56:30.5147Z [I] Calling IdleCallback [ADUC_MethodCall_Idle]
2021-08-26T12:56:30.5147Z [I] Now idle. workflowId:  [Idle]

DO-LOG

root@fsimx8mm:/etc/deliveryoptimization-agent# cat /adu/logs/doFail.log
2021-08-26T12:03:16.6683747Z 1181  1181  info     {Run} Started, DU;deliveryoptimization-agent/v0.5.0+20210823.105429
2021-08-26T12:03:16.7551667Z 1181  1189  info     {_TryRefresh} Read json config file /etc/deliveryoptimization-agent/admin-config.json
2021-08-26T12:03:16.7555715Z 1181  1189  info     {Download} 6b0b97dd-e372-4142-bc83-2fd238398644, new download, url: http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact, dest: /tmp/aduc-dl-210826120315/rauc_update_nand-V20211012.artifact
2021-08-26T12:03:16.7556154Z 1181  1189  info     {GetProperty} 6b0b97dd-e372-4142-bc83-2fd238398644, key: 0
2021-08-26T12:03:16.7586471Z 1181  1222  info     {ParseAndProcess} Download state change: 2
2021-08-26T12:03:16.7588127Z 1181  1184  trace    {_PerformStateChange} 6b0b97dd-e372-4142-bc83-2fd238398644, state change request 0 --> 1
2021-08-26T12:03:16.7590203Z 1181  1184  info     {Create} (hr:0) Create file /tmp/aduc-dl-210826120315/rauc_update_nand-V20211012.artifact
2021-08-26T12:03:16.7788947Z 1181  1184  trace    {Get} Proxy[0]: direct://
2021-08-26T12:03:16.7803287Z 1181  1184  info     {_TryRefresh} Read json config file /etc/deliveryoptimization-agent/sdk-config.json
2021-08-26T12:03:16.7803576Z 1181  1184  trace    {GetHostNameFromIoTConnectionString} Parsing connection string: HostName=IoT-Hub-Schneider.azure-devices.net;DeviceId=FSIMX8MM;SharedAccessKey=TCBNbw22TiWgZxejDiImXuT1OIFKgNEo9a5ulmexhh0=
2021-08-26T12:03:16.7803799Z 1181  1184  trace    {GetHostNameFromIoTConnectionString} GatewayHostName not found in HostName=IoT-Hub-Schneider.azure-devices.net;DeviceId=FSIMX8MM;SharedAccessKey=TCBNbw22TiWgZxejDiImXuT1OIFKgNEo9a5ulmexhh0=
2021-08-26T12:03:16.7804121Z 1181  1184  trace    {GetHost} Returning MCC host: [] for original host: [deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com]
2021-08-26T12:03:16.7804454Z 1181  1184  info     {_UpdateConnectionTypeAndGetUrl} 6b0b97dd-e372-4142-bc83-2fd238398644, connection type: 2, numAttempts: 1, url: http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact
2021-08-26T12:03:16.7804710Z 1181  1184  info     {_SendHttpRequest} 6b0b97dd-e372-4142-bc83-2fd238398644, requesting full file from http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact
2021-08-26T12:03:16.8045874Z 1181  1184  trace    {_CreateClient} New http_client for http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact
2021-08-26T12:03:16.8047852Z 1181  1184  trace    {TraceDownloadStatus} id: 6b0b97dd-e372-4142-bc83-2fd238398644, 1, codes: [0, 0x0, 0x0], 0 / 0
2021-08-26T12:03:16.8048184Z 1181  1184  info     {TraceDownloadStart} (hr:0) id: 6b0b97dd-e372-4142-bc83-2fd238398644, url: http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact, filePath: /tmp/aduc-dl-210826120315/rauc_update_nand-V20211012.artifact, mccHost:
2021-08-26T12:03:17.0457274Z 1181  1189  info     {OnHeadersAvailable} 6b0b97dd-e372-4142-bc83-2fd238398644, http_status: 200, content_length: 120944697, headers:
Accept-Ranges:bytes
Age:80634
Cache-Control:public,max-age=17280000
Content-Disposition:attachment; filename=rauc_update_nand-V20211012.artifact; filename*=utf-8''rauc_update_nand-V20211012.artifact
Content-Length:120944697
Content-Type:application/octet-stream
Date:Thu, 26 Aug 2021 12:03:17 GMT
Etag:"XY4LXnChbGD5OwW761tvivY6+7fqsc5njt0d5lD/Oyw="
Last-Modified:Wed, 25 Aug 2021 07:29:29 GMT
Server:ECAcc (ama/8B2D)
traceparent:00-5e1d1257094f8a4c836a41e84de73e51-3687082cdd01774c-00
X-Cache:HIT
X-CCC:NL
X-CID:11

2021-08-26T12:03:17.3095274Z 1181  1184  trace    {TraceDownloadStatus} id: 6b0b97dd-e372-4142-bc83-2fd238398644, 1, codes: [200, 0x0, 0x0], 2228224 / 120944697
2021-08-26T12:03:18.3130379Z 1181  1184  trace    {TraceDownloadStatus} id: 6b0b97dd-e372-4142-bc83-2fd238398644, 1, codes: [200, 0x0, 0x0], 13893632 / 120944697
2021-08-26T12:03:19.8169592Z 1181  1184  trace    {TraceDownloadStatus} id: 6b0b97dd-e372-4142-bc83-2fd238398644, 1, codes: [200, 0x0, 0x0], 25034752 / 120944697
2021-08-26T12:03:20.7769686Z 1181  1197  error    {Append} (hr:80070018) cbWritten != static_cast<ssize_t>(cbData) [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/do_file.cpp, 53]
2021-08-26T12:03:20.7771241Z 1181  1197  error    {OnData} (hr:80070018) DO failure: (null) (hr:0x80070018) [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/do_file.cpp, 53], {cbWritten != static_cast<ssize_t>(cbData)} [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/download/download.cpp, 629]
2021-08-26T12:03:20.7771549Z 1181  1197  error    {operator()} (hr:80070018) hr [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/http_agent.cpp, 289]
2021-08-26T12:03:20.7870562Z 1181  1207  error    {operator()} (hr:80070018) DO failure: (null) (hr:0x80070018) [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/http_agent.cpp, 289], {hr} [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/http_agent.cpp, 252]
2021-08-26T12:03:20.7871154Z 1181  1207  warning  {operator()} (hr:80070018) Url: http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact, host: deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com
2021-08-26T12:03:20.7875880Z 1181  1184  info     {IsConnected} Network connectivity detected. Interface: eth0, address family: 2 (AF_INET).
2021-08-26T12:03:20.7876639Z 1181  1184  info     {operator()} (hr:80070018) 6b0b97dd-e372-4142-bc83-2fd238398644, failure, will retry in 2 seconds, http_status: 200, headers:
Accept-Ranges:bytes
Age:80634
Cache-Control:public,max-age=17280000
Content-Disposition:attachment; filename=rauc_update_nand-V20211012.artifact; filename*=utf-8''rauc_update_nand-V20211012.artifact
Content-Length:120944697
Content-Type:application/octet-stream
Date:Thu, 26 Aug 2021 12:03:17 GMT
Etag:"XY4LXnChbGD5OwW761tvivY6+7fqsc5njt0d5lD/Oyw="
Last-Modified:Wed, 25 Aug 2021 07:29:29 GMT
Server:ECAcc (ama/8B2D)
traceparent:00-5e1d1257094f8a4c836a41e84de73e51-3687082cdd01774c-00
X-Cache:HIT
X-CCC:NL
X-CID:11

2021-08-26T12:03:21.8215256Z 1181  1184  trace    {TraceDownloadStatus} id: 6b0b97dd-e372-4142-bc83-2fd238398644, 1, codes: [200, 0x80070018, 0x0], 31326208 / 120944697
2021-08-26T12:03:22.7878722Z 1181  1184  info     {_UpdateConnectionTypeAndGetUrl} 6b0b97dd-e372-4142-bc83-2fd238398644, connection type: 2, numAttempts: 2, url: http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact
2021-08-26T12:03:22.7879333Z 1181  1184  info     {_SendHttpRequest} 6b0b97dd-e372-4142-bc83-2fd238398644, requesting range: 31326208-120944696 from http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact
2021-08-26T12:03:22.8414014Z 1181  1216  info     {OnHeadersAvailable} 6b0b97dd-e372-4142-bc83-2fd238398644, http_status: 206, content_length: 120944697, headers:
Accept-Ranges:bytes
Age:80635
Cache-Control:public,max-age=17280000
Content-Disposition:attachment; filename=rauc_update_nand-V20211012.artifact; filename*=utf-8''rauc_update_nand-V20211012.artifact
Content-Length:89618489
Content-Range:bytes 31326208-120944696/120944697
Content-Type:application/octet-stream
Date:Thu, 26 Aug 2021 12:03:22 GMT
Etag:"XY4LXnChbGD5OwW761tvivY6+7fqsc5njt0d5lD/Oyw="
Last-Modified:Wed, 25 Aug 2021 07:29:29 GMT
Server:ECAcc (ama/8B1A)
traceparent:00-ea9f923ff70c00469c9d44a846501ae5-9af982361cd30a4a-00
X-Cache:HIT
X-CCC:NL
X-CID:11

2021-08-26T12:03:22.8874063Z 1181  1197  error    {Append} (hr:C0D0001C) HRESULT_FROM_XPLAT_SYSERR(errno) [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/do_file.cpp, 51]
2021-08-26T12:03:22.8875678Z 1181  1197  error    {OnData} (hr:C0D0001C) DO failure: (null) (hr:0xC0D0001C) [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/do_file.cpp, 51], {HRESULT_FROM_XPLAT_SYSERR(errno)} [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/download/download.cpp, 629]
2021-08-26T12:03:22.8875971Z 1181  1197  error    {operator()} (hr:C0D0001C) hr [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/http_agent.cpp, 289]
2021-08-26T12:03:22.8878183Z 1181  1197  error    {operator()} (hr:C0D0001C) DO failure: (null) (hr:0xC0D0001C) [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/http_agent.cpp, 289], {hr} [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/http_agent.cpp, 252]
2021-08-26T12:03:22.8878538Z 1181  1197  warning  {operator()} (hr:C0D0001C) Url: http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact, host: deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com
2021-08-26T12:03:22.8884733Z 1181  1184  info     {IsConnected} Network connectivity detected. Interface: eth0, address family: 2 (AF_INET).
2021-08-26T12:03:22.8885582Z 1181  1184  info     {operator()} (hr:C0D0001C) 6b0b97dd-e372-4142-bc83-2fd238398644, failure, will retry in 4 seconds, http_status: 206, headers:
Accept-Ranges:bytes
Age:80635
Cache-Control:public,max-age=17280000
Content-Disposition:attachment; filename=rauc_update_nand-V20211012.artifact; filename*=utf-8''rauc_update_nand-V20211012.artifact
Content-Length:89618489
Content-Range:bytes 31326208-120944696/120944697
Content-Type:application/octet-stream
Date:Thu, 26 Aug 2021 12:03:22 GMT
Etag:"XY4LXnChbGD5OwW761tvivY6+7fqsc5njt0d5lD/Oyw="
Last-Modified:Wed, 25 Aug 2021 07:29:29 GMT
Server:ECAcc (ama/8B1A)
traceparent:00-ea9f923ff70c00469c9d44a846501ae5-9af982361cd30a4a-00
X-Cache:HIT
X-CCC:NL
X-CID:11

2021-08-26T12:03:24.3254103Z 1181  1184  trace    {TraceDownloadStatus} id: 6b0b97dd-e372-4142-bc83-2fd238398644, 1, codes: [206, 0xc0d0001c, 0x0], 31326208 / 120944697
2021-08-26T12:03:26.8049229Z 1181  1184  info     {CheckProgress} Bytes transferred so far: 31326208, no-progress intervals: [cur 0, max 30]
2021-08-26T12:03:26.8888261Z 1181  1184  info     {_UpdateConnectionTypeAndGetUrl} 6b0b97dd-e372-4142-bc83-2fd238398644, connection type: 2, numAttempts: 3, url: http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact
2021-08-26T12:03:26.8888851Z 1181  1184  info     {_SendHttpRequest} 6b0b97dd-e372-4142-bc83-2fd238398644, requesting range: 31326208-120944696 from http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact
2021-08-26T12:03:26.9320321Z 1181  1218  info     {OnHeadersAvailable} 6b0b97dd-e372-4142-bc83-2fd238398644, http_status: 206, content_length: 120944697, headers:
Accept-Ranges:bytes
Age:80639
Cache-Control:public,max-age=17280000
Content-Disposition:attachment; filename=rauc_update_nand-V20211012.artifact; filename*=utf-8''rauc_update_nand-V20211012.artifact
Content-Length:89618489
Content-Range:bytes 31326208-120944696/120944697
Content-Type:application/octet-stream
Date:Thu, 26 Aug 2021 12:03:26 GMT
Etag:"XY4LXnChbGD5OwW761tvivY6+7fqsc5njt0d5lD/Oyw="
Last-Modified:Wed, 25 Aug 2021 07:29:29 GMT
Server:ECAcc (ama/8B1A)
traceparent:00-ea9f923ff70c00469c9d44a846501ae5-9af982361cd30a4a-00
X-Cache:HIT
X-CCC:NL
X-CID:11

2021-08-26T12:03:26.9817305Z 1181  1200  error    {Append} (hr:C0D0001C) HRESULT_FROM_XPLAT_SYSERR(errno) [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/do_file.cpp, 51]
2021-08-26T12:03:26.9819022Z 1181  1200  error    {OnData} (hr:C0D0001C) DO failure: (null) (hr:0xC0D0001C) [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/do_file.cpp, 51], {HRESULT_FROM_XPLAT_SYSERR(errno)} [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/download/download.cpp, 629]
2021-08-26T12:03:26.9819343Z 1181  1200  error    {operator()} (hr:C0D0001C) hr [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/http_agent.cpp, 289]
2021-08-26T12:03:26.9822430Z 1181  1192  error    {operator()} (hr:C0D0001C) DO failure: (null) (hr:0xC0D0001C) [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/http_agent.cpp, 289], {hr} [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/http_agent.cpp, 252]
2021-08-26T12:03:26.9822799Z 1181  1192  warning  {operator()} (hr:C0D0001C) Url: http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact, host: deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com
2021-08-26T12:03:26.9827004Z 1181  1184  info     {IsConnected} Network connectivity detected. Interface: eth0, address family: 2 (AF_INET).
2021-08-26T12:03:26.9827711Z 1181  1184  info     {operator()} (hr:C0D0001C) 6b0b97dd-e372-4142-bc83-2fd238398644, failure, will retry in 8 seconds, http_status: 206, headers:
Accept-Ranges:bytes
Age:80639
Cache-Control:public,max-age=17280000
Content-Disposition:attachment; filename=rauc_update_nand-V20211012.artifact; filename*=utf-8''rauc_update_nand-V20211012.artifact
Content-Length:89618489
Content-Range:bytes 31326208-120944696/120944697
Content-Type:application/octet-stream
Date:Thu, 26 Aug 2021 12:03:26 GMT
Etag:"XY4LXnChbGD5OwW761tvivY6+7fqsc5njt0d5lD/Oyw="
Last-Modified:Wed, 25 Aug 2021 07:29:29 GMT
Server:ECAcc (ama/8B1A)
traceparent:00-ea9f923ff70c00469c9d44a846501ae5-9af982361cd30a4a-00
X-Cache:HIT
X-CCC:NL
X-CID:11

2021-08-26T12:03:27.3296700Z 1181  1184  trace    {TraceDownloadStatus} id: 6b0b97dd-e372-4142-bc83-2fd238398644, 1, codes: [206, 0xc0d0001c, 0x0], 31326208 / 120944697
2021-08-26T12:03:30.8345008Z 1181  1184  trace    {TraceDownloadStatus} id: 6b0b97dd-e372-4142-bc83-2fd238398644, 1, codes: [206, 0xc0d0001c, 0x0], 31326208 / 120944697
2021-08-26T12:03:34.8382859Z 1181  1184  trace    {TraceDownloadStatus} id: 6b0b97dd-e372-4142-bc83-2fd238398644, 1, codes: [206, 0xc0d0001c, 0x0], 31326208 / 120944697
2021-08-26T12:03:34.9830099Z 1181  1184  info     {_UpdateConnectionTypeAndGetUrl} 6b0b97dd-e372-4142-bc83-2fd238398644, connection type: 2, numAttempts: 4, url: http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact
2021-08-26T12:03:34.9831447Z 1181  1184  info     {_SendHttpRequest} 6b0b97dd-e372-4142-bc83-2fd238398644, requesting range: 31326208-120944696 from http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact
2021-08-26T12:03:35.0309990Z 1181  1195  info     {OnHeadersAvailable} 6b0b97dd-e372-4142-bc83-2fd238398644, http_status: 206, content_length: 120944697, headers:
Accept-Ranges:bytes
Age:80648
Cache-Control:public,max-age=17280000
Content-Disposition:attachment; filename=rauc_update_nand-V20211012.artifact; filename*=utf-8''rauc_update_nand-V20211012.artifact
Content-Length:89618489
Content-Range:bytes 31326208-120944696/120944697
Content-Type:application/octet-stream
Date:Thu, 26 Aug 2021 12:03:35 GMT
Etag:"XY4LXnChbGD5OwW761tvivY6+7fqsc5njt0d5lD/Oyw="
Last-Modified:Wed, 25 Aug 2021 07:29:29 GMT
Server:ECAcc (ama/8B1A)
traceparent:00-ea9f923ff70c00469c9d44a846501ae5-9af982361cd30a4a-00
X-Cache:HIT
X-CCC:NL
X-CID:11
shishirb-MSFT commented 3 years ago

Thanks for reporting the issue. The first problem I see is DO agent is continuing to retry the download even after writing to storage fails.

Looks like there is no space left on the storage device In the log below, C0D0001C indicates 0x1c == error 28 (ENOSPC / No space left on device /).

2021-08-26T12:03:19.8169592Z 1181 1184 trace {TraceDownloadStatus} id: 6b0b97dd-e372-4142-bc83-2fd238398644, 1, codes: [200, 0x0, 0x0], 25034752 / 120944697 2021-08-26T12:03:20.7769686Z 1181 1197 error {Append} (hr:80070018) cbWritten != static_cast(cbData) [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/do_file.cpp, 53] 2021-08-26T12:03:20.7771241Z 1181 1197 error {OnData} (hr:80070018) DO failure: (null) (hr:0x80070018) [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/do_file.cpp, 53], {cbWritten != static_cast(cbData)} [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/download/download.cpp, 629] 2021-08-26T12:03:20.7771549Z 1181 1197 error {operator()} (hr:80070018) hr [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/http_agent.cpp, 289] 2021-08-26T12:03:20.7870562Z 1181 1207 error {operator()} (hr:80070018) DO failure: (null) (hr:0x80070018) [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/http_agent.cpp, 289], {hr} [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/http_agent.cpp, 252] 2021-08-26T12:03:20.7871154Z 1181 1207 warning {operator()} (hr:80070018) Url: http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact, host: deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com 2021-08-26T12:03:20.7875880Z 1181 1184 info {IsConnected} Network connectivity detected. Interface: eth0, address family: 2 (AF_INET). 2021-08-26T12:03:20.7876639Z 1181 1184 info {operator()} (hr:80070018) 6b0b97dd-e372-4142-bc83-2fd238398644, failure, will retry in 2 seconds, http_status: 200, headers:

2021-08-26T12:03:22.8874063Z 1181 1197 error {Append} (hr:C0D0001C) HRESULT_FROM_XPLAT_SYSERR(errno) [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/do_file.cpp, 51] 2021-08-26T12:03:22.8875678Z 1181 1197 error {OnData} (hr:C0D0001C) DO failure: (null) (hr:0xC0D0001C) [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/do_file.cpp, 51], {HRESULT_FROM_XPLAT_SYSERR(errno)} [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/download/download.cpp, 629] 2021-08-26T12:03:22.8875971Z 1181 1197 error {operator()} (hr:C0D0001C) hr [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/http_agent.cpp, 289] 2021-08-26T12:03:22.8878183Z 1181 1197 error {operator()} (hr:C0D0001C) DO failure: (null) (hr:0xC0D0001C) [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/http_agent.cpp, 289], {hr} [/usr/src/debug/deliveryoptimization-agent/1.0+gitAUTOINC+3f00d1e0f8-r0/git/client-lite/src/util/http_agent.cpp, 252] 2021-08-26T12:03:22.8878538Z 1181 1197 warning {operator()} (hr:C0D0001C) Url: http://deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com/northeurope/deviceupdateinstance--schneider-device-update/6ecc8a8fb83b4160bd833ac8eb68ad74/rauc_update_nand-V20211012.artifact, host: deviceupdateinstance--schneider-device-update.b.nlu.dl.adu.microsoft.com 2021-08-26T12:03:22.8884733Z 1181 1184 info {IsConnected} Network connectivity detected. Interface: eth0, address family: 2 (AF_INET). 2021-08-26T12:03:22.8885582Z 1181 1184 info {operator()} (hr:C0D0001C) 6b0b97dd-e372-4142-bc83-2fd238398644, failure, will retry in 4 seconds, http_status: 206, headers:

Voxel07 commented 3 years ago

I haven't looked into the source code of DO-Agent very much, because the main focus was an DU-Agent and DO was just working, until I stumbled apron this Problem during testing.

Does DO-Agent reserve Memory somewhere else than the work folder that's given to him by DU-Agent? Because the /tmp/ folder is cleared before every download and "top" states more than 500m RAM left. So that shouldn't be the problem. An important note is that the rootfs of my device is ro, and I have specified some folders like the logging folders for DU and DO to be writable.

shishirb-MSFT commented 3 years ago

Large writes will be done only for downloading the file to the work folder provided by DU agent. Other than that, DO agent writes to /var/log/ (or /var/cache/ in an older version) and /var/run/ but both these locations should see writes <1MB in size.

Voxel07 commented 3 years ago

Thanks, then I haven't overlooked something. But I still don't get what part of my memory is running low that I can't see. Is there something that is allocated and doesn't get freed if the agent gets killed?

shishirb-MSFT commented 2 years ago

Insufficient disk space will now cause download to pause and report a fatal error.