search

microsoft / Microsoft365DSC

Manages, configures, extracts and monitors Microsoft 365 tenant configurations
https://aka.ms/M365DSC
MIT License
1.54k stars 472 forks source link

Experiencing memory issues when connecting to Exchange Online Management using C# #4930

Open vishali-gupta-robomq opened 1 month ago

vishali-gupta-robomq commented 1 month ago

Description of the issue

I am experiencing memory issues when connecting to Exchange Online Management using C#. The process involves executing commands such as Get-User, Get-DistributionGroupMember, Add-DistributionGroupMember, and Remove-DistributionGroupMember. After each Exchange connection, there is a memory spike that does not reduce, and with every new connection, the spike increases.

  1. I have tried all suggested ways to connect to Exchange Online as recommended by Microsoft here: Reducing Memory Consumption of the Exchange Online PowerShell V3 module.

  2. Docker Base Image: I use the base image mcr.microsoft.com/dotnet/sdk:8.0, which runs on a Linux container. I assumed the memory issue was caused by the OS, so I changed the Docker image to a Windows base image: mcr.microsoft.com/dotnet/sdk:8.0-windowsservercore-ltsc2022. This change reduced memory usage but did not resolve the continuous memory spikes after each connection.

  3. Exchange Module Version:I downgraded the Exchange module from version 3.5.0 to 3.4.0, but this did not improve the situation.

  4. Garbage Collection:I attempted to run garbage collection forcefully, but this had no effect on memory consumption.

Despite these efforts, I continue to face significant memory consumption that impacts performance. Any guidance on troubleshooting and resolving these memory issues would be greatly appreciated.

dotnet : 8.0 packages : `

<PackageReference Include="System.Management.Automation" Version="7.4.0" />`

Environment Information + PowerShell Version

No response

tayhall commented 1 month ago

could this be why we have the memory issues for the Exchange module on the more recent DSC versions?

vishali-gupta-robomq commented 1 month ago

This issue occurs with Exchange Online versions 3.4.0 and 3.5.0 using C#, but I have not tried it with earlier versions. Every time I create an Exchange connection, it causes a memory spike. I use the same Exchange connection for 1 hour and 15 minutes, and after this period, when I create a new connection, I observe a spike. When I create a new connection, I destroy all the previous connections using Disconnect-ExchangeOnline and dispose of PowerShell runspace and session, but the issue still persists. The problem is that the memory spike does not go down even after these steps.

Additionally, during the debugging phase of my C# application, I observed that some string objects hold memory and are filled with every new connection, but do not release resources. I have disposed of all PowerShell sessions and runspaces, but these objects are still not getting released.