Memory leak in client - Githubissues

gooseleggs commented 1 year ago

Last night I noticed that my ZDEW client was consuming a vast amount of memory and was a bit unresponsive. So, I crashed out of it, and then restarted. Tonight I checked back in, and it was back being high again. I have not used the ZDEW for anything. The laptop has been put to sleep a few times, but that is it. Just by watching the Task Manager over 5-10 minutes I can see the memory usage increasing.

App version is 2.1.16.0

How can I help to produce any data for this.

dovholuknf commented 1 year ago

Yikes. Are there any network configuration changes that have happened lately? This just happened out of nowhere? Best thing to do will be to get a set of logs to share, assuming you're comfortable with that and assuming it's reproducible. If it's NOT reproducible, just collect a feedback zip and send to us to inspect.

If you can reproduce the issue:

Enable debug level logging
Stop zdew
Clean up/remove existing log files (you'll have to do this manually)
start zdew
wait until you see the memory spike up over 500 mb
Get a feedback zip file, send to help at OpenZiti.org

gooseleggs commented 1 year ago

So, I have been doing some investigation. You mentioned if any network changes, so have been doing some experimentation. It seems to go balistic when I have virtual box open.

This is what is repeating in the logs (UI log) when I have Virtual Box machine open

[2023-06-15T09:42:43.205Z] DEBUG    ZitiDesktopEdge.MainWindow  ==== ControllerEvent    : action:connected identifier:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json 
[2023-06-15T09:42:43.277Z] TRACE    ZitiDesktopEdge.ServiceClient.DataClient    {"Op":"identity","Action":"added","Fingerprint":"KelvinWorkLaptop","Id":{"Name":"HDC Kelvin Work Laptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","FingerPrint":"KelvinWorkLaptop","Active":true,"Loaded":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443"},"ControllerVersion":"v0.27.9","IdFileStatus":true,"MfaEnabled":false,"MfaNeeded":false,"Metrics":{"Up":0,"Down":0},"MfaMinTimeout":0,"MfaMaxTimeout":0,"MfaMinTimeoutRem":0,"MfaMaxTimeoutRem":0,"MinTimeoutRemInSvcEvent":0,"MaxTimeoutRemInSvcEvent":0,"Deleted":false,"Notified":false}} 
[2023-06-15T09:42:43.277Z]  INFO    ZitiDesktopEdge.Models.ZitiIdentity Identity: HDC Kelvin Work Laptop updated To {"Name":"HDC Kelvin Work Laptop","FingerPrint":"KelvinWorkLaptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Active":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443","id":null,"configTypes":null},"Status":null,"Services":null,"Metrics":{"TotalBytes":0,"Up":0,"Down":0},"ControllerVersion":"v0.27.9","MfaEnabled":false,"MfaNeeded":false,"MinTimeout":0,"MaxTimeout":0,"MfaLastUpdatedTime":"0001-01-01T00:00:00"}    
[2023-06-15T09:42:43.277Z] DEBUG    ZitiDesktopEdge.MainWindow  ==== IdentityEvent    : action:added identifer:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json name:HDC Kelvin Work Laptop    
[2023-06-15T09:42:43.319Z] DEBUG    ZitiDesktopEdge.MainWindow  IDENTITY EVENT. Action: added identifier: C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json 
[2023-06-15T09:42:43.319Z] TRACE    ZitiDesktopEdge.ServiceClient.DataClient    {"Op":"controller","Action":"disconnected","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Fingerprint":"KelvinWorkLaptop"} 
[2023-06-15T09:42:43.319Z] DEBUG    ZitiDesktopEdge.ServiceClient.DataClient    Controller event received   
[2023-06-15T09:42:43.319Z] DEBUG    ZitiDesktopEdge.MainWindow  ==== ControllerEvent    : action:disconnected identifier:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json  
[2023-06-15T09:42:43.524Z] TRACE    ZitiDesktopEdge.ServiceClient.DataClient    {"Op":"identity","Action":"added","Fingerprint":"KelvinWorkLaptop","Id":{"Name":"HDC Kelvin Work Laptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","FingerPrint":"KelvinWorkLaptop","Active":true,"Loaded":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443"},"ControllerVersion":"v0.27.9","IdFileStatus":true,"MfaEnabled":false,"MfaNeeded":false,"Metrics":{"Up":0,"Down":0},"MfaMinTimeout":0,"MfaMaxTimeout":0,"MfaMinTimeoutRem":0,"MfaMaxTimeoutRem":0,"MinTimeoutRemInSvcEvent":0,"MaxTimeoutRemInSvcEvent":0,"Deleted":false,"Notified":false}} 
[2023-06-15T09:42:43.524Z]  INFO    ZitiDesktopEdge.Models.ZitiIdentity Identity: HDC Kelvin Work Laptop updated To {"Name":"HDC Kelvin Work Laptop","FingerPrint":"KelvinWorkLaptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Active":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443","id":null,"configTypes":null},"Status":null,"Services":null,"Metrics":{"TotalBytes":0,"Up":0,"Down":0},"ControllerVersion":"v0.27.9","MfaEnabled":false,"MfaNeeded":false,"MinTimeout":0,"MaxTimeout":0,"MfaLastUpdatedTime":"0001-01-01T00:00:00"}    
[2023-06-15T09:42:43.524Z] DEBUG    ZitiDesktopEdge.MainWindow  ==== IdentityEvent    : action:added identifer:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json name:HDC Kelvin Work Laptop    
[2023-06-15T09:42:43.552Z] DEBUG    ZitiDesktopEdge.MainWindow  IDENTITY EVENT. Action: added identifier: C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json 
[2023-06-15T09:42:43.552Z] TRACE    ZitiDesktopEdge.ServiceClient.DataClient    {"Op":"controller","Action":"connected","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Fingerprint":"KelvinWorkLaptop"}    
[2023-06-15T09:42:43.552Z] DEBUG    ZitiDesktopEdge.ServiceClient.DataClient    Controller event received   
[2023-06-15T09:42:43.552Z] DEBUG    ZitiDesktopEdge.MainWindow  ==== ControllerEvent    : action:connected identifier:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json 
[2023-06-15T09:42:43.564Z] TRACE    ZitiDesktopEdge.ServiceClient.DataClient    {"Op":"identity","Action":"added","Fingerprint":"KelvinWorkLaptop","Id":{"Name":"HDC Kelvin Work Laptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","FingerPrint":"KelvinWorkLaptop","Active":true,"Loaded":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443"},"ControllerVersion":"v0.27.9","IdFileStatus":true,"MfaEnabled":false,"MfaNeeded":false,"Metrics":{"Up":0,"Down":0},"MfaMinTimeout":0,"MfaMaxTimeout":0,"MfaMinTimeoutRem":0,"MfaMaxTimeoutRem":0,"MinTimeoutRemInSvcEvent":0,"MaxTimeoutRemInSvcEvent":0,"Deleted":false,"Notified":false}} 
[2023-06-15T09:42:43.564Z]  INFO    ZitiDesktopEdge.Models.ZitiIdentity Identity: HDC Kelvin Work Laptop updated To {"Name":"HDC Kelvin Work Laptop","FingerPrint":"KelvinWorkLaptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Active":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443","id":null,"configTypes":null},"Status":null,"Services":null,"Metrics":{"TotalBytes":0,"Up":0,"Down":0},"ControllerVersion":"v0.27.9","MfaEnabled":false,"MfaNeeded":false,"MinTimeout":0,"MaxTimeout":0,"MfaLastUpdatedTime":"0001-01-01T00:00:00"}    
[2023-06-15T09:42:43.564Z] DEBUG    ZitiDesktopEdge.MainWindow  ==== IdentityEvent    : action:added identifer:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json name:HDC Kelvin Work Laptop    
[2023-06-15T09:42:43.615Z] DEBUG    ZitiDesktopEdge.MainWindow  IDENTITY EVENT. Action: added identifier: C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json 
[2023-06-15T09:42:43.615Z] TRACE    ZitiDesktopEdge.ServiceClient.DataClient    {"Op":"controller","Action":"disconnected","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Fingerprint":"KelvinWorkLaptop"} 
[2023-06-15T09:42:43.615Z] DEBUG    ZitiDesktopEdge.ServiceClient.DataClient    Controller event received   
[2023-06-15T09:42:43.615Z] DEBUG    ZitiDesktopEdge.MainWindow  ==== ControllerEvent    : action:disconnected identifier:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json  
[2023-06-15T09:42:43.819Z] TRACE    ZitiDesktopEdge.ServiceClient.DataClient    {"Op":"identity","Action":"added","Fingerprint":"KelvinWorkLaptop","Id":{"Name":"HDC Kelvin Work Laptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","FingerPrint":"KelvinWorkLaptop","Active":true,"Loaded":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443"},"ControllerVersion":"v0.27.9","IdFileStatus":true,"MfaEnabled":false,"MfaNeeded":false,"Metrics":{"Up":0,"Down":0},"MfaMinTimeout":0,"MfaMaxTimeout":0,"MfaMinTimeoutRem":0,"MfaMaxTimeoutRem":0,"MinTimeoutRemInSvcEvent":0,"MaxTimeoutRemInSvcEvent":0,"Deleted":false,"Notified":false}} 
[2023-06-15T09:42:43.819Z]  INFO    ZitiDesktopEdge.Models.ZitiIdentity Identity: HDC Kelvin Work Laptop updated To {"Name":"HDC Kelvin Work Laptop","FingerPrint":"KelvinWorkLaptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Active":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443","id":null,"configTypes":null},"Status":null,"Services":null,"Metrics":{"TotalBytes":0,"Up":0,"Down":0},"ControllerVersion":"v0.27.9","MfaEnabled":false,"MfaNeeded":false,"MinTimeout":0,"MaxTimeout":0,"MfaLastUpdatedTime":"0001-01-01T00:00:00"}    
[2023-06-15T09:42:43.819Z] DEBUG    ZitiDesktopEdge.MainWindow  ==== IdentityEvent    : action:added identifer:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json name:HDC Kelvin Work Laptop    
[2023-06-15T09:42:43.858Z] DEBUG    ZitiDesktopEdge.MainWindow  IDENTITY EVENT. Action: added identifier: C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json 
[2023-06-15T09:42:43.858Z] TRACE    ZitiDesktopEdge.ServiceClient.DataClient    {"Op":"controller","Action":"connected","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Fingerprint":"KelvinWorkLaptop"}    
[2023-06-15T09:42:43.858Z] DEBUG    ZitiDesktopEdge.ServiceClient.DataClient    Controller event received   
[2023-06-15T09:42:43.858Z] DEBUG    ZitiDesktopEdge.MainWindow  ==== ControllerEvent    : action:connected identifier:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json 
[2023-06-15T09:42:43.858Z] TRACE    ZitiDesktopEdge.ServiceClient.DataClient    {"Op":"identity","Action":"added","Fingerprint":"KelvinWorkLaptop","Id":{"Name":"HDC Kelvin Work Laptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","FingerPrint":"KelvinWorkLaptop","Active":true,"Loaded":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443"},"ControllerVersion":"v0.27.9","IdFileStatus":true,"MfaEnabled":false,"MfaNeeded":false,"Metrics":{"Up":0,"Down":0},"MfaMinTimeout":0,"MfaMaxTimeout":0,"MfaMinTimeoutRem":0,"MfaMaxTimeoutRem":0,"MinTimeoutRemInSvcEvent":0,"MaxTimeoutRemInSvcEvent":0,"Deleted":false,"Notified":false}} 
[2023-06-15T09:42:43.858Z]  INFO    ZitiDesktopEdge.Models.ZitiIdentity Identity: HDC Kelvin Work Laptop updated To {"Name":"HDC Kelvin Work Laptop","FingerPrint":"KelvinWorkLaptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Active":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443","id":null,"configTypes":null},"Status":null,"Services":null,"Metrics":{"TotalBytes":0,"Up":0,"Down":0},"ControllerVersion":"v0.27.9","MfaEnabled":false,"MfaNeeded":false,"MinTimeout":0,"MaxTimeout":0,"MfaLastUpdatedTime":"0001-01-01T00:00:00"}    
[2023-06-15T09:42:43.858Z] DEBUG    ZitiDesktopEdge.MainWindow  ==== IdentityEvent    : action:added identifer:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json name:HDC Kelvin Work Laptop    
[2023-06-15T09:42:43.929Z] DEBUG    ZitiDesktopEdge.MainWindow  IDENTITY EVENT. Action: added identifier: C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json 
[2023-06-15T09:42:43.929Z] TRACE    ZitiDesktopEdge.ServiceClient.DataClient    {"Op":"controller","Action":"disconnected","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Fingerprint":"KelvinWorkLaptop"} 
[2023-06-15T09:42:43.929Z] DEBUG    ZitiDesktopEdge.ServiceClient.DataClient    Controller event received   
[2023-06-15T09:42:43.929Z] DEBUG    ZitiDesktopEdge.MainWindow  ==== ControllerEvent    : action:disconnected identifier:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json  
[2023-06-15T09:42:44.445Z] TRACE    ZitiDesktopEdge.ServiceClient.DataClient    {"Op":"identity","Action":"added","Fingerprint":"KelvinWorkLaptop","Id":{"Name":"HDC Kelvin Work Laptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","FingerPrint":"KelvinWorkLaptop","Active":true,"Loaded":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443"},"ControllerVersion":"v0.27.9","IdFileStatus":true,"MfaEnabled":false,"MfaNeeded":false,"Metrics":{"Up":0,"Down":0},"MfaMinTimeout":0,"MfaMaxTimeout":0,"MfaMinTimeoutRem":0,"MfaMaxTimeoutRem":0,"MinTimeoutRemInSvcEvent":0,"MaxTimeoutRemInSvcEvent":0,"Deleted":false,"Notified":false}} 
[2023-06-15T09:42:44.445Z]  INFO    ZitiDesktopEdge.Models.ZitiIdentity Identity: HDC Kelvin Work Laptop updated To {"Name":"HDC Kelvin Work Laptop","FingerPrint":"KelvinWorkLaptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Active":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443","id":null,"configTypes":null},"Status":null,"Services":null,"Metrics":{"TotalBytes":0,"Up":0,"Down":0},"ControllerVersion":"v0.27.9","MfaEnabled":false,"MfaNeeded":false,"MinTimeout":0,"MaxTimeout":0,"MfaLastUpdatedTime":"0001-01-01T00:00:00"}    
[2023-06-15T09:42:44.445Z] DEBUG    ZitiDesktopEdge.MainWindow  ==== IdentityEvent    : action:added identifer:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json name:HDC Kelvin Work Laptop    
[2023-06-15T09:42:44.474Z] DEBUG    ZitiDesktopEdge.MainWindow  IDENTITY EVENT. Action: added identifier: C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json 
[2023-06-15T09:42:44.474Z] TRACE    ZitiDesktopEdge.ServiceClient.DataClient    {"Op":"controller","Action":"connected","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Fingerprint":"KelvinWorkLaptop"}    
[2023-06-15T09:42:44.474Z] DEBUG    ZitiDesktopEdge.ServiceClient.DataClient    Controller event received   
[2023-06-15T09:42:44.474Z] DEBUG    ZitiDesktopEdge.MainWindow  ==== ControllerEvent    : action:connected identifier:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json 
[2023-06-15T09:42:44.488Z] TRACE    ZitiDesktopEdge.ServiceClient.DataClient    {"Op":"identity","Action":"added","Fingerprint":"KelvinWorkLaptop","Id":{"Name":"HDC Kelvin Work Laptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","FingerPrint":"KelvinWorkLaptop","Active":true,"Loaded":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443"},"ControllerVersion":"v0.27.9","IdFileStatus":true,"MfaEnabled":false,"MfaNeeded":false,"Metrics":{"Up":0,"Down":0},"MfaMinTimeout":0,"MfaMaxTimeout":0,"MfaMinTimeoutRem":0,"MfaMaxTimeoutRem":0,"MinTimeoutRemInSvcEvent":0,"MaxTimeoutRemInSvcEvent":0,"Deleted":false,"Notified":false}} 
[2023-06-15T09:42:44.488Z]  INFO    ZitiDesktopEdge.Models.ZitiIdentity Identity: HDC Kelvin Work Laptop updated To {"Name":"HDC Kelvin Work Laptop","FingerPrint":"KelvinWorkLaptop","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Active":true,"Config":{"ztAPI":"https://ziticontroller.horowhenua.govt.nz:443","id":null,"configTypes":null},"Status":null,"Services":null,"Metrics":{"TotalBytes":0,"Up":0,"Down":0},"ControllerVersion":"v0.27.9","MfaEnabled":false,"MfaNeeded":false,"MinTimeout":0,"MaxTimeout":0,"MfaLastUpdatedTime":"0001-01-01T00:00:00"}    
[2023-06-15T09:42:44.488Z] DEBUG    ZitiDesktopEdge.MainWindow  ==== IdentityEvent    : action:added identifer:C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json name:HDC Kelvin Work Laptop    
[2023-06-15T09:42:44.529Z] DEBUG    ZitiDesktopEdge.MainWindow  IDENTITY EVENT. Action: added identifier: C:\WINDOWS\system32\config\systemprofile\AppData\Roaming/NetFoundry/KelvinWorkLaptop.json 
[2023-06-15T09:42:44.529Z] TRACE    ZitiDesktopEdge.ServiceClient.DataClient    {"Op":"controller","Action":"disconnected","Identifier":"C:\\WINDOWS\\system32\\config\\systemprofile\\AppData\\Roaming/NetFoundry/KelvinWorkLaptop.json","Fingerprint":"KelvinWorkLaptop"} 
[2023-06-15T09:42:44.529Z] DEBUG    ZitiDesktopEdge.ServiceClient.DataClient    Controller event received

dovholuknf commented 1 year ago

That sure looks like a tight loop bug... Strange. Is the virtual box also running windows perhaps? Can you also look at the service log when this happens? Here, the UI is responding to IPC events from the tunneler running on this machine. I'm wondering if the vm is also running ZDEW or not, and I'm wondering what the service/data portion of ZDEW is doing. It's the one sending these IPC events to the UI. Still, the UI should not be growing it's memory uncontrollably. When this happens I expect you'll see one full cpu used by theziti-edge-tunnel as well.

Thanks for digging in. If you're feeling up to it, I would wonder how the preview/new UI would behave in this situation. https://github.com/openziti/desktop-edge-ui/releases/tag/3.2.3

gooseleggs commented 1 year ago

It is a Windows VM, without ziti in it. It is running a VPN client inside it. I have sent a help file through to help at openziti.... It is a bitwarden send link due to its size etc.

dovholuknf commented 1 year ago

Thanks. those logs confirm that the tunneler is sending IPC messages repeatedly and it's in a tight loop. It looks like the tunneler was last restarted on Jun 11 (the day you filed this issue) and this problem manifests immediately on startup and happens around 10 times every second "forever". I'd recommend you:

purge these log folders
restart the tunneler
see if the CPU use of the tunneler is one full CPU. (divide 100 by however many CPUs you have). I have 12 cores, so when i get into a tight loop, i see 8% CPU utilization in task manager.

Nothing changed on the network side, but did you perhaps 'forget' an identity or tear an older network down? If you look at the file in the logs you sent named ziti-tunneler.log.202306110000.log, on lines 20-22 you'll see:

[2023-06-11T20:49:14.653Z]    INFO ziti-edge-tunnel:ziti-edge-tunnel.c:1093 load_identities() loading identity file: b5.json
[2023-06-11T20:49:14.653Z]    INFO ziti-edge-tunnel:ziti-edge-tunnel.c:1093 load_identities() loading identity file: k..id.json
[2023-06-11T20:49:14.653Z]    INFO ziti-edge-tunnel:ziti-edge-tunnel.c:1093 load_identities() loading identity file: K..p.json

are those identities all expected to work properly? It seems (looking at the logs) only one identity is working? Maybe it's some kind of bug on an unused network/improperly removed identity or something like that...

If you expect all three identities to work, let's do this:

move all three identities from their location by making a 'backup' folder, and moving ALL the files at C:\Windows\System32\config\systemprofile\AppData\Roaming\NetFoundry into the backup folder. I will often make a folder at C:\Windows\System32\config\systemprofile\AppData\Roaming\NetFoundry\backup and just move them there...
restart the ZDEW, confirm things work properly, no identities are shown, memory not growing, etc.
Add back the one identity that seems to be working, this one: KelvinWorkLaptop.json
restart ZDEW, ,confirm the logs aren't going nuts
repeat that process for the other identities.

I expect one of the identities has 'gone bad' and is exposing some kind of bug

gooseleggs commented 1 year ago

Thanks. Yes it was pegging the CPU on a core. It was the 'KelvinWorkLaptop.json' that was causing the problem. I noticed that I had an identity with a long name - like GUID which was my original identity when starting to play around with Ziti. That went in, but had no services, then I found that my certs had expired on my main overlay network. Anyway, so the issue here was a bad identity. I have not deep dived further into the bad identity as my own overlay down is more important!

openziti / desktop-edge-win

Memory leak in client #605