This solution has partially solved my issue, as indeed I can log out and be prompted to delete the password here. However, there's another problem.
After clicking the link once, it not only asks whether to delete the password for the currently connected server but also for every account with the same name. I have more than 20 servers saved in the system, all with the same username, hence this dialogue box keeps popping up over 20 times. I need to carefully read the content of each pop-up to make sure I'm deleting the correct password.
Originally posted by @hsyhhssyy in https://github.com/intersystems-community/intersystems-servermanager/issues/192#issuecomment-1650992172