Fixed a few memory leaks

[Jonathanzhao02]

Turns out Silence stream does not work too well, and removing all listeners prevented an object from cleaning up properly.