Unregister silent workers should not be called upon every timestamp

[clangenb]

It is highly inefficient like this. And in general, I think we need to revise the procedure in order to be scalable.

[brenzi]

to be replaced with lazy garbage collection