End the conversation when there is no department to add/remove

[furkansimsekli]

I just saw that my conversation has timed out even though I thought it was over because I was already subscribed to all departments.