avoid finalizer, may destabilize the GC

[arnetheduck]

forgot about https://github.com/nim-lang/Nim/issues/4851 when writing it

generally, will only be a problem if threads are created and destroyed often