Avoid keeping a static reference to the ServiceLoader

[gsmet]

This has shown as one of the culprit for keeping class loaders around.

If this change makes sense for you, I would appreciate it being backported to the maintained branches.