Removes ref helpers and improves flag set performance

[aarondandy]

This slightly increases the suggest performance but seems to slightly decrease total check performance.