Fixes #37761 - Allow rewrites needed for cockpit integration

[adamruzicka]

A successor to https://github.com/theforeman/puppet-foreman/pull/1177 which github won't allow me to reopen.