No rigidBody to remove if physx not initialized

[vincentfretin]

This fixes regression, my fix https://github.com/diarmidmackenzie/christmas-scene/pull/3 was missing.