[Feature Request] More details about how to DIY users' local environments and modify default configs of environments in documentation and README.

[muchvo]

Required prerequisites

• [X] I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
• [X] Consider asking first in a Discussion.

Motivation

Consider add more details about how to DIY local environments and modify default configs of environments in documentation and README.

Solution

No response

Alternatives

No response

Additional context

Just like this in safety-gym:

[zmsn-2077]

These changes have been made and the issue will now be closed.