awarelab / continual_world

79 stars 16 forks source link

a series of modifications to get the continual world up to gymnasium, recent metaworld, and the sac model running #10

Open balloch opened 6 months ago

balloch commented 6 months ago

maybe this shouldn't be pushed to main, but instead to some new feature branch like "gymnasium"?

Process for building the environment right now (tested Python 3.10):

only really tested with run_cl.py so far, and haven't tested the CL methods yet just vanilla SAC

Only real issue is that for some reason I had to comment out the @tf.function build decorators to get SAC to run which doesn't seem correct and might be environment dependent, so maybe those changes specifically shouldn't be merged. I am planning on PR for a Docker container like in Metaworld to ensure that the testing environment is more controllable