stanfordnmbl / osim-rl

Reinforcement learning environments with musculoskeletal models
http://osim-rl.stanford.edu/
MIT License
896 stars 249 forks source link

Server error with submission script #207

Open d9w opened 5 years ago

d9w commented 5 years ago

I'm getting a server error when running osim-rl/examples/submission.py

ServerErrorPrint Problem compiling lock. Message: ERR Error running script (call to f_edee45c2b72388ccb07f4026672d7d82cdad23c7): @user_script:29: @user_script: 29: -OOM command not allowed when used memory > 'maxmemory'. 400
Problem compiling lock. Message: ERR Error running script (call to f_edee45c2b72388ccb07f4026672d7d82cdad23c7): @user_script:29: @user_script: 29: -OOM command not allowed when used memory > 'maxmemory'.

It appears that this is happening at the point of environment creation on the server:

In [7]: observation = client.env_create(aicrowd_token, env_id='L2M2019Env')                                                                                                                    
ServerErrorPrint Problem compiling lock. Message: ERR Error running script (call to f_edee45c2b72388ccb07f4026672d7d82cdad23c7): @user_script:29: @user_script: 29: -OOM command not allowed when used memory > 'maxmemory'. 400
An exception has occurred, use %tb to see the full traceback.

SystemExit: Problem compiling lock. Message: ERR Error running script (call to f_edee45c2b72388ccb07f4026672d7d82cdad23c7): @user_script:29: @user_script: 29: -OOM command not allowed when used memory > 'maxmemory'.

In [8]: %tb                                                                                                                                                                                    
---------------------------------------------------------------------------
ServerError                               Traceback (most recent call last)
~/.conda/envs/opensim-rl/lib/python3.6/site-packages/osim/http/client.py in env_create(self, token, env_id)
     55         try:
---> 56             resp = self._post_request(route, data)
     57         except ServerError as e:

~/.conda/envs/opensim-rl/lib/python3.6/site-packages/osim/http/client.py in _post_request(self, route, data)
     41                             data=json.dumps(data))
---> 42         return self._parse_server_error_or_raise_for_status(resp)
     43 

~/.conda/envs/opensim-rl/lib/python3.6/site-packages/osim/http/client.py in _parse_server_error_or_raise_for_status(self, resp)
     32         if resp.status_code != 200 and "message" in j:  # descriptive message from server side
---> 33             raise ServerError(message=j["message"], status_code=resp.status_code)
     34         resp.raise_for_status()

ServerError: 

During handling of the above exception, another exception occurred:

SystemExit                                Traceback (most recent call last)
<ipython-input-7-04298f56a9b4> in <module>
----> 1 observation = client.env_create(aicrowd_token, env_id='L2M2019Env')

~/.conda/envs/opensim-rl/lib/python3.6/site-packages/osim/http/client.py in env_create(self, token, env_id)
     56             resp = self._post_request(route, data)
     57         except ServerError as e:
---> 58             sys.exit(e.message)
     59         self.instance_id = resp['instance_id']
     60         self.env_monitor_start("tmp", force=True)

SystemExit: Problem compiling lock. Message: ERR Error running script (call to f_edee45c2b72388ccb07f4026672d7d82cdad23c7): @user_script:29: @user_script: 29: -OOM command not allowed when used memory > 'maxmemory'.
d9w commented 5 years ago

This is no longer an issue as of 2019-10-13. Keeping the issue open so you can investigate on the server side; I suspect that the redis server ran out of memory.

smsong commented 5 years ago

@d9w Thanks for the note