Note: will require python >3.8 to run. Please install a fresh conda environment with python >3.8, I have been using 3.8.10 locally but it should probably work with 3.9 as well.
After creating a fresh conda env, see instructions below on how to install the remaining requirements:
To setup a new environment for a project, in addition to running python setup.py install at the repo level, one would also need to call pip install -r requirements.txt at a project level
Refactoring to the run file, some changes. Initial draft, we can modify as needed:
Uses a run.py file (previously called learn.py). Parses through a config dictionary defined in experiments folder using dataclasses. Dataclasses with the default values and variable types are defined in parser.py.
Variables which are not specific to the experiment (not experiment hyperparameters) are still passed through command line - for example whether to continue an existing run, to use GPU or not, or whether to run in debugging mode. We can move those to variables experiments as well if you prefer so. Some of our projects consolidate everything into the experiments config, others have this mixed approach.
Breaks requirements into a global one plus one for each project. Reason is to isolate dependencies which are specific to each project (for example metaworld requires mujoco, which in turn requires a mujoco license; robotarm requires pybullet which might conflict with local libraries in macos). To setup a new environment for a project, in addition to running python setup.py install at the repo level, one would also need to call pip install -r requirements.txt at a project level
Removes dependency to baselines, switch to stable_baselines3. Still pending to check if all functions are the exactly the same as expected - I am specially concerned about Monitor
If needed, we can code an alternative run file that still reads from command line. If not, we can just move to using predefined configs.
@vkakerbeck please see what you think, leave your comments, and we can discuss and adjust in our next meeting. This all can be changed, or if it is too bad we don't have to merge it. Hopefully this refactor did not introduce any changes in the code that would lead to different results.
Next and final step of this refactoring I will change the folder structure of this project and multitask to match one another and also if possible be a closer match to nupic.research.
Note: will require python >3.8 to run. Please install a fresh conda environment with python >3.8, I have been using 3.8.10 locally but it should probably work with 3.9 as well.
After creating a fresh conda env, see instructions below on how to install the remaining requirements:
Refactoring to the run file, some changes. Initial draft, we can modify as needed:
parser.py.python setup.py installat the repo level, one would also need to callpip install -r requirements.txtat a project levelMonitorIf needed, we can code an alternative run file that still reads from command line. If not, we can just move to using predefined configs.
@vkakerbeck please see what you think, leave your comments, and we can discuss and adjust in our next meeting. This all can be changed, or if it is too bad we don't have to merge it. Hopefully this refactor did not introduce any changes in the code that would lead to different results.
Next and final step of this refactoring I will change the folder structure of this project and multitask to match one another and also if possible be a closer match to nupic.research.