rddy / mimi

Code for the paper, "First Contact: Unsupervised Human-Machine Co-Adaptation via Mutual Information Maximization"
MIT License
23 stars 2 forks source link

rollout_policy LunarLander #1

Closed guyko81 closed 2 years ago

guyko81 commented 2 years ago

running the lander notebook I got an error:

---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
<ipython-input-14-f979eb03d797> in <module>
      4   gp_min_kwargs=gp_min_kwargs,
      5   ep_kwargs=ep_kwargs,
----> 6   reward_model_train_kwargs=mi_model_train_kwargs
      7 )

~\anaconda3\envs\mimienv\lib\site-packages\mimi\opt.py in run(self, n_pols, n_steps_per_pol, n_eps_per_pol, gp_min_kwargs, ep_kwargs, reward_model_train_kwargs)
     80       self.param_bounds,
     81       n_calls=n_pols,
---> 82       **gp_min_kwargs
     83     )
     84     policy = self.policy_from_params(res.x)

~\anaconda3\envs\mimienv\lib\site-packages\skopt\optimizer\gp.py in gp_minimize(func, dimensions, base_estimator, n_calls, n_random_starts, n_initial_points, initial_point_generator, acq_func, acq_optimizer, x0, y0, random_state, verbose, callback, n_points, n_restarts_optimizer, xi, kappa, noise, n_jobs, model_queue_size)
    266         n_restarts_optimizer=n_restarts_optimizer,
    267         x0=x0, y0=y0, random_state=rng, verbose=verbose,
--> 268         callback=callback, n_jobs=n_jobs, model_queue_size=model_queue_size)

~\anaconda3\envs\mimienv\lib\site-packages\skopt\optimizer\base.py in base_minimize(func, dimensions, base_estimator, n_calls, n_random_starts, n_initial_points, initial_point_generator, acq_func, acq_optimizer, x0, y0, random_state, verbose, callback, n_points, n_restarts_optimizer, xi, kappa, n_jobs, model_queue_size)
    297     for n in range(n_calls):
    298         next_x = optimizer.ask()
--> 299         next_y = func(next_x)
    300         result = optimizer.tell(next_x, next_y)
    301         result.specs = specs

~\anaconda3\envs\mimienv\lib\site-packages\mimi\opt.py in cost_of_policy_params(self, policy_params)
     51   def cost_of_policy_params(self, policy_params):
     52     policy = self.policy_from_params(policy_params)
---> 53     rollouts = utils.rollout_policy(
     54       policy,
     55       self.env,

AttributeError: module 'mimi.utils' has no attribute 'rollout_policy'
rddy commented 2 years ago

Apologies, should be fixed now