-
Hi Team, Thanks for creating such wonderful notebooks and examples. 😊
I have successfully trained a model(For movie lens data) using a training script mentioned in the example section(https://github.…
-
Hi @yundiqian. I was skimming through the hyperparams of https://github.com/google/ml-compiler-opt/blob/main/compiler_opt/rl/inlining/gin_configs/ppo_nn_agent.gin and it seems counterintuitive to me t…
-
I've been trying to apply the latest ppo example from:
https://github.com/tensorflow/agents/tree/master/tf_agents/experimental/examples/ppo/schulman17
From my understanding of Schulman 2017 the pp…
-
Hello, I am trying to setup the project in my own system. I am not using Docker since my mujoco key ist not valid for that. I have Ubuntu 18.04 and installed CUDA 10.0 and cudnn 7.6.5. However I am g…
-
Hello,
in Tutorial 8: Networks, there's a faulty link to Keras' network.py in the section Defining Networks. I am not sure how this bug came about but my guess is that Keras removed this API/file/w…
-
I try to implement getting the second order gradient by tf_agent.
The reason why I do second order gradient is came from meta-learning algorithm [MAML](https://arxiv.org/abs/1703.03400).
First I c…
-
I am getting this error while trying to create a custom environment and feed it to the DQN agent.
**ValueError: Only scalar actions are supported now, but action spec is: BoundedTensorSpec(shape=(…
-
I used [save](https://github.com/tensorflow/agents/blob/c584e7642fbb45df79ab78dc8884248871e14f3e/tf_agents/utils/common.py#L1026) in [tf_agents.utils.common.Checkpointer ](https://github.com/tenso…
-
I met a similar problem with #963, when I was trying to run the last part in tutorial04_visualize.ipynb.
!python ../flow/visualize/visualizer_rllib.py data/trained_ring 20 …
-
I am building a PPO agent side by side with the [TF-Agents DQN tutorial](https://colab.research.google.com/github/tensorflow/agents/blob/master/docs/tutorials/1_dqn_tutorial.ipynb#scrollTo=wr1KSAEGG4h…