Closed huang6668 closed 1 year ago
import tianshou, gymnasium as gym, torch, numpy, sys print(tianshou.__version__, gym.__version__, torch.__version__, numpy.__version__, sys.version, sys.platform)
I tried to replace the preprocess_net of the Actor and Critic networks in the DIscreteSAC algorithm with a convolutional neural network instead of an MLP, but I failed. Is there an example to guide me to continue?
You could have a look at the atari examples, there the nets are built with convolutional layers
Thanks for your answer.
I tried to replace the preprocess_net of the Actor and Critic networks in the DIscreteSAC algorithm with a convolutional neural network instead of an MLP, but I failed. Is there an example to guide me to continue?