[RLlib] Ape-X DQN with custom first part net

ray-project / ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

https://ray.io

Apache License 2.0

33.01k stars 5.59k forks source link

[RLlib] Ape-X DQN with custom first part net #14088

Closed Jogima-cyber closed 3 years ago

Jogima-cyber commented 3 years ago

Hi there, and thanks for this beautiful RL library ! I would like to use a residual convolutional network with batch normalization (written using pytorch) as first part of the network in an Ape-X DQN model. I’ve seen in the doc and in the examples how to create and register a custom model. However it is not clear whether my custom model will then be added a DQN head with dueling and other network related DQN advancement (if I’ve set them in the config) or if I have to implement them as part of my custom model.

stale[bot] commented 3 years ago

Hi, I'm a bot from the Ray team :)

To help human contributors to focus on more relevant issues, I will automatically add the stale label to issues that have had no activity for more than 4 months.

If there is no further activity in the 14 days, the issue will be closed!

If you'd like to keep the issue open, just leave any comment, and the stale label will be removed!
If you'd like to get more attention to the issue, please tag one of Ray's contributors.

You can always ask for help on our discussion forum or Ray's public slack channel.

stale[bot] commented 3 years ago

Hi again! The issue will be closed because there has been no more activity in the 14 days since the last message.

Please feel free to reopen or open a new issue if you'd still like it to be addressed.

Again, you can always ask for help on our discussion forum or Ray's public slack channel.

Thanks again for opening the issue!