Network improvements - Githubissues

Nathan13888 / bs-lindor

Lindor... a sweet serpent, Furry, cute, yet not for feasts, Tempting, but untouched. Hardened by years of experience, in DC library :/

GNU General Public License v3.0

2 stars 0 forks source link

Network improvements #3

Open Nathan13888 opened 1 year ago

Nathan13888 commented 1 year ago

larger network: extra layers, wider layers
just use ReLU?
test different pooling methods

Nathan13888 commented 1 year ago

migrate PPO implementation
- https://iclr-blog-track.github.io/2022/03/25/ppo-implementation-details/
- https://sb3-contrib.readthedocs.io/en/master/modules/ppo_mask.html
http://incompleteideas.net/rlai.cs.ualberta.ca/RLAI/rewardhypothesis.html
https://stable-baselines.readthedocs.io/en/master/guide/pretrain.html
baysian optimizationq
BF16??
- acceleration?
- 2-3 precision problem, CNNs only?
- C++ implementation: https://stackoverflow.com/questions/5766882/why-is-there-no-2-byte-float-and-does-an-implementation-already-exist