RLE-Foundation / rllte

Long-Term Evolution Project of Reinforcement Learning
https://docs.rllte.dev/
MIT License
467 stars 86 forks source link

Added Option for Kaiming He Layer Initialization #53

Open Zach-Attach opened 2 weeks ago

Zach-Attach commented 2 weeks ago

Added a third layer initialization option of kaiming he

Description

Add a third option for weight_init as 'kaiming he' (see https://pytorch.org/docs/stable/nn.init.html and https://arxiv.org/pdf/1803.08494).

Motivation and Context

This change adds additional option for layer initialization, providing more options for the user. In my personal work, I have found this to perform better than orthogonal.

closes #51

Types of changes

Checklist

Note: You can run most of the checks using make commit-checks.

Note: we are using a maximum length of 127 characters per line