search

tensorly / torch

TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch
http://tensorly.org/torch/
BSD 3-Clause "New" or "Revised" License
74 stars 19 forks source link

Add He and Glorot initialization for linear layers #2

Closed merajhashemi closed 3 years ago

merajhashemi commented 3 years ago

This resolves #1, also:

  1. Validates decomposed cores before initializing from
  2. Minor fixes in the docstrings.
JeanKossaifi commented 3 years ago

Thanks @merajhashemi, I was planning to add these inits. This is the goal of the init module. I think it is best to add these there and mirror PyTorch's API to make it easy for pytorch users.