The reparam argument is a Callable from tensors to tensors that is passed as an argument when constructing the TensorizedPC.
I was wondering which default initialization to use for layers though. At the moment parameters are initialized using a uniform distribution, which perhaps does not plays well if using a exp or softmax re-parametrization.
reparam
argument is a Callable from tensors to tensors that is passed as an argument when constructing theTensorizedPC
.I was wondering which default initialization to use for layers though. At the moment parameters are initialized using a uniform distribution, which perhaps does not plays well if using a
exp
orsoftmax
re-parametrization.Closes #80 #100.