Closed peterjliu closed 4 years ago
g should be initialized with ones and b with zeros. Looks like an accidental swap. Otherwise, this layer starts out outputting 1 instead of x.
g should be initialized with ones and b with zeros. Looks like an accidental swap. Otherwise, this layer starts out outputting 1 instead of x.