Closed dantp-ai closed 2 years ago
Fan-in is defined to be the maximum number of inputs to a layer. The weight matrix is transposed. This means that the number of inputs are equal to the second component in the shape not the first one (0-indexing).
Fan-in is defined to be the maximum number of inputs to a layer. The weight matrix is transposed. This means that the number of inputs are equal to the second component in the shape not the first one (0-indexing).