About alpha

[andyzgj]

Hi, I have a quick question. Why all 8 cells share a same alpha?

def _initialize_alphas(self):
      k = sum(1 for i in range(self._steps) for n in range(2+i))
      num_ops = len(PRIMITIVES)

      self.alphas_normal = Variable(1e-3*torch.randn(k, num_ops).cuda(), requires_grad=True)
      self.alphas_reduce = Variable(1e-3*torch.randn(k, num_ops).cuda(), requires_grad=True)
      self._arch_parameters = [
        self.alphas_normal,
        self.alphas_reduce,
      ]

The code here looks like each cell share the same alpha. Should't each cell have a independent alpha?

[sorobedio]

according to the paper all normal cell are the same so all normal cells have the same alphas. same for the reduction cells