GraphModifer return invalid ModelSpec

[Naruu]

• graph modifier requires stricter validation

• matrix, ops of below two cases may not be the same

  • matrix, ops

  • model_spec = nasbench.ModelSpec(matrix, ops) # nasbench101
    model_spec.matrix, model_spec.ops

• This is because, ModelSpec.__init__(matrix, ops) modifies matrix, ops (self._prune()) ex. delete row/colum without 1 ModelSpec.__init__(matrix, ops)

comparison between edited_model vs nasbench.ModelSpec

AS-IS

• input : matrix, ops
• validation model_spec = nasbench.ModelSpec(matrix, ops)
  1. nasbench.api.is_valid(model_spec) is True

TO-BE

• add validation model_spec = nasbench.ModelSpec(matrix, ops)
  1. nasbench.api.is_valid(model_spec) is True
  2. len(ops) == len(model_spec.ops)

@juice500ml 지난주에 reconstruction error가 높았던 것은 이것 때문 아닌가 싶습니다...!

[juice500ml]

Fixed at #13.