search

aqibsaeed / Genetic-CNN

CNN architecture exploration using Genetic Algorithm
Apache License 2.0
215 stars 98 forks source link

training using GA compares with BP #4

Closed EigenvectorOfFate closed 6 years ago

EigenvectorOfFate commented 6 years ago

Hello! I read the paper, you said 'It would be very interesting to incorporate the genetic algorithm to training the network structure and weights simultaneously.' Considering the genetic algorithm is computationally expensive, is it the good method to training with GA compares with BP.

aqibsaeed commented 6 years ago

Hi, I am not the author of the paper :) but your observation is correct. There is a method called NEAT that simultaneously do both things, I would suggest you to look into that. Also, this might be an interested read on evolving deep architectures. Using GA just for weight optimization is not good compare to BP that's what have been seen so far in practice.

EigenvectorOfFate commented 6 years ago

Thanks a lot.