deil87 / automl-genetic

Applying genetic programming to AutoML https://travis-ci.org/deil87/automl-genetic.svg?branch=master
12 stars 3 forks source link

How can we increase quality of solution through test cases? #34

Open deil87 opened 6 years ago

deil87 commented 6 years ago

We can choose test examples that were difficult in terms of classification.

Techniques that have been proposed to ameliorate this difficulty include shared sampling, in which test cases are chosen so as to be unsolvable by as many of the strategies in the population as possible

deil87 commented 6 years ago

shared sampling

deil87 commented 6 years ago

The motivation behind resource sharing is to promote diversity by rewarding strategies that can solve test cases that few other strategies are also able to solve. In this way strategies receive less payoff for pursuing approaches that put them into “niches” already heavily occupied.

deil87 commented 6 years ago

We can compare solutions from all individuals of the population and find those individuals that were able to find a new way towards solution for difficult cases.... and promote them into next generations.

deil87 commented 6 years ago

If the test cases are too easy, there is no strong pressure for high-performance strategies to emerge; if the test cases are too hard, then all low-performance strategies appear equally poor, reducing fitness variance, and evolution cannot proceed.