Improve the fitness function

Vaarun-C commented 1 year ago

The current fitness function, defined in calc_fitness() within the Computer(Car) class in main.py, calculates fitness as velocity multiplied by time. However, this approach has several limitations:

This has several issues:

Loop Following: Cars sometimes tend to learn to follow loops, resulting in inflated distance traveled and suboptimal learning.
Slow Learning Rate: The current fitness function may lead to very slow learning progress.

Try to improve this by using a better way of calculating the fitness of the cars. You could also try penalizing the car for negative behavior. Ensure that the new fitness function is tailored to the specific requirements of our project and doesn't rely on external libraries beyond PyGame.

Acceptance Criteria:

Cars trained with the updated fitness function demonstrate improved learning behavior, including better track navigation and reduced loop following.
The solution does not rely on external libraries beyond PyGame.

Have fun :)