Fertility During Learning in Evolutionary Robot Systems

abstract

Robot evolution systems in which bodies and brains evolve in tandem can be significantly improved by extending them with the ability to learn. Technically, this means that 'newborn' robots are given the opportunity to optimize their inherited brain to control the inherited body adequately. Robots are in an underdeveloped 'infant' stage during this learning stage since their brains and fitness are still being improved. An open issue with regard to this infancy period is that of 'fertility': Should the robot be eligible for mating during the learning stage? This paper explores two distinct approaches from the literature, based on the Triangle of Life (TOL) model, where infant robots cannot produce offspring, and the Morphological Innovation Protection (MIP) mechanism, where they can. The main contribution is a new algorithm, TOL with infant fertility (TOL+IF), inspired by MIP. Experimental comparisons with TOL and MIP show that the new method is superior. TOL+IF is successful not only in producing robots with much higher fitness but also in maintaining the population diversity at higher levels and in evolving different interesting morphologies.