### Abstract

We show that when XCS is applied to complex real-valued problems, the XCS populations contain structural information. This information exists in the underlying classifier space as the degree of uncertainty associated to the problem space. Therefore, we can use structural information to improve the overall system performance. We take an information theoretic approach, introducing a new entropy model for XCS to extract the structural information from dynamically forming substructures. Using this entropy model, we can collectively emphasize or de-emphasize the effect of an individual input. For a complex problem domain, we chose the speaker identification (SID) problem. The SID problem challenges XCS with a complex problem space that may force the learning classifier system to evolve large and highly overlapping population. The entropy model improved the system performance up to 5-10% in large-set SID problems. Furthermore, the entropy model has the ability to assist the population initialization in the beginning of the learning process by assuring a certain level of overall diversity.

Original language | English (US) |
---|---|

Title of host publication | Proceedings of the 11th Annual Genetic and Evolutionary Computation Conference, GECCO-2009 |

Pages | 1283-1290 |

Number of pages | 8 |

DOIs | |

State | Published - Dec 31 2009 |

Event | 11th Annual Genetic and Evolutionary Computation Conference, GECCO-2009 - Montreal, QC, Canada Duration: Jul 8 2009 → Jul 12 2009 |

### Publication series

Name | Proceedings of the 11th Annual Genetic and Evolutionary Computation Conference, GECCO-2009 |
---|

### Other

Other | 11th Annual Genetic and Evolutionary Computation Conference, GECCO-2009 |
---|---|

Country | Canada |

City | Montreal, QC |

Period | 7/8/09 → 7/12/09 |

### Keywords

- Information theory
- Learning classifier systems
- Speaker identification

### ASJC Scopus subject areas

- Computational Theory and Mathematics
- Theoretical Computer Science

## Fingerprint Dive into the research topics of 'New entropy model for extraction of structural information from XCS population'. Together they form a unique fingerprint.

## Cite this

*Proceedings of the 11th Annual Genetic and Evolutionary Computation Conference, GECCO-2009*(pp. 1283-1290). (Proceedings of the 11th Annual Genetic and Evolutionary Computation Conference, GECCO-2009). https://doi.org/10.1145/1569901.1570073