Kagan Tumer's Publications

Display Publications by [Year] [Type] [Topic]


Fitness Function Shaping in Multiagent Cooperative Coevolutionary Algorithms. M. Colby and K. Tumer. Journal of Autonomous Agents and Multiagent Systems, 2015. DOI: 10.1007/s10458-015-9318-0

Abstract

Coevolution is a promising approach to evolve teams of agents which must cooperate to achieve some system objective. However, in many coevolutionary approaches, credit assignment is often subjective and context dependent, as the fitness of an individual agent strongly depends on the actions of the agents with which it collaborates. In order to alleviate this problem, we introduce a cooperative coevolutionary algorithm which biases the evolutionary search as well as shapes agent fitness functions to promote behavior that benefits the system-level performance. More specifically, we bias the search using a hall of fame approximation of optimal collaborators, and shape the agent fitness using the difference evaluation function. Our results show that shaping agent fitness with the difference evaluation improves system performance by up to 50%, and adding an additional fitness bias improves performance by up to 75% in our experiments. Finally, an analysis of system performance as a function of computational cost demonstrates that this algorithm makes extremely efficient use of computational resources, having a higher performance as a function of computational cost than any other algorithm tested.

Download

(unavailable)

BibTeX Entry

@article{tumer-colby_jaamas15,
author = {M. Colby and K. Tumer},
title = {Fitness Function Shaping in Multiagent Cooperative Coevolutionary Algorithms},
journal = {Journal of Autonomous Agents and Multiagent Systems},
note={DOI: 10.1007/s10458-015-9318-0},
abstract={Coevolution is a promising approach to evolve teams of agents which must cooperate to achieve some system objective. However, in many coevolutionary approaches, credit assignment is often subjective and context dependent, as the fitness of an individual agent strongly depends on the actions of the agents with which it collaborates. In order to alleviate this problem, we introduce a cooperative coevolutionary algorithm which biases the evolutionary search as well as shapes agent fitness functions to promote behavior that benefits the system-level performance. More specifically, we bias the search using a hall of fame approximation of optimal collaborators, and shape the agent fitness using the difference evaluation function. Our results show that shaping agent fitness with the difference evaluation improves system performance by up to 50%, and adding an additional fitness bias improves performance by up to 75% in our experiments.  Finally, an analysis of system performance as a function of computational cost demonstrates that this algorithm makes extremely efficient use of computational resources, having a higher performance as a function of computational cost than any other algorithm tested.}
	bib2html_pubtype = {Journal Articles},
	bib2html_rescat = {Evolutionary Algorithms, Multiagent Systems},
year = {2015}
}

Generated by bib2html.pl (written by Patrick Riley ) on Wed Apr 01, 2020 17:39:43