Kagan Tumer's Publications

Display Publications by [Year] [Type] [Topic]


Agent Partitioning with Reward/Utility-Based Impact. W. Curran, A. Agogino, and K. Tumer. In AAAI-2015 Workshop on Multiagent Interaction without Prior Coordination, Austin, TX, January 2015.

Abstract

Reinforcement learning with reward shaping is a well established but often computationally expensive approach tolarge multiagent systems. Agent partitioning can reduce this computational complexity by treating each partition of agents as an independent problem. We introduce a novel agent partitioning approach called Reward/Utility-Based Impact(RUBI). RUBI finds an effective partitioning of agents while requiring no prior domain knowledge, improves performance by discovering a non-trivial agent partitioning, and leads to faster simulations. We test RUBI in the Air Traffic Flow Management Problem (ATFMP), where there are tens of thousands of aircraft affecting the system and no obvious similarity metric between agents. When partitioning with RUBI in the ATFMP, there is a 37\% increase in performance, with a 510x speed increase over non-partitioning approaches. Additionally, RUBI matches the performance of the current domain-dependent ATFMP gold standard using no prior knowledge and with 10\% faster performance.

Download

(unavailable)

BibTeX Entry

@inproceedings{tumer-curran_aaai15_mipc,
        author = {W. Curran, A. Agogino, and  K. Tumer},
        title = {Agent Partitioning with Reward/Utility-Based Impact},
        booktitle = {AAAI-2015 Workshop on Multiagent Interaction without Prior Coordination},
	month = {January},
	address = {Austin, TX},
abstract={Reinforcement learning with reward shaping is a well established but often computationally expensive approach to
large multiagent systems. Agent partitioning can reduce this computational complexity by treating each partition of agents as an independent problem. We introduce a novel agent partitioning approach called Reward/Utility-Based Impact
(RUBI). RUBI finds an effective partitioning of agents while requiring no prior domain knowledge, improves performance by discovering a non-trivial agent partitioning, and leads to faster simulations. We test RUBI in the Air Traffic Flow Management Problem (ATFMP), where there are tens of thousands of aircraft affecting the system and no obvious similarity metric between agents. When partitioning with RUBI in the ATFMP, there is a 37\% increase in performance, with a 510x speed increase over non-partitioning approaches. Additionally, RUBI matches the performance of the current domain-dependent ATFMP gold standard using no prior knowledge and with 10\% faster performance.},
	bib2html_pubtype = {Workshop/Symposium Papers},	
	bib2html_rescat = {Multiagent Systems},
        year = {2015}
}

Generated by bib2html.pl (written by Patrick Riley ) on Tue Jun 26, 2018 19:10:42