Reinforcement learning approaches to coordination in cooperative multi-agent systems

S Kapetanakis, D Kudenko, M J A Strens

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We report on an investigation of reinforcement learning techniques for the learning of coordination in cooperative multi-agent systems. Specifically, we focus on two novel approaches: one is based on a new action selection strategy for Q-learning [10], and the other is based on model estimation with a shared action-selection protocol. The new techniques are applicable to scenarios where mutual observation of actions is not possible.

To date, reinforcement learning approaches for such independent agents did not guarantee convergence to the optimal joint action in scenarios with high miscoordination costs. We improve on previous results [2] by demonstrating empirically that our extension causes the agents to converge almost always to the optimal joint action even in these difficult cases.

Original languageEnglish
Title of host publicationADAPTIVE AGENTS AND MULTI-AGENT SYSTEMS
EditorsE Alonso, D Kudenko, D Kazakov
Place of PublicationBERLIN
PublisherSpringer
Pages18-32
Number of pages15
ISBN (Print)3-540-40068-0
Publication statusPublished - 2003

Cite this