Multi-agent reinforcement learning for intrusion detection

Arturo Servin, Daniel Kudenko

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Intrusion Detection Systems (IDS) have been investigated for many years and the field has matured. Nevertheless, there are still important challenges, e.g., how an IDS can detect new and complex distributed attacks. To tackle these problems, we propose a distributed Reinforcement Learning (RL) approach in a hierarchical architecture of network sensor agents. Each network sensor agent learns to interpret local state observations, and communicates them to a central agent higher up in the agent hierarchy. These central agents, in turn, learn to send signals up the hierarchy, based on the signals that they receive. Finally, the agent at the top of the hierarchy learns when to signal an intrusion alarm. We evaluate our approach in an abstract network domain.

Original languageEnglish
Title of host publicationADAPTIVE AGENTS AND MULTI-AGENT SYSTEMS
EditorsK Tuyls, A Nowe, Z Guessoum, D Kudenko
Place of PublicationBERLIN
PublisherSpringer
Pages211-223
Number of pages13
ISBN (Print)978-3-540-77947-6
Publication statusPublished - 2008

Cite this