On Self-adaptive Resource Allocation through Reinforcement Learning

Summary, in English

Autonomic computing was proposed as a promising solution to overcome the complexity of modern systems, which is causing management operations to become increasingly difficult for human beings. This work proposes the Adaptation Manager, a comprehensive framework to implement autonomic managers capable of pursuing some of the objectives of autonomic computing (i.e., self-optimization and self-healing). The Adaptation Manager features an active performance monitoring infrastructure and two dynamic knobs to tune the scheduling decisions of an operating system and the working frequency of cores. The Adaptation Manager exploits artificial intelligence and reinforcement learning to close the Monitor-Plan-Analyze- Execute with Knowledge adaptation loop at the very base of every autonomic manager. We evaluate the Adaptation Manager, and especially the adaptation policies it learns by means of reinforcement learning, using a set of representative applications for multicore processors and show the effectiveness of our prototype on commodity computing systems.

• Author: Jacopo Panerati; Filippo Sironi; Matteo Carminati; Martina Maggio; Giovanni Beltrame; Piotr Gmytrasiewicz; Donatella Sciuto; Marco Domenico Santambrogio
• Department/s: Department of Automatic Control; ELLIIT: the Linköping-Lund initiative on IT and mobile communication
• Publishing year: 2013
• Language: English
• Pages: 23-30
• Publication/Series: NASA/ESA Conference on Adaptive Hardware and Systems (AHS), 2013
• Links: http://dx.doi.org/10.1109/AHS.2013.6604222
• Document type: Conference paper
• Publisher: IEEE - Institute of Electrical and Electronics Engineers Inc.
• Topic: Control Engineering
• Conference name: NASA/ESA Conference on Adaptive Hardware and Systems (AHS-2013)
• Conference date: 2013-06-25
• Conference place: Torino, Italy
• Status: Published
• Research group: LCCC
• ISBN/ISSN/Other: ISBN: 9781467363822