A Survey of Methodology in Self-Adaptive Systems Research

Porter, Barry and Rodrigues Filho, Roberto and Dean, Paul (2020) A Survey of Methodology in Self-Adaptive Systems Research. In: 2020 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS). IEEE, pp. 168-177. ISBN 9781728172774

[thumbnail of main]
Text (main)
main.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.

Download (383kB)


Major research venues on autonomic and self-adaptive systems have been active for 16 years, exploring and building on the seminal vision of autonomic computing in 2003. We study the current trajectory and progress of the research field towards this vision, surveying the research questions that are asked by researchers and the methodological practice that they employ in order to answer these questions. We survey contributions under this lens across the three main venues for primary research in autonomic and self-adaptive systems work: ICAC, SASO, and SEAMS. We examine the last three years of contributions from each venue, totalling 210 publications, to gain an understanding of the dominant current research questions and methodological practice - and what this shows us about the progress of the field. Our major findings include: (i) most research questions still focus one level below the highest autonomy level vision; (ii) methodological practice is split almost evenly between real-world experiments and simulation; (iii) a high level of positive results bias exists in publications; and (iv) there are low levels of repeatability across most contributions.

Item Type:
Contribution in Book/Report/Proceedings
Additional Information:
©2020 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
ID Code:
Deposited By:
Deposited On:
16 Jul 2020 16:25
Last Modified:
21 Sep 2023 04:01