Remy, Christian and Bates, Oliver Emile Glaves and Dix, Alan and Thomas, Vanessa and Hazas, Michael David and Friday, Adrian John and Huang, Elaine (2018) Evaluation beyond Usability : Validating Sustainable HCI Research. In: CHI '18 Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems :. ACM, New York. ISBN 9781450356206
paper2342.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.
Download (682kB)
Abstract
The evaluation of research artefacts is an important step to validate research contributions. Sub-disciplines of HCI often pursue primary goals other than usability, such as Sustainable HCI (SHCI), HCI for development, or health and wellbeing. For such disciplines, established evaluation methods are not always appropriate or sufficient, and new conventions for identifying, discussing, and justifying suitable evaluation methods need to be established. In this paper, we revisit the purpose and goals of evaluation in HCI and SHCI, and elicit five key elements that can provide guidance to identifying evaluation methods for SHCI research. Our essay is meant as a starting point for discussing current and improving future evaluation practice in SHCI; we also believe it holds value for other subdisciplines in HCI that encounter similar challenges while evaluating their research.