All that glitters is not gold:on the effectiveness of cyber security qualifications

Knowles, William and Such, Jose M. and Gouglidis, Antonios and Misra, Gaurav and Rashid, Awais (2017) All that glitters is not gold:on the effectiveness of cyber security qualifications. IEEE Computer, 50 (12). pp. 60-71. ISSN 0018-9162

[thumbnail of CO_COM-2016-08-0184.R1_Such]
PDF (CO_COM-2016-08-0184.R1_Such)
CO_COM_2016_08_0184.R1_Such.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.

Download (544kB)


There has been a proliferation of industry-focused cyber security qualifications, which use different techniques to assess the competencies of cyber security professionals and certify them to employers. There is, however, a lingering question about these qualifications: do they effectively assess the competencies of cyber security professionals? 74 cyber security qualifications were analysed to determine how competency assessment is performed in practice, and five distinct techniques were identified together with the frequency of their use within qualifications. These techniques formed the basis of a large-scale survey of the perceptions of 153 industry stakeholders on the effectiveness of individual techniques and their cost-effectiveness as combinations. Despite a perceived low effectiveness of Multiple Choice Examinations, industry qualifications were found to rely on it heavily, often as a sole technique, and few qualifications utilised the cost-effective combinations identified by stakeholders.

Item Type:
Journal Article
Journal or Publication Title:
IEEE Computer
Additional Information:
©2017 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.
Uncontrolled Keywords:
ID Code:
Deposited By:
Deposited On:
06 Apr 2017 09:22
Last Modified:
19 Sep 2023 01:44