Lancaster EPrints

What is a pilot or feasibility study?:a review of current practice and editorial policy

Arain, Mubashir and Campbell, Michael J and Cooper, Cindy L and Lancaster, Gillian (2010) What is a pilot or feasibility study?:a review of current practice and editorial policy. BMC medical research methodology, 10. p. 67. ISSN 1471-2288

[img]
Preview
PDF - Published Version
Available under License Creative Commons Attribution.

Download (414Kb) | Preview

    Abstract

    Background In 2004, a review of pilot studies published in seven major medical journals during 2000-01 recommended that the statistical analysis of such studies should be either mainly descriptive or focus on sample size estimation, while results from hypothesis testing must be interpreted with caution. We revisited these journals to see whether the subsequent recommendations have changed the practice of reporting pilot studies. We also conducted a survey to identify the methodological components in registered research studies which are described as 'pilot' or 'feasibility' studies. We extended this survey to grant-awarding bodies and editors of medical journals to discover their policies regarding the function and reporting of pilot studies. Methods Papers from 2007-08 in seven medical journals were screened to retrieve published pilot studies. Reports of registered and completed studies on the UK Clinical Research Network (UKCRN) Portfolio database were retrieved and scrutinized. Guidance on the conduct and reporting of pilot studies was retrieved from the websites of three grant giving bodies and seven journal editors were canvassed. Results 54 pilot or feasibility studies published in 2007-8 were found, of which 26 (48%) were pilot studies of interventions and the remainder feasibility studies. The majority incorporated hypothesis-testing (81%), a control arm (69%) and a randomization procedure (62%). Most (81%) pointed towards the need for further research. Only 8 out of 90 pilot studies identified by the earlier review led to subsequent main studies. Twelve studies which were interventional pilot/feasibility studies and which included testing of some component of the research process were identified through the UKCRN Portfolio database. There was no clear distinction in use of the terms 'pilot' and 'feasibility'. Five journal editors replied to our entreaty. In general they were loathe to publish studies described as 'pilot'. Conclusion Pilot studies are still poorly reported, with inappropriate emphasis on hypothesis-testing. Authors should be aware of the different requirements of pilot studies, feasibility studies and main studies and report them appropriately. Authors should be explicit as to the purpose of a pilot study. The definitions of feasibility and pilot studies vary and we make proposals here to clarify terminology.

    Item Type: Article
    Journal or Publication Title: BMC medical research methodology
    Additional Information: © 2010 Arain et al; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
    Subjects: Q Science > QA Mathematics
    Departments: Faculty of Science and Technology > Mathematics and Statistics
    ID Code: 59931
    Deposited By: ep_importer_pure
    Deposited On: 12 Nov 2012 10:07
    Refereed?: Yes
    Published?: Published
    Last Modified: 10 Apr 2014 00:18
    Identification Number:
    URI: http://eprints.lancs.ac.uk/id/eprint/59931

    Actions (login required)

    View Item