Pilot experiment
{{Short description|Small scale preliminary study}}
{{redirect|field testing|other topics|field test (disambiguation)}}
A pilot experiment, pilot study, pilot test or pilot project is a small-scale preliminary study conducted to evaluate feasibility, duration, cost, adverse events, and improve upon the study design prior to performance of a full-scale research project.{{cite journal | vauthors = Thabane L, Ma J, Chu R, Cheng J, Ismaila A, Rios LP, Robson R, Thabane M, Giangregorio L, Goldsmith CH | display-authors = 6 | title = A tutorial on pilot studies: the what, why and how | journal = BMC Medical Research Methodology | volume = 10 | issue = 1 | pages = 1 | date = January 2010 | pmid = 20053272 | pmc = 2824145 | doi = 10.1186/1471-2288-10-1 | doi-access = free }}{{cite journal | vauthors = Lewis M, Bromley K, Sutton CJ, McCray G, Myers HL, Lancaster GA | title = Determining sample size for progression criteria for pragmatic pilot RCTs: the hypothesis test strikes back! | journal = Pilot and Feasibility Studies | volume = 7 | issue = 1 | pages = 40 | date = February 2021 | pmid = 33536076 | pmc = 7856754 | doi = 10.1186/s40814-021-00770-x | doi-access = free }}
Implementation
Pilot experiments are frequently carried out before large-scale quantitative research, in an attempt to avoid time and money being used on an inadequately designed project. A pilot study is usually carried out on members of the relevant population. A pilot study is used to formulate the design of the full-scale experiment which then can be adjusted. The pilot study is potentially a critical insight to clinical trial design,
recruitment and sample size of participants, treatment testing, and statistical analysis to improve the power of testing the hypothesis of the study. Analysis from the pilot experiment can be added to the full-scale (and more expensive) experiment to improve the chances of a clear outcome.
Applications
In sociology, pilot studies can be referred to as small-scale studies that will help identify design issues before the main research is done. Although pilot experiments have a well-established tradition, their usefulness as a strategy for change has been questioned, at least in the domain of environmental management.{{cite journal | vauthors = Billé R, Duchemin B | title = Action without change? On the use and usefulness of pilot experiments in environmental management. | journal = SAPIEN. Surveys and Perspectives Integrating Environment and Society. | date = February 2010 | volume = 4 | issue = 1 | url = http://sapiens.revues.org/index979.html }} Extrapolation from a pilot study to large scale strategy may not be assumed as possible, partly due to the exceptional resources and favorable conditions that accompany a pilot study.
In clinical research, studies conducted in preparation for a future randomized controlled trial are known as "pilot" and "feasibility" studies, where pilot studies are a subset of feasibility studies.{{cite journal | vauthors = Leon AC, Davis LL, Kraemer HC | title = The role and interpretation of pilot studies in clinical research | journal = Journal of Psychiatric Research | volume = 45 | issue = 5 | pages = 626–629 | date = May 2011 | pmid = 21035130 | pmc = 3081994 | doi = 10.1016/j.jpsychires.2010.10.008 }} A feasibility study asks whether the study should proceed, and if so, how. A pilot study asks the same questions, but also has a specific design feature: in a pilot study, a future study is conducted on a smaller scale,{{cite journal | vauthors = Eldridge SM, Lancaster GA, Campbell MJ, Thabane L, Hopewell S, Coleman CL, Bond CM | title = Defining Feasibility and Pilot Studies in Preparation for Randomised Controlled Trials: Development of a Conceptual Framework | journal = PLOS ONE | volume = 11 | issue = 3 | pages = e0150205 | date = 2016 | pmid = 26978655 | pmc = 4792418 | doi = 10.1371/journal.pone.0150205 | bibcode = 2016PLoSO..1150205E | doi-access = free }} which, if having produced positive results, may lead to a Phase I clinical trial.{{cite web |title=The drug development process: Step 3: Clinical research |url=https://www.fda.gov/patients/drug-development-process/step-3-clinical-research |publisher=US Food and Drug Administration |access-date=29 March 2021 |date=4 January 2018}}{{dead link|date=May 2025|bot=medic}}{{cbignore|bot=medic}} The use of pilot and feasibility studies to estimate treatment effect is controversial, with ongoing methodologic discussion about appropriateness.{{cite journal | vauthors = Sim J | title = Should treatment effects be estimated in pilot and feasibility studies? | journal = Pilot and Feasibility Studies | volume = 5 | issue = 1 | pages = 107 | date = December 2019 | pmid = 31485336 | pmc = 6712606 | doi = 10.1186/s40814-019-0493-7 | doi-access = free }}
A checklist was published in 2016 to provide guidance on how to report pilot trials.{{cite journal | vauthors = Eldridge SM, Chan CL, Campbell MJ, Bond CM, Hopewell S, Thabane L, Lancaster GA | collaboration = PAFS Consensus Group | title = CONSORT 2010 statement: extension to randomised pilot and feasibility trials | journal = BMJ | volume = 355 | issue = | pages = i5239 | date = October 2016 | pmid = 27777223 | pmc = 5076380 | doi = 10.1136/bmj.i5239 }}
In engineering, a pilot trial may be conducted to understand the design problems, learn the correct technique’s or to capture unknown requirements prior to building a prototype. It may use prototype parts or simply samples to see which are successful and which are not, prior to more significant development effort. A pilot can typically be differentiated from a prototype by being significantly different in build, if not in function i.e. it is not intended to be developed into the end product, but to learn how to design and build the end product successfully.