Implementation Research Outcomes: Efficacy, Effectiveness and Delivery Success
Distinguish intervention efficacy, real-world effectiveness and implementation effectiveness, and define acceptability, adoption, fidelity, cost, reach and sustainability measures.
Editorial context
Adapted and summarized by PHC-Nepal from the uploaded WHO/TDR training slides Module4_intro_Chapter_1.pdf, developed with technical support from EPFL. The upload does not establish a publication date. This is an independent educational summary, not a WHO-endorsed course or certificate. Only the introduction and Chapter 1 of Module 4 were supplied. This is a conceptual guide with illustrative measurement ideas, not the missing chapters or a validated measurement instrument.
Key points
- Efficacy, intervention effectiveness and implementation effectiveness answer different questions.
- Effective interventions can fail to improve health when delivery fails.
- Implementation, service and patient outcomes should be distinguished.
- Define the construct, measurement level, time point and data source before collecting data.
Efficacy is not delivery success
Intervention efficacy concerns effects under controlled conditions. Intervention effectiveness concerns effects under real-world conditions. Implementation effectiveness concerns the success of efforts to get an effective intervention adopted, delivered and sustained across relevant settings and populations.
A programme may use an effective intervention yet fail because it is not adopted, reaches too few people, is delivered inconsistently or stops when support ends. Health outcomes alone may not reveal which delivery process failed.
Three connected outcome levels
Implementation outcomes describe the effects of deliberate efforts to put an intervention into practice. Service outcomes concern how care functions, such as timeliness or efficiency. Patient and population outcomes concern symptoms, function or health status.
The module presents implementation outcomes as intermediate or proximal outcomes in a pathway toward service and health effects. That pathway should be examined rather than assumed: high adoption does not guarantee equitable delivery or health improvement.
Common implementation outcomes
Proctor and colleagues distinguish several constructs used in implementation research. Terms should be operationalized for the particular study rather than treated as interchangeable.
- Acceptability: whether stakeholders find the intervention or strategy agreeable.
- Adoption: the decision or action to use it.
- Appropriateness: perceived fit or relevance for a setting or need.
- Feasibility: whether it can be carried out in that setting.
- Fidelity: whether delivery follows the intended core elements.
- Implementation cost: resources required for the implementation effort.
- Penetration: integration within a service setting or subsystem; define any reach or coverage measure separately.
- Sustainability: continued delivery or use over time.
Make measurement explicit
Specify whose views or behaviour are measured, the unit of analysis, timing and data source. An acceptability interview with managers does not represent all patients. An adoption count should state eligible sites and what counts as adopting.
Use validated measures when suitable and justify adaptation or translation. Cost assessment should state perspective and whether staff time, donated resources and participant costs are included. Sustainability requires follow-up beyond an initial launch, with a clearly stated observation period.
An illustrative outcome plan
For a hypothetical new stock-review process, a team might track the proportion of eligible facilities holding the review, adherence to required steps, staff-reported feasibility, meeting-related time and continuation after pilot support. These are proposed measures, not a validated instrument or Nepal results.
Link these delivery measures with service indicators such as stock availability, while accounting for procurement changes and other influences. Report denominators, missing data, subgroup differences and unexpected harms so the findings can inform a real decision.
Sources and further reading
Use the linked institutions for current definitions, regulations, programmes and statistics.
- WHO TDR: Implementation research toolkit—Workbook (2014)
Official foundational toolkit for bottlenecks, stakeholders, questions and implementation of findings.
- Proctor et al.: Outcomes for implementation research (2011)
Conceptual distinctions and measurement of implementation outcomes.
- Proctor et al.: Implementation strategies—recommendations for specifying and reporting (2013)
Seven dimensions for specifying implementation strategies.
- Implementation Research in Health: A Practical Guide (2013)
Peters, Tran and Adam: questions, context, methods and use of findings.
Related learning note
Implementation ResearchWhat Is Implementation Research? Concepts, Scope and Three Core PhasesUnderstand implementation research, how it differs from intervention and health systems research, and how teams define problems, design strategies and test delivery in real settings.Educational notice: This article summarizes historical and public-health material. It does not replace current national protocols, clinical judgement or care from a qualified professional.