What Is Treatment Integrity?
Treatment integrity (also called procedural fidelity or treatment fidelity) refers to the degree to which an intervention is implemented as planned. It answers a fundamental question: was the treatment actually delivered correctly? Without measuring treatment integrity, behavior analysts cannot determine whether changes (or lack of changes) in behavior are due to the intervention itself or to inconsistent implementation.
Consider a scenario where a reinforcement-based intervention fails to produce improvement. Was the intervention ineffective, or was the implementer not delivering reinforcement consistently? Without treatment integrity data, there is no way to distinguish between these possibilities. This makes treatment integrity one of the most important and frequently overlooked aspects of ABA practice.
Why Treatment Integrity Matters
Clinical Decision Making
Treatment integrity data directly inform clinical decisions. When an intervention is not producing expected results, the first question should be whether the intervention is being implemented correctly. If integrity is low, the appropriate response is to improve implementation rather than changing the intervention. If integrity is high but results are poor, the intervention itself may need modification.
Without integrity data, clinicians may abandon effective interventions prematurely because they do not realize the interventions are being implemented incorrectly. Alternatively, they may continue with modifications that are unnecessary.
Internal Validity
In research contexts, treatment integrity is essential for demonstrating that the independent variable was actually present as intended. If a study claims that a particular intervention caused behavior change but does not measure whether the intervention was implemented correctly, the conclusions are weakened. The independent variable may not have been present at the level described.
Ethical Obligations
The BACB Ethics Code requires behavior analysts to use evidence-based interventions and to monitor the effectiveness of their programs. Monitoring treatment integrity is a necessary component of this obligation. Delivering a poorly implemented intervention may not only be ineffective but could also be harmful if it creates inconsistent contingencies for the client.
How to Measure Treatment Integrity
Creating Fidelity Checklists
The most common method for measuring treatment integrity is a procedural fidelity checklist. This document breaks the intervention into its component steps and provides a clear, observable description of each step. An observer watches the implementer and records whether each step was completed correctly, incorrectly, or not at all.
A good fidelity checklist includes: a clear operational definition of each step, the correct sequence of steps, decision rules for common situations, and a scoring system (such as correct, incorrect, or not applicable).
Calculating Treatment Integrity
Treatment integrity is typically reported as a percentage:
Formula: (Number of steps implemented correctly / Total number of steps) x 100
Some researchers also calculate component-level integrity, examining which specific steps are most frequently missed or implemented incorrectly. This detailed analysis helps target training efforts where they are most needed.
Frequency of Assessment
Treatment integrity should be assessed regularly throughout the course of an intervention, not just at the beginning. Implementation quality can drift over time as implementers become fatigued, distracted, or complacent. Regular assessment helps identify and correct problems before they significantly impact outcomes.
A common recommendation is to assess integrity during at least 20% to 30% of sessions, distributed across the course of the intervention.
Training Implementers
Ensuring high treatment integrity often requires systematic training of the individuals who will implement the intervention. This might include parents, teachers, classroom aides, direct care staff, or other professionals. Effective training strategies include:
- Written protocols: Provide clear, step-by-step written instructions for the intervention procedures.
- Modeling: Demonstrate the correct implementation of each step.
- Rehearsal: Have implementers practice the procedures in role-play scenarios before implementing with clients.
- Feedback: Provide specific, timely feedback on performance. This should include both praise for correct implementation and corrective feedback for errors.
- Booster training: Conduct periodic retraining sessions to address drift and maintain high levels of integrity.
Acceptable Levels of Treatment Integrity
The generally accepted standard for treatment integrity in ABA is 80% or higher, with many researchers and practitioners aiming for 90% or above. However, the acceptable level depends on the complexity of the intervention and the severity of the behavior being treated. For interventions targeting dangerous behaviors, higher integrity levels are especially critical.
Research has shown that partial implementation of an intervention often produces partial or inconsistent results. Even small deviations from the planned procedure can significantly affect outcomes, particularly for interventions that rely on precise timing or consistency of consequences.
Relationship Between Integrity and Outcomes
Multiple studies have demonstrated a positive relationship between treatment integrity and client outcomes. Higher integrity is associated with better behavior change, faster skill acquisition, and more durable outcomes. Low integrity can lead to extinction bursts that are not properly managed, intermittent reinforcement of problem behavior, and client confusion about contingencies.
This relationship underscores why measuring and maintaining treatment integrity is not merely a research requirement but a clinical necessity.
BCBA Exam Relevance
On the BCBA exam, expect questions about why treatment integrity is important, how to measure it, what to do when integrity is low, and the relationship between integrity and outcomes. You may also see scenarios where you need to identify treatment integrity as the likely explanation for poor intervention results.