· David Cruz · ABA Best Practices · 4 min read
ABA Program Data Analysis: What Mastery Charts Tell You and What to Review Next
Use program summaries to find the next review question, then inspect target data, criteria, and context before deciding what to change.
Key Takeaways
Program summaries help you decide where to look next; target data helps you investigate what is happening. TallyFlex brings recorded mastery counts, a cumulative mastery chart, and target comparisons together. Use that overview to focus your review, then check the observations and conditions behind the pattern.
When time is limited, it is tempting to treat a rising mastery chart as “working” and a flat one as “stalled.” Those labels skip an important distinction: a mastery chart records decisions about targets. It is not a graph of every response or proof that an intervention caused change.
Start with the Question Behind the Chart
Before interpreting a program summary, identify what you want to know:
- Which targets have recorded mastery?
- Which current objectives have evidence ready for review?
- Has target performance changed in the intended direction?
- Are follow-up observations consistent with the earlier mastery decision?
These questions require different evidence. A mastered count answers the first. The current objective’s criterion and progress help with the second. Target graphs and the collection context support the others.
What the Mastery Summary Shows
The mastered count summarizes target status. The cumulative chart groups targets by their currently saved mastery dates. Reopening a target can change the chart. A step is not simply the first moment a numerical criterion was met.
A flat section shows no additional saved mastery dates in that interval. It does not tell you why. A target may still be progressing through objectives, awaiting review, or receiving fewer collection opportunities. Open the relevant targets before choosing an explanation.
Phase and program completion need the same care. A phase can complete under an N-of-M rule while some targets remain unmastered. Finishing the program does not change those remaining targets’ status.
Read Target Performance in Context
Three useful features of a target graph are:
- Level: where values sit within the period being reviewed.
- Trend: the direction of change over time.
- Variability: how much values differ within that period.
These are starting points for review. The What Works Clearinghouse’s single-case design technical documentation also considers immediacy, overlap, and consistency across similar phases when evaluating intervention effects. A trend or mastery count alone does not establish a causal effect.
Interpret direction against the target’s measure and goal. An upward line has a different meaning for independent requests than for response latency. Also check whether the data points represent comparable opportunities, observation periods, and prompting conditions.
A program phase in TallyFlex is a group of targets. Its name or completion status does not itself define the experimental phases needed for an analysis of treatment effects.
Use Comparisons to Form Questions
The program’s target comparison chart helps you spot differences worth investigating. Before comparing lines, check the measures and units: similar-looking values can represent different kinds of performance.
| Pattern you notice | Useful next question |
|---|---|
| One target differs from the others | Are the task, opportunities, and prompt conditions comparable? |
| Several targets change together | Did collection conditions or the teaching plan change at that time? |
| Few recent observations | Was the target selected and were opportunities available? |
| Criteria met but no mastery recorded | Has someone with editing access reviewed the evidence? |
| Completed phase with unfinished targets | Was an N-of-M completion rule used? |
These are review questions, not diagnoses. They help you choose which target to open and which context to check with the collector or supervising practitioner.
Decide What to Review Before Changing the Plan
There is no universal “three to five sessions” rule that can tell you when every program needs a change. Review timing and action should follow the individual plan, the significance of the finding, and the available evidence.
The BACB’s Ethics Code for Behavior Analysts, sections 2.17–2.18, calls for using data and continually evaluating interventions. In practice, bring the target’s definition, recent observations, criterion, and relevant changes in conditions into that review.
Check calculated progress separately from recorded mastery. Correcting observations can change whether current criteria are met. A recorded mastery decision is managed separately. If the review supports reopening a target or revising objectives, make that decision explicitly and preserve the observation history.
A Focused Program Review
- Scan the summary. Note recorded mastery and any phase or program completion.
- Choose a question. Use target comparisons to identify a pattern worth investigating.
- Open the target. Check its observations, current objective, criteria, and collection context.
- Record the next action. Follow the responsible practitioner’s decision about continued collection, mastery, follow-up, or changes to the plan.
This gives the summary a useful job: helping you enter the detailed review with a clear question.
What’s Next?
- Program Analytics: understand the program review view.
- Working with Graphs: inspect individual target observations.
- Mastery Criteria and Objectives: review calculated evidence and record mastery.
