Learning Science · Accessibility, preferences and individual differences
Checking whether an adaptation helps
Evaluate an adaptation through its intended effect, unintended costs and the learner’s account.
Use the examples to connect this lesson with the earlier topics. No specialist equipment is needed.
Back to the chapterAfter reading, you can
- Choose relevant before-and-after evidence.
- Interpret an adaptation result without overclaiming causality.
A change needs a question
A teacher adds captions to a video and sees more completions. That may indicate improved access, but the intended question could also concern comprehension, effort or ability to find key information. Before calling the adaptation successful, name which outcome it was meant to improve and for whom.
Gather several kinds of evidence
Observe whether the previously blocked action becomes possible. Ask the learner whether the format is usable and what still gets in the way. Check the target ability with an appropriate task. These sources can disagree: a technically navigable resource may remain exhausting, while a low score may reflect an untaught concept despite excellent access.
Keep conditions sufficiently comparable to interpret change. A harder second task, more practice, different feedback or a new teacher can affect performance. Repeated observations are usually more informative than one before-and-after score, but ordinary classroom comparisons remain limited evidence about cause.
Keep access while improving the design
Review unexpected costs. Extra descriptions may be poorly organised; too many simultaneous cues may obscure the main idea; a new tool may require training. Revise the implementation instead of assuming that the principle of access failed.
Do not withdraw essential access to create an experimental comparison. Compare acceptable alternatives or use records of task usability while maintaining needed support. The learner should understand what is being tried and how feedback will be used. A useful review produces a decision to keep, revise or supplement the adaptation and identifies the next unresolved learning need.
| Evidence | Interpretation to investigate | Next action |
|---|---|---|
| Series can now be identified | The distinction became accessible in this task | Retain labels/patterns |
| Labels overlap when enlarged | Layout still blocks comfortable use | Reposition labels and offer a table |
| A comparison answer is still wrong | A conceptual or reading error may remain | Ask for reasoning on a fresh accessible graph |
Worked example
Reviewing an alternative graph format
A new graph format lets a learner identify series, but labels overlap under magnification. What should the review retain and revise?
- A learner previously could not distinguish lines. After labels and line patterns are added, the learner can identify each series and answer a comparison question. The learner reports that labels overlap at high magnification. The teacher keeps the new distinctions, changes the layout and supplies a table. A fresh graph checks interpretation. The evidence supports improved access to series identity while leaving layout and conceptual inference as separate questions.
- Agree on a review point that gives the adaptation a reasonable trial. One unfamiliar attempt may reflect learning to use the new format; repeated failure should not be ignored indefinitely. The review can identify an implementation problem, a remaining access barrier or a separate content gap. Those interpretations lead to different changes and should not be merged into one success label.
Keep the useful series distinctions, repair the layout and offer the table. Check a fresh graph and the learner’s experience rather than merging access and conceptual understanding into one score.
Try it yourself
Think through each question before opening the answer.
Why combine the learner’s account with performance?
Show the answer and reasoning
A score does not reveal all access costs or practical barriers. The account helps locate problems, while a relevant task shows what can be done.
Usability, effort and comprehension are different outcomes. A relevant performance task and the learner’s account supply complementary evidence about the changed conditions.
A score rises after an adaptation. Can the whole rise be attributed to it?
Show the answer and reasoning
Not automatically. Practice, task differences and other changes may contribute. Describe the conditions and use repeated suitable evidence before a strong causal claim.
The second score can differ because of practice, task difficulty or other changes. Repeated comparable evidence can guide a practical decision while remaining limited causal evidence.
What to carry forward
- Evaluate the adaptation’s particular job and its practical costs.
- Keep needed access and revise the implementation from evidence.
References
Sources supporting the explanations and learning checks in this lesson.