Learning Science · Evaluating emerging learning tools

AI-generated explanations and feedback that need checking

Use generated explanations as material to inspect, while checking claims and preserving the learner’s reasoning.

Use the examples to connect this lesson with the earlier topics. No specialist equipment is needed.

After reading, you can

Identify which parts of generated feedback require verification.
Check a mathematical explanation through independent reasoning.
Use feedback to revise an attempt rather than copy an answer.

Fluent language is not verification

An AI system can produce an explanation that reads smoothly and still contains a false premise, an invalid step or a reference that does not support the claim. The useful question is which parts can be independently checked. A confident tone is not evidence of correctness.

Begin with the learner’s task and attempt. Ask for feedback on a particular step or distinction. A long replacement answer may conceal the original misunderstanding and reduce the opportunity to practise the target skill.

Verify the consequential pieces

For a calculation, identify the quantities, units, assumptions and operations. Recalculate independently and test a boundary case. For a factual claim, inspect an appropriate source rather than accepting a generated citation. For a writing judgement, connect the comment to the audience, purpose and actual text.

The checking burden depends on the consequence. If neither the learner nor an available trusted reference can verify a technical explanation, seek qualified help. Do not turn uncertainty into approval simply because an output is well formatted.

A counterexample can reveal a bad rule

Suppose a generated explanation says that multiplying two positive numbers always makes a number larger. The statement fails for numbers between zero and one: 0.5 × 0.5 = 0.25. The correction needs conditions, not just a different answer.

Ask the learner to explain why the counterexample matters and to state a more precise rule. The activity practices mathematical reasoning. Merely pasting the corrected sentence into notes would provide less evidence of that capability.

Check what remains when the help is removed

After using verified feedback, ask for a revised explanation and a new problem. Specify whether the tool is available. A good tool-assisted product and independent understanding are different outcomes and both can be valuable when aligned with the goal.

Protect personal information and use arrangements appropriate to the learning setting. General guidance on human agency and verification informs design; it does not establish that every AI product or prompt improves learning.

Worked example

Repairing a misleading percentage explanation

How can a learner independently check the claim that a 20% rise followed by a 20% fall restores the starting amount?

A generated response claims that raising 100 by 20% and then lowering the result by 20% returns to 100. The learner calculates 100 × 1.2 = 120, then 120 × 0.8 = 96. The second percentage uses a different base.
The learner writes that explanation and checks a fresh starting amount. This directly verifies the arithmetic and the underlying relationship, without relying on agreement from another generated response.

From 100, the rise adds 20 to give 120. The fall is 20% of 120, or 24, leaving 96. Multiplying by 1.2 and then 0.8 gives 0.96 of any positive starting amount.

A changed percentage base changes the result

Start at 100. Increasing by 20% of 100 adds 20, giving 120. Decreasing by 20% of the new 120 subtracts 24, giving 96. The combined factor is 1.2 × 0.8 = 0.96. The same percentage is applied to different bases, so the amounts added and removed differ.

Try it yourself

Think through each question before opening the answer.

Why is asking the same system “Are you sure?” insufficient verification?
Show the answer and reasoning
The second response may repeat or rationalise the same error. Independent calculation, an inspected source or qualified review is needed for the relevant claim.
A second fluent response may use the same false premise or repeat the same source error. Verification must connect to arithmetic, a supporting inspected source or competent review independent of that unsupported assertion.
What should follow a verified correction if the goal is learning?
Show the answer and reasoning
A learner-produced revision and a suitable fresh task, so the reasoning is used rather than merely copied.
Revision and a fresh task make the learner use the corrected relationship. A copied correction alone leaves it unclear whether the learner can choose the proper base or detect the original mistake.

What to carry forward

Inspect claims, steps and references independently.
Use counterexamples and boundary checks where appropriate.
Evaluate the learner’s reasoning after feedback.

References

Sources supporting the explanations and learning checks in this lesson.