Verified against ChatGPT · 2026-08-14
Write an unmoderated usability test script that catches silent confusion, not just task completion
Writes an unmoderated usability-test script with task prompts and follow-up questions designed to surface confusion a participant powered through silently, since an unmoderated test has no facilitator there to notice a hesitation live.
The prompt
Ready to copy — highlighted parts are example details you can swap.
Write an unmoderated usability test script for the flow below. The specific risk with unmoderated testing is that there's no facilitator present to notice a participant hesitating, backtracking, or looking confused in the moment — a participant who eventually completes a task can still have been confused the whole way through, and a script that only checks "did they finish" will miss that entirely.
FLOW BEING TESTED
A redesigned settings page for managing notification preferences across email, push, and SMS.
SPECIFIC CONCERN PROMPTING THIS TEST
We're worried users won't realize SMS notifications need a separate opt-in from push notifications.
PARTICIPANT SCREENING CRITERIA
Existing users who have never changed their default notification settings.
TEST LENGTH
15 minutes, unmoderated, recorded via screen-and-audio capture.
STRUCTURE
1. Write a pre-task question that establishes the participant's expectation before they start — what do they think is about to happen — so a mismatch between expectation and reality is detectable afterward rather than only inferred from completion time.
2. Write the task prompts themselves as realistic scenarios, not literal instructions naming the UI elements to click — a prompt that says "tap the blue button" tests nothing, since it tells the participant exactly what to do instead of observing what they'd naturally try; describe the goal in the participant's own terms and let the interface do the rest.
3. After each task, write a small set of follow-up questions specifically aimed at surfacing silent confusion: what did they expect to happen when they took the key action, was there any point they weren't sure what to do next even if they figured it out, and would they have done anything differently if this weren't a test. Do not ask a generic satisfaction question here ("how would you rate this task") — a rating doesn't reveal where the hesitation happened.
4. Include an explicit instruction for the participant to think aloud, stated plainly at the start of the script, since unmoderated tests depend entirely on the participant self-reporting what a moderator would otherwise observe.
5. Tie the follow-up questions for the task most related to We're worried users won't realize SMS notifications need a separate opt-in from push notifications. directly back to that concern, phrased so they could surface disconfirming evidence, not just confirm the concern is real.
WHAT NOT TO DO
Do not write task instructions that name specific UI elements or steps. Do not write more tasks than fit comfortably in the stated test length, and do not front-load easy tasks only — include the task most related to the specific concern even if it's the hardest one.
OUTPUT FORMAT
The full script in the order above: think-aloud instruction, pre-task expectation question, then each task with its scenario prompt and follow-up questions, ending with a short debrief question set.Customize
Optional — swap in your own details for the highlighted parts above.
Why this works
A usability test script written without this constraint tends to default to instruction-style task prompts ("click the settings icon, then toggle SMS notifications on") because that reads as a clear, unambiguous test step — but a prompt that names the exact UI element being tested doesn't actually test whether a participant can find it themselves, it just checks whether they can follow directions, which is a fundamentally different and far less useful signal; describing the goal in the participant's own terms instead is what forces the interface's actual discoverability to be the thing under test. The specific risk named in the prompt — that unmoderated tests have no facilitator to catch a silent struggle — is real and well-documented in usability research: task completion rate alone conflates a participant who breezed through with one who hesitated, backtracked twice, and got there by trial and error, and both look identical in a binary completion metric. Requiring a pre-task expectation question and a post-task set specifically aimed at the moment of the key action (what did you expect, was there a point you weren't sure) gives the researcher a way to detect that gap after the fact using only self-report, which is the only signal available once there's no live observer — a generic satisfaction rating doesn't do this because a participant can rate a confusing-but-eventually-successful task highly out of relief at having finished it, masking exactly the friction the test was meant to catch. Explicitly requiring the concern-related task to be included even if it's the hardest, and phrasing its follow-up to allow disconfirming evidence, guards against the same confirmation-bias risk present in interview scripts: a test designed only to validate an existing worry will tend to produce data that validates it, unless at least one question is built with a genuine chance to show the worry is unfounded.
What you get back
Task 2 scenario: 'You just missed an important text alert from a friend and want to make sure you get text alerts for messages like that going forward. Show me how you'd set that up.' Follow-up: 'What did you expect to happen when you turned on notifications earlier in this task — did you think that already covered text messages, or did you know it was separate?' This is phrased to surface whether the participant assumed push and SMS were bundled, without stating that assumption as the expected answer.
Verified against
ChatGPT GPT-5.1 · 2026-08-14
Changelog
- 2026-08-14 — Initial publish, verified against ChatGPT GPT-5.1.
Need this built into your business?
If a prompt isn't enough — branding & design, built and maintained for you — that's Scult's day job.
EXPLORE BRANDING & DESIGN
