Data & BI

Verified against ChatGPT · 2026-08-14

Trace a sudden metric drop back to its actual cause instead of the first correlated event you notice

Works through a structured root-cause process for an unexplained metric drop, ruling out data artifacts and coincidental timing before committing to a causal story.

ChatGPT (GPT-5.1)4 fillable variables

The prompt

Ready to copy — highlighted parts are example details you can swap.

Investigate the metric drop described below the way a rigorous analyst would — ruling out boring explanations first, before reaching for an interesting causal story.

THE METRIC AND THE DROP
Daily active users dropped 18% starting last Tuesday and hasn't recovered

WHAT ELSE CHANGED AROUND THE SAME TIME
A new login flow shipped Monday night; also a competitor launched a promotional campaign that same week

SEGMENTS OR CUTS AVAILABLE
Can segment by platform (iOS/Android/web), by country, and by new vs. returning user

HOW URGENT THIS IS
Leadership wants an explanation in the next two hours for a stakeholder update

Work through these checks in order, and do not skip ahead to a causal explanation before ruling out the earlier, less interesting ones.

CHECK 1 — DATA ARTIFACT
Is there any chance this drop is a measurement or pipeline issue rather than a real behavior change — a tracking change, a timezone shift in how the data is bucketed, a reporting delay that makes the most recent period look artificially low because data is still landing? State explicitly whether this can be ruled out with the information given, or whether it needs to be checked before anything else in this analysis is trustworthy.

CHECK 2 — SEASONALITY OR CALENDAR EFFECT
Could this be an expected calendar pattern (day-of-week effect, a holiday, a known seasonal dip) rather than an anomaly at all? Compare against the same period in prior cycles if that comparison is possible from what's given.

CHECK 3 — SEGMENT CONCENTRATION
Using Can segment by platform (iOS/Android/web), by country, and by new vs. returning user, check whether the drop is broad-based across all segments or concentrated in one — a drop that's actually isolated to one platform, region, or user cohort has a very different likely cause than one that's uniform across everything, and averaging across segments would hide exactly this distinction.

CHECK 4 — CAUSAL CANDIDATES
Only once checks 1-3 haven't fully explained the drop, evaluate A new login flow shipped Monday night; also a competitor launched a promotional campaign that same week as possible causes, ranked by how well the timing and the segment concentration found in Check 3 actually line up with each candidate — a change that rolled out to everyone doesn't explain a drop that's concentrated in one segment, so use Check 3's finding to filter which candidates are even plausible.

WHAT NOT TO DO
Do not jump straight to the most narratively satisfying explanation from A new login flow shipped Monday night; also a competitor launched a promotional campaign that same week without first checking whether the drop is even real, seasonal, or segment-specific. Correlation in timing between the drop and a concurrent change is not sufficient on its own — state explicitly what additional evidence would confirm or rule out each causal candidate.

OUTPUT FORMAT
1. Check 1-3 results, one line each, with a clear "ruled out" or "can't rule out with current data" verdict.
2. Most likely causal candidate(s), ranked, with the specific evidence supporting each.
3. What additional data or check would confirm the leading candidate.
4. A one-line "do not act on this yet if..." caveat given Leadership wants an explanation in the next two hours for a stakeholder update.

Customize

Optional — swap in your own details for the highlighted parts above.

Why this works

Given both a metric drop and a list of things that changed at the same time, a model will naturally gravitate toward pairing them into a causal story, because a specific, named cause makes for a more satisfying and complete-sounding answer than "we're not sure yet" — this prompt counters that pull by hard-sequencing the investigation so that data-artifact and seasonality checks must be addressed and explicitly ruled out before the model is even allowed to evaluate the causal candidates, which mirrors the actual discipline good analysts apply and prevents the single most common root-cause mistake: confidently blaming a shipped feature for a drop that was actually a reporting lag or an ordinary weekly pattern. The segment-concentration check (Check 3) placed before the causal evaluation (Check 4) matters mechanically because it changes what evidence is even admissible for the later step — a company-wide login flow change cannot explain a drop that later analysis shows is isolated to one country, and running the segmentation check first means that finding actively filters which causal candidates get taken seriously, rather than the model evaluating each candidate in isolation and picking whichever fits the surface-level correlation best. Explicitly requiring the model to state what additional evidence would confirm the leading candidate — rather than stopping at a plausible-sounding story — reflects the actual epistemic status of a same-day root-cause analysis: correlation in timing is a hypothesis, not a conclusion, and treating it as settled before that confirming evidence exists is how organizations end up reverting a shipped feature that had nothing to do with the actual drop. The urgency-aware caveat at the end exists because time-pressured stakeholders often act on the first plausible story regardless of how it's hedged in the prose above it, so putting the "don't act on this yet" line as its own explicit, unmissable output item is what actually gets read under pressure.

What you get back

Check 1 (data artifact): Ruled out — pipeline shows consistent volume, no reporting lag pattern in the trailing 3 days. Check 2 (seasonality): Ruled out — same week last year shows no comparable dip. Check 3 (segment concentration): Drop is concentrated in Android, down 34%, while iOS and web are flat — this rules out the competitor campaign (which would hit all platforms) as the primary driver. Leading candidate: the new login flow, shipped Monday night, appears to have an Android-specific bug. Confirming evidence needed: Android crash logs or funnel drop-off data for the new login screen specifically. Caveat: do not attribute this to the competitor campaign in the stakeholder update — the segment data doesn't support that explanation.

Verified against

ChatGPT GPT-5.1 · 2026-08-14

Changelog

  • 2026-08-14 Initial publish, verified against ChatGPT GPT-5.1.

Need this built into your business?

If a prompt isn't enough — what Scult builds, built and maintained for you — that's Scult's day job.

EXPLORE WHAT SCULT BUILDS
All Data & BI prompts

Check your AI visibility

One URL in, a 0–100 score and the exact fixes out.

RUN THE CHECK

Browse all the tools

15 tools across six categories
13 of them never send your data anywhere

Free · No signup · No trial clock

SEE THE DIRECTORY