// SLIDE 01 — HOOK

A DRUG THAT HELPS EVERYONE BUT HURTS EVERYONE.

40%
Drug recovery (men)
vs
60%
No drug recovery (men)

Same drug, same data, opposite conclusions depending on whether you stratify by gender or aggregate across it. This is Simpson's Paradox — a real phenomenon with no statistical resolution.

NARRATION

Here's a clinical trial of a drug for some disease. Two hundred patients. Half took the drug, half didn't. Look at men alone: forty percent of drug-takers recover, sixty percent of non-takers recover. The drug is worse for men. Look at women alone: eighty percent of drug-takers recover, ninety percent of non-takers recover. The drug is worse for women. Now aggregate across everyone: seventy-six percent of drug-takers recover, sixty-three percent of non-takers recover. The drug is better for people. The drug is bad for men. The drug is bad for women. The drug is good for people. What does the drug actually do? You might think this is a trick of arithmetic. It isn't. The numbers are correct. This is a real phenomenon — Simpson's Paradox. And here's the crucial part: no statistical test ever invented can tell you what the drug does by looking at the data alone. To know what the drug does, you need one more thing. You need the causal diagram.

// SLIDE 02 — STAKES

THE SAME DATA, TWO OPPOSITE CONCLUSIONS.

Confounder PathGender affects drug choice and recovery. Stratify: drug is bad.
Mediator PathDrug lowers blood pressure, which affects recovery. Aggregate: drug is good.

The data table is identical in both cases. Only the causal structure — the diagram — tells you which variable to adjust for and whether the drug works.

NARRATION

Consider two possible diagrams, both consistent with the same data. In the first, gender is a confounder. It affects whether someone takes the drug — doctors prescribed it more to women because early evidence suggested a gender-specific effect — and gender also affects recovery because women recover more easily regardless of treatment. Gender creates spurious association between drug and recovery. The honest effect lives inside each gender group. The drug is bad. In the second diagram, the third variable is blood pressure, measured after taking the drug. The drug lowers blood pressure, and blood pressure affects recovery. Now the variable is a mediator on the causal pathway from drug to recovery. Stratifying by it destroys the very effect you're trying to measure. The honest effect is the overall one. The drug is good. Same numbers. Two diagrams. Opposite causal conclusions. This is the fundamental problem: data will never tell you which diagram is right. You have to bring the diagram to the data.

// SLIDE 03 — CONCEPT

FOUR SOURCES OF OBSERVED CORRELATION.

Treatment causes outcomeThis is what you want to know
Outcome causes treatmentReverse causation — rare in trials, common in observational studies
Something causes bothThis is confounding — creates spurious association
Conditioning creates false correlationBias from bad stratification choices

Confounding is option three: a variable that causes both the treatment and the outcome. When it exists and you don't account for it, the observed correlation is a mixture of the real causal effect and a bookkeeping artifact.

NARRATION

When you observe a correlation between two variables — say, drug and recovery — that correlation could come from several sources. First, the drug could cause recovery. This is what you want to know. Second, recovery could cause the drug. This is impossible in a trial where you recover after treatment, but in observational studies, reverse causation happens constantly. Third, something else could cause both the drug and recovery. Fourth, you could have conditioned on something you shouldn't have, manufacturing a correlation out of nothing. Confounding is the third source. A confounder is a variable that causes both the treatment and the outcome. When it exists and you don't account for it, the correlation you observe is a mixture of two things: the real causal effect and a bookkeeping artifact produced by the confounder. The artifact arises because the confounder is imbalanced between treatment groups. More women took the drug. Women recover more easily. So the drug group has more women, artificially inflating recovery rates in the drug arm.

// SLIDE 04 — CONCEPT

CONFOUNDERS, MEDIATORS, AND COLLIDERS.

ConfounderCauses both treatment and outcome. Adjust to remove bias.
MediatorLies on causal path. Don't adjust — it destroys the effect.
ColliderBoth treatment and outcome cause it. Adjusting creates bias.

These are structurally distinct in the causal diagram. Each demands a different statistical choice. Conditioning on the wrong type of variable can flip your conclusion.

NARRATION

You need to distinguish confounders from three other types of variables in the causal diagram. A confounder has arrows going into both the treatment and the outcome. It creates spurious association. You adjust for it by stratifying or controlling. A mediator is a variable that the treatment affects, which then affects the outcome. Blood pressure after drug administration is a mediator. The drug causes the change in blood pressure, which causes the change in recovery. When you adjust for a mediator, you block the very causal pathway you're trying to measure. You destroy the effect you're estimating. A collider is the opposite structure: both the treatment and the outcome have arrows pointing into it. When you condition on a variable that both treatment and outcome affect, you open a path between treatment and outcome that would otherwise be blocked. You induce an association that doesn't reflect causation. A fourth type is simply irrelevant — causally independent of treatment, outcome, and everything on the paths between them. Adjust or don't adjust. It doesn't matter. Confounders demand adjustment. Mediators forbid it. Colliders forbid it too. These distinctions are sharp in the diagram.

// SLIDE 05 — CONCEPT

D-SEPARATION DOES THE WORK.

Key fact: Two variables are causally unrelated given a set of variables if and only if they are d-separated by that set in the causal diagram.

You can read this off the graph without any data. D-separation tells you which variables to adjust for to break all non-causal paths from treatment to outcome.

NARRATION

Remember d-separation from Chapter Two. Two variables are d-separated by a set of variables if all paths between them are blocked. A path is blocked if it contains a collider on the path that isn't in the conditioning set, or if it contains a non-collider that is in the conditioning set. This is a purely graphical operation. You can do it without touching any data. Here's why it matters: if treatment and outcome are d-separated given a set of variables, then they are conditionally independent given those variables in the data. If you condition on that set — stratify by it or control for it — you remove all spurious association and isolate the causal effect. The converse is also true. If they're not d-separated given the set, conditioning won't work. There will be remaining bias. So the problem of finding a valid adjustment set becomes a purely graphical problem: find a set of variables such that treatment and outcome are d-separated given that set, with no open path going backward through confounders.

// SLIDE 06 — CONCEPT

THE BACK-DOOR CRITERION.

Identify back-door pathsPaths from treatment to outcome that enter treatment backward
Find deconfoundersVariables that block every back-door path
Verify no blockage of causal pathDon't block the front-door path or mediators on it

Apply this criterion to any causal diagram and you can identify exactly which variables to adjust for to estimate the causal effect cleanly.

NARRATION

The back-door criterion is a formal way to identify a valid adjustment set. It has three steps. First, identify all back-door paths from treatment to outcome. A back-door path is any path that enters the treatment variable from the back — it ends with an arrow pointing into the treatment. These are the non-causal paths, the ones that create confounding bias. Second, find a set of variables such that conditioning on that set blocks every back-door path. These are your deconfounders. Third, verify that conditioning on this set doesn't block the front-door causal path — the direct arrow from treatment to outcome and any mediators on the causal pathway. If you can find such a set, you have a valid adjustment. Stratify by those variables and you've removed the confounding bias. If no such set exists among the variables you observe, then you have an identification problem. No adjustment can save you. You need a different method — an instrument, a regression discontinuity, or some other causal inference method that doesn't rely on adjustment.

// SLIDE 07 — CONCEPT

STRATIFICATION IMPLEMENTS THE ADJUSTMENT.

Identify deconfoundersStratify by themEstimate effect within strata

Within each stratum, treatment is now randomized with respect to outcome. Compare outcomes across treatment groups within each stratum, then pool across strata to get the causal effect.

NARRATION

Once you've identified a valid adjustment set using the back-door criterion, you adjust by stratifying. You break the data into subgroups defined by the values of your deconfounders. Within each subgroup, the confounder is held fixed. It can't confound anymore because it's constant. Now you can compare outcomes between treated and untreated subjects, and the comparison is clean. It's like a local randomized trial within each stratum. Then you pool across strata. You compute a weighted average of the stratum-specific effects, where the weights reflect the size of each stratum or the target population you care about. This gives you the adjusted causal effect. In the drug example, you stratify by gender. Within men, the drug is worse. Within women, the drug is worse. You pool across these strata and conclude the drug is worse overall. Gender was the confounder, and stratifying by it revealed the true effect. This is the simplest and most transparent form of adjustment.

// SLIDE 08 — CONCEPT

THREE COMMON ADJUSTMENT MISTAKES.

Right adjustmentsConfounders · irrelevant variables
Wrong adjustmentsMediators · colliders · M-bias

The most costly mistakes: conditioning on a mediator destroys your effect, conditioning on a collider creates spurious association, and M-bias opens non-causal paths through a hidden confounder.

NARRATION

There are three classic adjustment mistakes. First: conditioning on a mediator. You observe that an educational program improves job outcomes. You decide to adjust for vocational skills, thinking it's a confounder. But the program works by building vocational skills. Skills are the mechanism. When you condition on skills, you block the causal pathway and the effect disappears. You conclude the program doesn't work. It does, but you've destroyed the evidence. Second: conditioning on a collider. Suppose you're studying whether depression causes job loss. You condition on whether someone sought therapy, thinking it's a confounder. But therapy is a collider: both depression and job loss cause someone to seek therapy. Conditioning on therapy opens a path between depression and job loss that would otherwise be closed. You see a spurious negative association where none exists. Third: M-bias. You have a simple causal path from treatment to outcome, mediated by nothing, confounded by nothing you've observed. But there's an unobserved variable that affects both a confounder you do observe and a collider downstream. This creates a biased path shaped like an M. Conditioning on the confounder opens this false path. You introduce bias where there was none.

// SLIDE 09 — CONCEPT

WHEN NO ADJUSTMENT SET EXISTS.

Key fact: If a back-door path cannot be blocked by any subset of observed variables, no adjustment set exists and confounding bias cannot be removed by conditioning alone.

This tells you to abandon the adjustment strategy and reach for instrumental variables, regression discontinuity, or another identification method that doesn't depend on observing all confounders.

NARRATION

Not every causal problem can be solved by adjustment. Sometimes a confounder is unobserved. You don't have the data on it, so you can't stratify or control for it. The back-door path stays open. Conditioning on other variables won't help — they don't lie on the back-door path, so they don't block it. Your adjustment set is empty. No observed variables will remove the bias. This is a diagnosis, not a dead end. It tells you that confounding adjustment won't work. You need a different strategy. You might have an instrumental variable — a variable that affects treatment but is independent of outcome except through treatment. You might have a regression discontinuity — a sharp rule that determines treatment around a threshold, allowing you to compare people just above and just below it. You might have difference-in-differences or matching or other causal inference methods that don't require conditioning on all confounders. The value of drawing the diagram and applying the back-door criterion is that it tells you when adjustment will work and when it won't. This knowledge is actionable.

// SLIDE 10 — SYNTHESIS

THE DIAGRAM DECIDES WHAT TO DO.

Same dataSimpson's Paradox. Identical numbers, opposite causal conclusions.
Different diagramConfounder vs mediator. Only causal structure resolves the ambiguity.

Data alone cannot tell you whether a variable is a confounder, mediator, or collider. The diagram is the bridge between ambiguous data and confident causal conclusions. Your judgment about the causal structure is the bottleneck.

NARRATION

Let's tie it together. You observe a correlation. You want to know if it's causal. The correlation could arise from confounding, mediation, collison, or the causal effect itself. The data cannot tell you which. You need the causal diagram. The diagram lets you apply d-separation to find the structure of paths. The back-door criterion lets you identify what to adjust for. Stratification implements the adjustment. If all back-door paths are blocked, you've isolated the causal effect. If not, you know adjustment won't work and you need another method. This is the entire reasoning loop. The data provides the correlation. The diagram provides the causal interpretation. The diagram is not something you can extract from data. It's prior knowledge — subject matter expertise, domain reasoning, prior studies. It's the thing statisticians often want to avoid because it's not in the data. But it's essential. It's the only thing that saves you from Simpson's Paradox. The diagram decides what to do. Your judgment about causation is the bottleneck in causal inference.

// SLIDE 11 — THESIS

DATA RESOLVES NOTHING; THE DIAGRAM DECIDES.

To know what a variable does to an outcome, you must know the causal structure, not just the numbers.

Simpson's Paradox is not a pathology — it is the normal state of observational data. Confounding, mediation, and collision are structural facts about the world, not statistical artifacts. Adjustment strategy follows from causal reasoning, not from data exploration.

NARRATION

This is the central claim of the chapter: data alone cannot resolve causal questions. Two datasets with identical numbers can tell opposite causal stories, depending on the underlying structure that generated them. A drug can be bad for men, bad for women, and good overall. No statistical test can tell you which conclusion is right by looking at the data. You must bring the causal diagram. The diagram tells you whether gender is a confounder you should adjust for, or a mediator you should preserve. It tells you the structure of the world. And the structure of the world determines which variable to condition on. This is not a limitation of statistics or a failure of data analysis. It is the fundamental nature of causal inference. You cannot extract causation from pattern alone. You must combine pattern with structure. The numbers show you what is correlated. The diagram shows you what is connected. Only by combining both do you know what is caused. This is why a brutalist causal inference insists on drawing the diagram before you touch the data.

// SLIDE 12 — CLOSE

CONFOUNDING AND ADJUSTMENT.

CONFOUNDING//ADJUSTMENT//CAUSAL DIAGRAMS

Causal Inference · Chapter 3 · Confounding and Adjustment

NARRATION

01 / 12
Causal Inference · Ch.3 · Nik Bear Brown