Andrew Gelman’s Hero System

Andrew Gelman built a heroic life out of refusal. Most men earn their standing by claiming, the bold result, the clean finding, the story that lands. Gelman earns his by declining to claim more than the numbers will bear. His whole authority rests on a discipline that sounds like the opposite of ambition, the insistence on saying only what the data support and stopping there, on the wide interval where others draw the confident line, on the model that might be wrong and the result that might be noise. He made himself the conscience of the empirical sciences by becoming the man who will not oversell, and in a culture that pays for confidence, the refusal to oversell is the rarest thing on the table.

What he built is the garden of forking paths. Jorge Luis Borges (1899-1986) supplied the image. A scientist gathers his data, looks at it, makes a chain of reasonable choices about what to keep and what to drop and which pattern to chase, and each choice is defensible and the chain together delivers a finding that means nothing, a certainty manufactured in good faith. No fraud. Just a man walking the branching paths in real time, led by the data toward the result the data happened to suggest, calling the arrival knowledge. That is Gelman’s terror, the honest self-deception, the false certainty wearing the face of science. His hero is the man who does not fool himself, and the harder feat folded inside it, the man who builds the tools that would catch him fooling himself and then runs them on his own work.

Here is where he parts from most of his peers. The others reach their authority by subtraction, the claim to have stripped the bias and the faith and the construction away to leave the clean residue, reality with the error removed. Gelman denies there is a clean residue. The whole of his method holds that you never reach the bare truth, you reach a range, a posterior, a model that knows something and not everything. Partial pooling, his signature move, refuses both the lie that all cases are the same and the lie that each stands alone, and settles in the honest middle where the data inform you without delivering you certainty. The wide interval is not timidity. It is the true width of what can be known, drawn to scale. Where the deflators say here is the world with the illusions gone, Gelman says here is the world with the uncertainty kept in the picture, because leaving it out is the deepest illusion of all.

Ernest Becker (1924-1974) named the work every man’s creed performs, the holding-off of death through service to something that outlasts him. Gelman’s something is the self-correcting record, the slow public machine by which inquiry catches its own errors and grinds toward truth across the generations. His methods, his students, the norms he pressed on a generation, these go on after him, and the going-on is his answer to the grave. The story his life tells is that science is fragile and precious, that the replication crisis threatened to rot it, and that his criticism defended a thing larger and more lasting than any career. A reductive reader will say the story is a cover, that under the talk of integrity sits the ordinary fear of slipping down the ladder. The reductive reader has not earned the claim. Becker’s point was never that the immortality project masks a baser motive. The project is how the motive lives in an animal that knows it will die. The hunger for significance and the love of the enterprise are not two things, one real and one decorative. They are the same hunger, and to call the nobler name a disguise is to claim a knowledge of another man’s heart that no evidence supplies, which is the one move Gelman spent his life teaching us to distrust.

Sit with that. To deflate Gelman, to announce that his integrity is status anxiety dressed for church, is to do the exact thing his whole career condemns. It is a finding with no power behind it, a confident story reverse-engineered from a man’s success, the garden of forking paths run on a biography instead of a dataset. You can always find the path that makes the honest man look like a careerist, the way you can always find the subgroup that turns the null result significant. Gelman taught the field to ask what we would believe if the study had come out the other way. Ask it here. Had the disintermediation never come, had his kind of science kept its grip on public belief, no one would read his integrity as a cover for status fear, because there would be no falling status to explain it by. The deflation depends on the outcome it pretends to diagnose. By his own time-reversal test it fails. The honest reading grants him the uncertainty he granted the world and takes the man at his word until the evidence says otherwise, and the evidence does not.

The cost is real, and he sees it more clearly than any critic could. He won the war he fought. Inside the academy the reforms took, the pre-registration and the open data and the death of the lonely underpowered study waved through on a lucky p-value. And the victory arrived as the ground gave way beneath it. The bridge from rigorous research to public belief, the science journalism and the popularizers and the lectures that once carried findings from the lab to the living room, gives way, and into the gap pour the direct-to-audience health influencers who need no credential and answer to no review, whose authority is reach and warmth and the parasocial trust of millions. Gelman perfected the instrument and the concert hall emptied. He is right inside a house whose writ no longer runs where most people form their beliefs. His March reply names this without flinching, the reform of the science and the ruin of the channel that made the science count, and a lesser man would have told himself a happier story.

A quieter cost sits beneath that one. The discipline that forbids overclaiming forbids the verdict too, the meaning, the thing a frightened public wants. A man deciding how to live, whether to fear the diagnosis or take the supplement or trust the shot, comes to Gelman and receives a probability interval and a warning that the study was underpowered, which is the truth and is not the bread he came for. The influencer hands him certainty and a plan. Gelman hands him the honest width of the unknown. The honest width is worth more and feels like less, and in a market for feeling, the man who sells the truth about uncertainty is selling the one thing the frightened animal is built to refuse.

The others in this gallery have a blind spot they cannot find. Gelman is the strange case who sees nearly the whole board, the square his own king stands on included. He runs the skepticism on himself, corrects his own old work, names the obsolescence creeping toward his method without dressing it as another man’s fault. The cut is not that he fails to see. The cut is that seeing does not save him. Rigor cannot manufacture the public trust that rigor once earned, and the virtue that built the bridge holds no tool to rebuild it after the culture stops prizing the virtue. He can describe the washing-out of the road with perfect accuracy. He cannot pave it with description.

So the figure stands, the honest accountant of what can be known, the man who made restraint heroic in a field that rewards the confident lie, and who turned his skepticism on himself when the others turned theirs only outward. His hero is the un-self-deceived inquirer. His immortality is the self-correcting record. He is doing the most honest work in the building. The building empties. He keeps the books straight anyway, which is either the last virtue or the first one, and is in any case the only one he was ever willing to claim.

About Luke Ford

My work has been covered in the New York Times, the Los Angeles Times, and on 60 Minutes. I teach Alexander Technique in Beverly Hills (Alexander90210.com).
This entry was posted in Andrew Gelman. Bookmark the permalink.