So You Want To Be A Truth-Optimizer?

The first and hardest thing is learning to tolerate uncertainty without rushing to fill it. Most people reach for an explanation the moment something confuses them, and the first explanation that feels satisfying tends to stick. A truth-optimizer waits. He sits with not knowing and keeps asking whether the evidence actually points where he thinks it does.
Read primary sources whenever possible. Journalists summarize, commentators interpret, and each step away from the original source introduces distortion. When someone cites a study, find the study. When someone quotes a speech, read the speech. You will be surprised how often the summary and the source tell different stories.
Pay attention to what you want to be true. This is the central discipline. Confirmation bias does not announce itself. It works quietly, making friendly evidence feel solid and hostile evidence feel suspicious. The question to ask is not “does this support my view?” but “what would I need to see to change my mind?” If you cannot answer that honestly, you are probably not reasoning anymore.
Follow the incentives. When someone tells you something, ask who benefits if you believe it. This applies to media, to governments, to corporations, to activists, to scientists applying for grants. None of this means everyone lies, but incentives shape what people emphasize, what they omit, and how they frame things.
Be especially skeptical of anything that confirms a simple narrative. The world resists clean stories. When a piece of news fits perfectly into an existing ideological frame, that is a reason for suspicion, not satisfaction.
Seek out the strongest version of the position you disagree with. Not the strawman, not the loudest and least careful proponent, but the best argument made by the most serious thinkers on that side. If you cannot steelman an opposing view, you probably do not understand the issue yet.
Build a diverse information diet, but not arbitrarily. The goal is not balance for its own sake. The goal is exposure to good-faith thinkers who see things differently than you do. Some sources are worth your time and some are not, and learning to tell the difference is itself a skill that develops slowly.
Finally, keep a record of your predictions and beliefs. Write them down with dates. Revisit them. Nothing corrects overconfidence faster than a log of the things you were certain about that turned out to be wrong.

Further Reading:

The Scout Mindset by Julia Galef addresses the central discipline of monitoring what you want to be true. She distinguishes between the soldier mindset, which defends a position, and the scout mindset, which seeks an accurate map of reality regardless of whether the news is good or bad. Her work provides practical tools for the steelmanning process you mentioned.

Expert Political Judgment by Philip E. Tetlock explores the value of keeping a record of predictions. Tetlock conducted a long-term study on the accuracy of experts and found that those who operate with a diverse information diet and adjust their beliefs based on evidence consistently outperform those with a single, grand narrative. His findings support the idea that clean stories are usually a reason for suspicion.

The Tacit Dimension by Michael Polanyi offers a perspective on the limitations of primary sources and the nature of knowledge. Polanyi argues that we know more than we can tell, which suggests that even a primary source might omit the underlying logic or tacit knowledge required to understand a situation. This adds a layer of complexity to the pursuit of original evidence.

Unsimple Truths: Science, Complexity, and Policy by Sandra D. Mitchell argues against the scientific and philosophical preference for simple, universal laws. Mitchell shows how reductive explanations often fail when applied to complex biological and social systems. She proposes integrative pluralism as a way to account for the multilevel and contingent nature of reality.

Seeing Like a State by James C. Scott examines how large institutions and governments simplify complex social realities to make them manageable. Scott argues that these simplifications often lead to failure because they ignore the local, tacit knowledge that makes societies function. This work illustrates the danger of reaching for clean stories at the expense of messy truths.

Incentives: Motivation and the Economics of Information by Donald E. Campbell provides a structural look at how incentives shape behavior and information. Campbell explains how coordination is achieved or undermined by the way individual decision makers are motivated. The book uses examples from corporate governance to market transactions to show how incentives act as signals that shape what is emphasized or omitted.

Mixed Signals: How Incentives Really Work by Uri Gneezy explores the unintended consequences of poorly designed reward systems. Gneezy demonstrates that incentives often send signals that contradict the stated goals of an organization. This helps in following the incentives to understand why certain narratives are framed in specific ways by media or corporations.

Going to the Sources: A Guide to Historical Research and Writing by Anthony Brundage is a practical manual on the historian’s craft. Brundage explains how to identify, evaluate, and engage critically with primary sources. He details the distortions that occur when moving from original evidence to secondary summaries, providing a methodology for the “truth-optimizer” to find the original story.

The Houses of History by Anna Green and Kathleen Troup offers a detailed examination of different schools of historiography. By explaining how various historians interpret the same evidence based on their theoretical frameworks, the book teaches you how to spot the “interpretive step” that commentators take away from the original source.

Intuition Pumps and Other Tools for Thinking by Daniel Dennett contains a specific section on Rapoport’s Rules for critical commentary. These rules provide a step-by-step guide for steelmanning: you must re-express your opponent’s position so clearly and fairly that they thank you for the summary before you are allowed to offer a rebuttal.

Intellectual Humility: An Introduction to the Philosophy and Science by Ian M. Church and Peter L. Samuelson explores the virtue of knowing your own intellectual limitations. The authors draw on lead research to explain why the desire for satisfying explanations is so strong and how to cultivate the habit of sitting with “not knowing.”

Extraordinary Popular Delusions and the Madness of Crowds by Charles Mackay is a study of collective irrationality from 1841 that still reads well. It covers tulip mania, the South Sea Bubble, and witch trials to show how social pressure is a more powerful force than evidence. Mackay argues that large numbers of intelligent people can believe absurd things together when caught in episodes of mass credulity.

The Storytelling Animal by Jonathan Gottschall argues that the human mind is built to construct narratives rather than weigh evidence. This explains why clean stories beat complicated truths in almost every competition for attention and belief. Gottschall suggests that our biological drive for story often interferes with our ability to see reality clearly.

How to Lie with Statistics by Darrell Huff is a short and essential guide to how numbers get manipulated without technically being false. It provides the tools necessary for detecting manipulation in others and for avoiding those same traps in your own work. The book remains a fundamental text for anyone trying to understand how data is used to shape public opinion.

Influence by Robert Cialdini covers the specific mechanisms of persuasion that shape human behavior. Reading it makes you better at recognizing when those mechanisms are being used on you by marketers, politicians, or peers. Cialdini identifies the psychological triggers that bypass conscious reasoning.

The Art of Philosophizing and Other Essays and The Problems of Philosophy by Bertrand Russell provide a philosophical grounding for careful thinking. Russell writes plainly and without pretension about what it means to know something at all. His style and clarity make these works accessible starting points for developing a rigorous intellectual discipline.

About Luke Ford

I teach Alexander Technique in Beverly Hills (Alexander90210.com).
This entry was posted in Epistemics. Bookmark the permalink.