TRADECRAFT: The Intelligence Trap (Motivated Reasoning)
The Concept
We like to think our brains are “Scientists”—we gather data and reach a conclusion.
In reality, our brains are Lawyers.
-
The Client: Your Tribe / Your Identity / Your Gut Feeling.
-
The Job: The Client decides the conclusion (“My team is good”), and your Brain’s job is to find the evidence to prove it.
This is called Motivated Reasoning.
When you see a study that agrees with you, your brain asks: “Can I believe this?” (Answer: Yes).
When you see a study that disagrees, your brain asks: “Must I believe this?” (Answer: No, look at that typo in paragraph 3!).
THE TRAP: Why Smart People are More Biased
You might think: “I have a high IQ, so I am less biased.”
Wrong. Research shows that high-IQ people are often more biased.
-
Why? Because they are better at arguing.
-
If you are smart, you are faster at finding reasons to dismiss data you don’t like. You use your intelligence to build a fortress around your bad ideas.
-
The Result: Intelligence is not a shield against bias; it is a tool for rationalization.
TRADECRAFT TOOL: Scout Mindset vs. Soldier Mindset
(Concept by Julia Galef)
| The Soldier | The Scout |
| Goal: Defend the tribe. Defeat the enemy. | Goal: See the map clearly. Find the truth. |
| Reaction to error: Denial. “It wasn’t my fault.” | Reaction to error: Curiosity. “Oh, I was wrong? Interesting.” |
| Emotion: Anger, Adrenaline, Tribalism. | Emotion: Intrigue, Pride in accuracy. |
| Weakness: Dies on the wrong hill. | Weakness: Doesn’t feel the “rush” of battle. |
The Lesson: You cannot be a Critical Thinker if you are a Soldier. You must be a Scout. A Scout doesn’t care who wins; they just want to know where the bridge is.
LAB EXERCISE: The “Kill Your Darling” Test
Prove you are not a Soldier.
The Mission:
-
Take a belief you hold strongly (e.g., “Nuclear power is dangerous” or “Rent control works”).
-
The Challenge: Find one valid, data-backed argument against your belief.
-
The Test: If you cannot find a single smart reason why the other side thinks that way, you are not informed—you are indoctrinated.
-
Write it down: “I believe [X], but a valid point against it is [Y].”
ACTION ITEM: The “Umpire Check”
Next time you share a news story that makes your “Side” look good:
-
Pause.
-
Ask: “If this story was about the Other Team, would I fact-check it harder?”
-
If the answer is Yes, you are engaging in Motivated Reasoning. Do not share it until you verify it.