An oxymoron is a figure of speech in which apparently contradictory terms appear in conjunction. To me, the word motivated reasoning seems like an oxymoron. Let me explain.
Sound reasoning should be objective — devoid of any or all biases/motivations. Right?
But the human mind is a house of paradoxical features. As it tries to get rid of one bias, it leaves the backdoor open for the same bias. Motivated reasoning is a bias that affects that part of our mind which is often referred to as rational and objective.
Let me give you a quick refresher on System 1 Vs. System 2 concept.
World famous psychologist Daniel Kahneman has done revolutionary work in the field of understanding human cognition. His two systems framework is a brilliant mental construct to decode how our brain makes decisions. System 1 is the result of our reflexive brain — quick and eager to jump to conclusions. System 2 is our reflective brain — slower, effortful, logical, and less prone to error.
[show_to accesslevel=’almanack-all’]
These two systems don’t really exist physically inside our skull. They are merely a representation of how the human brain carries out the task of thinking. Consider these two systems as agents within the mind, with their individual personalities, abilities, and limitations. Put simply, System 1 Vs. System 2 is an excellent mental model to explain the machinery of thought.
System 1 is good at arriving approximate solutions when the problem is either simple or an old one. However, in the face of uncertainty and incomplete information, System 1 often leads to blunders. System 2 is rational is by definition immune to cognitive errors.
Those who are familiar with the workings of System 1 and its numerous mental biases, often look at System 2 as a wise friend who always gives reliable advice. However, as I mentioned earlier, our mind has devilish characteristics especially when it comes to fooling itself.
Motivated reasoning is a bias which plagues the objectivity of System 2 and makes it as error-prone as System 1. The strength of System 2 — ability to reason intelligently — becomes its weakness. Annie Duke explains in her book Thinking in Bets —
…intuitively, it feels like smart people should have the ability to spot motivated reasoning coming and should have more intellectual resources to fight it. Surprisingly, being smart can actually make bias worse…the smarter you are, the better you are at constructing a narrative that supports your beliefs, rationalizing and framing the data to fit your argument or point of view. After all, people in the “spin room” in a political setting are generally pretty smart for a reason.
…being in deliberative mind is no guarantee of rationality. As I’ve noted regarding Dan Kahan’s work on motivated reasoning, people performing complicated tasks with statistics — clearly a deliberative or System 2 type task — were susceptible to reasoning to make the math come out consistent with their prior beliefs. And the people with the most math skill had the strongest tendency to do that. Daniel Kahneman has also recognized that System 2 should not be considered immune to bias.
A belief has its own life. As it takes shape in mind, it starts behaving like a living creature interested in self-preservation. As the belief becomes part of the thinking, it shrewdly recruits the rational faculties to ensure its perpetuation.
Warren Buffett said it best — What the human being is best at doing is interpreting all new information so that their prior conclusions remain intact.
Our mind is a product of evolution. Its primary interest is conserving its energy. And discarding a belief means sunk cost. So the mind resists changing beliefs but its method of resistance takes the shape of motivated reasoning, the motivation being a continuation of the prior beliefs.
Someone wisely said, “Humans aren’t rational being, they rationalizing beings.”
This idea has interesting parallels in investing. In a company, think of the independent board of directors (IBoD) as System 2. Their purpose is to bring in rationality and objectivity to the CEO’s decisions. However, the CEO decides the incentives (remuneration) of IBoDs. Upsetting the CEO goes against an IBoD’s motivations, i.e., his salary and the opportunity to continue serving the board. Which means, an intelligent IBoD will not only support a CEO’s actions but he will actually find creative reasons to justify his stand.
Richard Peterson, in his book Inside the Investor’s Brain, describes an interesting experiment that shows the devious ways of motivated reasoning —
Professor Ditto at the University of California at Irvine set up an experiment to investigate motivated reasoning. He videotaped participants as they self-administered a bogus medical test. The subjects were coached that one result color on the test strip was favorable, while the other was an unfavorable (but unnoticeable) diagnosis. Subjects who received the unfavorable diagnosis required more time to accept the validity of the test result, were more likely to spontaneously recheck it, and believed that the test had lower accuracy than those with the favorable results. Not only do people underestimate the likelihood of negative feedback about themselves, but even after they are presented with it, they tend not to believe it (and actively argue against it)!
Motivated reasoning, in other words, is the irrationality of the rational mind.
Motivated reasoning helps us to believe in our own goodness and competence, to feel in control, and to generally see ourselves in an overly positive light, writes Leonard Mlodinow in his book Subliminal, “When we apply motivated reasoning to assessments about ourselves, we produce that positive picture of a world in which we are all above average. If we’re better at grammar than arithmetic, we give linguistic knowledge more weight in our view of what is important, whereas if we are good at adding but bad at grammar, we think language skills just aren’t that crucial. If we are ambitious, determined, and persistent, we believe that goal-oriented people make the most effective leaders; if we see ourselves as approachable, friendly, and extroverted, we feel that the best leaders are people-oriented.”
Reminds me of an anecdote which is often told in a different context.
Once upon a time, a shoe company sent two salesmen to Africa to determine the market potential for their products. One salesman was sent to the east coast of Africa, while the other salesman was sent to the west coast of Africa. Both the salesmen completed a basic survey of the target market and called back to the office. The salesman sent to the east coast of Africa reported “No one here wears any shoes, there is no market for us here!”. The other salesman sent a message “No one here wears any shoes, there is a huge market for us, send inventory fast!”.
Two people with different motivations can arrive at dramatically conflicting interpretations of the reality when they are shown the same set of facts. Motivation or prior outlook drives what patterns people see in the information presented to them.
When I read Kahneman’s work, I found that all hope wasn’t lost for there was System 2. But motivated reasoning took away that last hope also. So what do we do? How does one guard against motivated reasoning?
First, accept the fact that building an accurate mental model of the reality is an uncomfortable endeavour.
One of my favourite sci-fi movies is The Matrix. Keanu Reeves plays Neo (the protagonist) and Morpheus is the hero-hacker. When Morpheus offers to show the reality of the matrix, Neo accepts the challenge which sets him on the path to an extremely inconvenient and disorienting journey.
Living in the Matrix was an illusion, albeit a comfortable one. But if you intend to see the reality as it is, you need to step out of your comfort zone. Get ready to challenge long-held beliefs and break old habits.
Annie Duke suggests a few questions that you can ask yourself which can pierce through the fog of motivated reasoning —
- Why might my belief not be true?
- What other evidence might be out there bearing on my belief?
- Are there similar areas I can look toward to gauge whether similar beliefs to mine are true?
- What sources of information could I have missed or minimized on the way to reaching my belief?
- What are the reasons someone else could have a different belief, what’s their support, and why might they be right instead of me?
- What other perspectives are there as to why things turned out the way they did?
I hope these questions will make you uncomfortable. They should. Making better decisions isn’t easy. To become a better thinker is a herculean task but it’s possible if one keeps at it by becoming a learning machine and constantly working on the behavioural pitfalls.
[/show_to]
[hide_from accesslevel=’almanack-all’]
- Spotlight: Big ideas from Value Investing and why applying them in your investment decision making will be a great deal
- InvestorInsights: Interviews with experienced value investors, learners, and deep thinkers
- StockTalk: Thorough analysis of business models of companies (without any recommendations)
- Behaviouronomics: Deep analysis of human behaviour and how it impacts investment decision making
- BookWorm: Reviews of the best books on Value Investing and related subjects
- Free Course – Financial Statement Analysis for Smart People (otherwise priced at Rs 5,900)
- Archives: Instant access to our huge archive from the past three years