Key Takeaways
- Cherry-picking data means selecting only evidence that supports a conclusion while ignoring contradictions.
- Watch for trough-to-peak returns, survivorship-filtered track records, and median-price distortions.
- The narrative fallacy creates false confidence by making past outcomes seem predictable and inevitable.
- Evaluate data sources critically: Who produced the analysis? What data was excluded? What is their incentive?
Data can be manipulated to support almost any narrative. This lesson identifies common data manipulation techniques in real estate marketing and analysis, teaching you to evaluate claims critically.
Common Data Manipulation Techniques
Cherry-picking involves selecting only the data points that support a predetermined conclusion while ignoring contradictory evidence. In real estate, this takes many forms: citing appreciation from the 2012 trough (the lowest point) to the present to inflate returns, using median price increases that reflect changes in the mix of homes selling rather than true appreciation, or comparing vacancy rates to post-crisis highs rather than long-term averages.
Another common technique is survivorship-filtered data. A fund manager who launched three real estate funds might market the track record of the one that succeeded while quietly closing the two that underperformed. An educator who recommended 20 markets might highlight the five that outperformed while ignoring the fifteen that delivered average or below-average returns.
The Narrative Fallacy
The narrative fallacy is our tendency to construct coherent stories from random data. After the fact, every market outcome seems inevitable — "of course Austin appreciated 50%, it was attracting tech companies." Before the fact, however, dozens of cities were attracting tech companies, and only some saw extraordinary appreciation.
Narrative fallacies are dangerous because they create false confidence in prediction. If you can explain why Austin boomed, you feel like you can predict the next Austin. But the narrative was constructed after the fact, fitting the explanation to the outcome. Prospective prediction is fundamentally harder than retrospective explanation, and mistaking the two leads to overconfident investment decisions.
Common Pitfalls
Citing trough-to-peak appreciation as representative of typical market returns.
Risk: Overestimating achievable returns and taking on excess risk based on inflated historical performance.
Always state appreciation over complete cycles and note both the starting and ending points. A return from the 2012 trough is not comparable to a return from the 2019 level.
Constructing a compelling narrative for why a market will outperform and treating it as a reliable prediction.
Risk: Overconcentration in a single market based on a narrative that may not materialize.
Acknowledge that narratives are constructed after the fact. Use probability ranges rather than single-point predictions, and diversify across markets.
Best Practices Checklist
Sources
Common Mistakes to Avoid
Citing trough-to-peak appreciation as representative of typical market returns.
Consequence: Overestimating achievable returns and taking on excess risk based on inflated historical performance.
Correction: Always state appreciation over complete cycles and note both the starting and ending points. A return from the 2012 trough is not comparable to a return from the 2019 level.
Constructing a compelling narrative for why a market will outperform and treating it as a reliable prediction.
Consequence: Overconcentration in a single market based on a narrative that may not materialize.
Correction: Acknowledge that narratives are constructed after the fact. Use probability ranges rather than single-point predictions, and diversify across markets.
"Survivorship Bias, Recency Bias & Historical Data Traps" is a Pro track
Upgrade to access all lessons in this track and the entire curriculum.
Immediate access to the rest of this content
1,746+ structured curriculum lessons
All 33+ real estate calculators
Metro-level data across 50+ regions
Test Your Knowledge
1.What is cherry-picking in data analysis?
2.What is the narrative fallacy?
3.How can you evaluate whether a data claim is cherry-picked?