Anecdotes Beat the Dashboard

Bezos states the principle on the Lex Fridman Podcast (December 2023) and at the Bush Center’s 2018 Forum on Leadership, where he qualifies that “you do need the data” but should “check that data with your intuition and your instincts.” The operational claim is narrow: when a customer complaint conflicts with the dashboard, doubt the dashboard, not the complaint, because metrics measure proxies and proxies drift off the real thing they were supposed to track.

The example, told on the Fridman podcast, is from early Amazon. A weekly business review showed customer-service hold times under sixty seconds on the 1-800 line, but complaints kept coming, and Bezos’s own test calls suggested otherwise. In the meeting, with the customer-service lead defending the metric, Bezos picked up the phone, dialed the number, and the room waited in silence. The hold ran past ten minutes; the team started measuring it correctly afterward. Bezos adds in the same conversation that this is not a license to follow anecdotes blindly: the complaint is what should drive you to examine the data.

The cleaner intellectual home is the Toyota Production System’s principle of genchi genbutsu (“go and see for yourself”), Taiichi Ohno’s insistence that managers physically observe the work and the customer rather than rely on dashboards and reports from afar. Jeffrey Liker codified it as Principle 12 of The Toyota Way (2004). The shape of Bezos’s claim is the same. The dashboard is a report from afar; the customer complaint is direct observation; and when they disagree the direct observation usually wins, because the report compressed away something that mattered.