Success and Luck: Good Fortune and the Myth of Meritocracy
Apr 19, 2016
Read enough of these sorts of books and the ideas start to mash together. In fact, they often use some of the same anecdotes and reference each other. Into this general category, “success and luck” I put books like “Drunkard’s Walk,” “The Success Equation,” “Fooled by Randomness,” “Signal and the Noise” and even “Adapt: Why Success Always Starts with Failure.” I keep on coming back to these sorts of books because I like to consider the interplay between effort, randomness and uncertainty in our lives and in the greater scheme of things.
There is no such a thing as destiny. History is contingent and so are our lives – contingent on our environment, on what came before, on our earlier choices and very much on random chance. We have an illusion of control, well illusion of too much control. It seems counter intuitive but we have more control over the things that matter to us if we properly recognize the role of randomness and let things happen. This is not merely “going with the flow.” If you find yourself in a strong current, you cannot successfully fight against it, but you can have a lot more choices if you determine its direction and use it to your advantage. It is the old story of constrained free will that the Stoics used to talk about and about which thinkers like Saint Augustine wrote. But let me finally get to “Success and Luck” book itself.
I started off not liking it. The author seemed kind of preachy and seemed to have the agenda of telling his readers that their accomplishments were mostly the result of luck and so they should be happy to pay more in taxes. It was a variation on the “you didn’t build that” idea that I loathe. But as I got farther along, I saw the book really was more on the order of something like the “Success Equation.” In fact, he specifically refers to that book and quotes some its examples.
He comes up with a reasonable assessment of the interplay between luck and effort in achieving success. All of us, for example, are lucky to be living in 21st Century America. Because of the luck of out birth or immigration status, we have opportunities well beyond those of most people in the world and well beyond even those most fortunate of centuries past. We are almost all of us absolutely better off than most of humanity today and way better off than almost all of humanity in historical terms. But, Mr. Frank says, it is not our absolute positions that concern most of us, but our positions relative to others around us, our reference group. If you are the richest guy in a poor place, you feel fortunate and empowered. If you are the poorest in your gang of millionaires, you feel put upon and deprived. This, he asserts, is hard wired into us by evolution, since your relative standing in your group determined what you got and your reproductive success, very important from a Darwinian perspective. This idea becomes central to his policy prescriptions, which I will get to later.
Frank explains more about the role of luck. He stipulates that most successful people work very hard and are intelligent and talented. But intelligence and talent are necessary but not sufficient to achieve the greatest success. Referring to the “paradox of skill” w/o actually calling it by that specific name, Frank explains that as the general level of expertise becomes very high, luck plays an increasingly important role. Maybe 1000 people COULD do the job. The high level of competence is a threshold requirement, a ticket in. You cannot even begin to compete w/o it, but since all participants have it, the only differences will come from luck. (Taking an example from a different book, “The Success Equation,” no baseball player will ever again achieve Ted Williams’ record. It is not that modern players cannot achieve his level of absolute skill, but rather that the general level of skill has become so high that nobody can stand as far out anymore on skill alone.)
This brings Frank to a talk about the winner takes all society (the title of one of his earlier books.) Small differences get magnified so that the winner may not be very much better than the second place finisher, but he gets the whole prize. This is a big driver of inequality. The winners small edge is enough to get it all and, according to Franks, sometimes, often, this small edge is due to luck. He explains that every outcome depends on a combination of skill and luck. In simulations where subjects are assigned skill levels and then given random luck scores, the most skillful subjects rarely actually win the top place and you can see why. If you have a skill level ten and I have only five and we throw the dice with me getting twelve and you two, I win. Skill indeed increases your odds, but in a situation with significant random chance it is not the determining factor. Beyond that, future outcomes are influenced by past ones. Take our example above. When we started, your skill level was twice mine and your odds better. But after the first roll of the dice, I am now at seventeen (5 skill +s 12 chance) and you start out at only twelve (10 skill + 2 chance). Since the dice have no memory, you may never catch up. And in the real world it might be even more pronounced, since my greater opportunity would let me develop more expertise.
Frank’s prescription to address this problem is higher taxes, specifically a progressive consumption tax. He feels this would have little or no effect on actual work, since it would maintain the relative position of all participants (as above, he thinks relative position is key) but would raise the big bucks needed to improve infrastructure on which all depend. Even the rich would be better off, he says, since they would have better quality public goods (it is no fun to drive a great private car on a dilapidated public road) and since their relative positions would be unchanged, they would have similar incentive to work.
I don’t think his idea is a terrible way to raise revenue. In fact, it has advantages over income taxes. But it is an inelegant solution to the problem of luck and success. The “problem” of randomness, IMO, is best addressed by more randomness, or more correctly a better recognition of random chance in our lives. We spend way too much time and energy trying to be precise about things that cannot be measured with precision, finding exactly the best job candidate or student applicant. It is likely that there is no “best” candidate, since future conditions will differ from past ones in significant but unpredictable ways. Enter randomness. Determine a pool of qualified candidates and then do a lottery. This would have the advantage of partially negating the effects of autocorrelation, making the system much simpler and countering the myth that you have to pay so much more for just the exactly right talent.
I recommend “Luck and Success.” I predict that mostly conservative readers will dislike the book at first, but come to appreciate it farther along, while mostly liberal readers will think he starts off right and then come off the tracks later. I suppose that shows it is mostly balanced. I would say, however, that better books on almost the same topic are “The Success Equation,” or “the Drunkard’s Walk.”

Markets everywhere, July 17, 2016
Format: Hardcover
Kids like dinosaurs and I was no exception. In fact, I liked dinosaurs more than the average kid. Before I could read, I knew their names & characteristics. I knew which period of the Mesozoic Era the important ones lived. When I had kids, I wanted to pass along my knowledge about the science of the paleo-worlds, about dinosaurs. Trouble was, the things I knew were no longer true. You would think something that happened at least 65 million years ago would be less subject to the vagaries of current fashion. My dinosaurs were big, slow moving cold-blooded reptiles. They came in dullish colors, ranging from brownish grey to greyish brown. My kids’ dinosaurs were quick and colorful. Some were warm-blooded and even had feathers.
I bought this book as part of my self-help search for elegance – title seemed to fit. Let me first reiterated that elegance in science is not necessary like elegance in dress or manners. The two connotations share the idea of beauty, but the scientific beauty is its simplify and capacity to explain in the fewest steps where the addition of anything else is unnecessary and the subtraction of anything is impossible w/o compromising the integrity. An example is the Ptolemaic universe versus Copernican. The astronomer Claudius Ptolemy, who worked in Roman Egypt in the second century, deigned a system to explain the movement of planets and stars. The ancients did NOT believe the earth was flat but they did think it was the center of the universe. The Ptolemaic system did a decent job of prediction, i.e. it worked, and it remained the vision of the universe for 1500 years. The problem was that it was very complex. Because it was actually not describing the heliocentric reality, it required lots of what we would unscientifically call tweaks or exceptions to make it go. When the Polish scholar Nicolas Copernicus overturned the Ptolemaic system, putting the sun at the center of what we now call the solar system, his explanation was not materially better in its predictive or explanatory power, given the generally crude measurements available at the time, but it was much simpler. Simple is usually better.
This book is beautifully written. It is erudite & detailed in describing the wonders of the natural world. You realize that you are in the presence of greatness when you read Wilson’s words. All these things cleverly hide the fact that Wilson is wrong when he goes after what he calls the “new conservationists.” He very effectively proves, and demonstrates with stunning examples, that nature is complex and that humans do not now and probably never can adequately understand the relationships within even simple ecosystems. He goes on ostensibly to advocate humility when presuming to manage nature. So far, so good. But his attack on the “new conservationism” is an extrapolation not supported by the evidence Wilson presents.
America never stopped being great and we are about to become greater again. Competition, automation and the 2008 crash followed by a weak recovery have made us feel less down and fueled anger, but we are at an inflection point again with indicators pointing up. In some ways, the situation today is like that of the late 1970s or early 1980s. We lived through a years of uncertain recovery and “malaise” but good things were happening that were easily overlooked.