Showing posts with label How Not To Be Wrong. Show all posts
Showing posts with label How Not To Be Wrong. Show all posts

Saturday, April 16, 2016

When Am I Going To Use This?

The mathematicians we’ve encountered in this book are not just puncturers of unjustified certainties, not just critics who count. They found things and they built things. Galton uncovered the idea of regression to the mean; Condorcet built a new paradigm for social decision making; Bolyai created an entirely novel geometry, “a strange new universe”; Shannon and Hamming made a geometry of their own, a space where digital signals lived instead of circles and triangles; Wald got the armor on the right part of the plane.

Every mathematician creates new things, some big, some small. All mathematical writing is creative writing. And the entities we can create mathematically are subject to no physical limits; they can be finite or infinite, they can be realizable in our observable universe or not. This sometimes leads outsiders to think of mathematicians as voyagers in a psychedelic realm of dangerous mental fire, staring straight at visions that would drive lesser beings mad, sometimes indeed being driven mad themselves.

It’s not like that, as we’ve seen. Mathematicians aren’t crazy, and we aren’t aliens, and we aren’t mystics.

“What’s true is that the sensation of mathematical understanding—of suddenly knowing what’s going on, with total certainty, all the way to the bottom—is a special thing, attainable in few if any other places in life. You feel you’ve reached into the universe’s guts and put your hand on the wire. It’s hard to describe to people who haven’t experienced it.

We are not free to say whatever we like about the wild entities we make up. They require definition, and having been defined, they are no more psychedelic than trees and fish; they are what they are. To do mathematics is to be, at once, touched by fire and bound by reason. This is no contradiction. Logic forms a narrow channel through which intuition flows with vastly augmented force.

The lessons of mathematics are simple ones and there are no numbers in them: that there is structure in the world; that we can hope to understand some of it and not just gape at what our senses present to us; that our intuition is stronger with a formal exoskeleton than without one. And that mathematical certainty is one thing, the softer convictions we find attached to us in everyday life another, and we should keep track of the difference if we can.

Every time you observe that more of a good thing is not always better; or you remember that improbable things happen a lot, given enough chances, and resist the lure of the Baltimore stockbroker; or you make a decision based not just on the most likely future, but on the cloud of all possible futures, with attention to which ones are likely and which ones are not; or you let go of the idea that the beliefs of groups should be subject to the same rules as beliefs of individuals; or, simply, you find that cognitive sweet spot where you can let your intuition run wild on the network of tracks formal reasoning makes for it; without writing down an equation or drawing a graph, you are doing mathematics, the extension of common sense by other means. When are you going to use it? You’ve been using mathematics since you were born and you’ll probably never stop. Use it well.



Mathematics

What can I say? Mathematics is a way not to be wrong, but it isn’t a way not to be wrong about everything. (Sorry, no refunds!) Wrongness is like original sin; we are born to it and it remains always with us, and constant vigilance is necessary if we mean to restrict its sphere of influence over our actions. There is real danger that, by strengthening our abilities to analyze some questions mathematically, we acquire a general confidence in our beliefs, which extends unjustifiably to those things we’re still wrong about. We become like those pious people who, over time, accumulate a sense of their own virtuousness so powerful as to make them believe the bad things they do are virtuous too.

Nonlinearity

Money must not be estimated by its numerical quantity: if the metal, that is merely the sign of wealth, was wealth itself, that is, if the happiness or the benefits that result from wealth were proportional to the quantity of money, men would have reason to estimate it numerically and by its quantity, but it is barely necessary that the benefits that one derives from money are in just proportion with its quantity; a rich man of one hundred thousand ecus income is not ten times happier than the man of only ten thousand ecus; there is more than that what money is, as soon as one passes certain limits it has almost no real value, and cannot increase the well-being of its possessor; a man that discovered a mountain of gold would not be richer than the one that found only one cubic fathom.

Mathematics of Gambling

James Harvey wasn’t the first person to take advantage of a poorly designed state lottery. Gerald Selbee’s group made millions on Michigan’s original WinFall game before the state got wise and shut it down in 2005. And the practice goes back much further. In the early eighteenth century, France financed government spending by selling bonds, but the interest rate they offered wasn’t enticing enough to drive sales. To spice the pot, the government attached a lottery to the bond sales. Every bond gave its holder the right to buy a ticket for a lottery with a 500,000-livre prize, enough money to live on comfortably for decades. But Michel Le Peletier des Forts, the deputy finance minister who conceived the lottery plan, had botched the computations; the prizes to be disbursed substantially exceeded the money to be gained in ticket receipts. In other words, the lottery, like Cash WinFall on roll-down days, had a positive expected value for the players, and anyone who bought enough tickets was due for a big score.

One person who figured this out was the mathematician and explorer Charles-Marie de La Condamine; just as Harvey would do almost three centuries later, he gathered his friends into a ticket-buying cartel. One of these was the young writer François-Marie Arouet, better known as Voltaire. While he may not have contributed to the mathematics of the scheme, Voltaire placed his stamp on it. Lottery players were to write a motto on their ticket, to be read aloud when a ticket won the jackpot; Voltaire, characteristically, saw this as a perfect opportunity to epigrammatize, writing cheeky slogans like “All men are equal!” and “Long live M. Peletier des Forts!” on his tickets for public consumption when the cartel won the prize.

Eventually, the state caught on and canceled the program, but not before La Condamine and Voltaire had taken the government for enough money to be rich men for the rest of their lives. What—you thought Voltaire made a living writing perfectly realized essays and sketches? Then, as now, that’s no way to get rich.

Eighteenth-century France had no computers, no phones, no rapid means of coordinating information about who was buying lottery tickets and where: you can see why it took the government some months to catch on to Voltaire and Le Condarmine’s scheme.

The Sea and The Stone

Outsiders sometimes have an impression that mathematics consists of applying more and more powerful tools to dig deeper and deeper into the unknown, like tunnelers blasting through the rock with ever more powerful explosives. And that’s one way to do it. But Grothendieck, who remade much of pure mathematics in his own image in the 1960s and ’70s, had a different view: “The unknown thing to be known appeared to me as some stretch of earth or hard marl, resisting penetration . . . the sea advances insensibly in silence, nothing seems to happen, nothing moves, the water is so far off you hardly hear it . . . yet it finally surrounds the resistant substance.”

The unknown is a stone in the sea, which obstructs our progress. We can try to pack dynamite in the crevices of rock, detonate it, and repeat until the rock breaks apart, as Buffon did with his complicated computations in calculus. Or you can take a more contemplative approach, allowing your level of understanding gradually and gently to rise, until after a time what appeared as an obstacle is overtopped by the calm water, and is gone.

Mathematics as currently practiced is a delicate interplay between monastic contemplation and blowing stuff up with dynamite.



Reliability of Scientific Facts

Fisher certainly understood that clearing the significance bar wasn’t the same thing as finding the truth. He envisions a richer, more iterated approach, writing in 1926: “A scientific fact should be regarded as experimentally established only if a properly designed experiment rarely fails to give this level of significance.”

Not “succeeds once in giving,” but “rarely fails to give.” A statistically significant finding gives you a clue, suggesting a promising place to focus your research energy. The significance test is the detective, not the judge. You know how when you read an article about a breakthrough finding that this thing causes that thing, or that thing prevents the other thing, and at the end there’s always a banal sort of quote from a senior scientist not involved in the study intoning some very minor variant of “The finding is quite interesting, and suggests that more research in this direction is needed”? And how you don’t really even read that part because you think of it as an obligatory warning without content?

Here’s the thing—the reason scientists always say that is because it’s important and it’s true! The provocative and oh-so-statistically-significant finding isn’t the conclusion of the scientific process, but the bare beginning. If a result is novel and important, other scientists in other laboratories ought to test and retest the phenomenon and its variants, trying to figure out whether the result was a one-time fluke or whether it truly meets the Fisherian standard of “rarely fails.” That’s what scientists call replication; if an effect can’t be replicated, despite repeated trials, science backs apologetically away. The replication process is supposed to be science’s immune system, swarming over newly introduced objects and killing the ones that don’t belong.

That’s the ideal, at any rate. In practice, science is a bit immunosuppressed. Some experiments, of course, are hard to repeat. If your study measures a four-year-old’s ability to delay gratification and then relates these measurements with life outcomes thirty years later, you can’t just pop out a replication.
But even studies that could be replicated often aren’t. Every journal wants to publish a breakthrough finding, but who wants to publish the paper that does the same experiment a year later and gets the same result? Even worse, what happens to papers that carry out the same experiment and don’t find a significant result? For the system to work, those experiments need to be made public. Too, often they end up in the file drawer instead.



Improbable>Impossible

Here’s the bad news: the reductio ad unlikely, unlike its Aristotelian ancestor, is not logically sound in general. It leads us into its own absurdities. Joseph Berkson, the longtime head of the medical statistics division at the Mayo Clinic, who cultivated (and loudly broadcast) a vigorous skepticism about methodology he thought shaky, offered a famous example demonstrating the pitfalls of the method. Suppose you have a group of fifty experimental subjects, who you hypothesize (H) are human beings. You observe (O) that one of them is an albino. Now, albinism is extremely rare, affecting no more than one in twenty thousand people. So given that H is correct, the chance you’d find an albino among your fifty subjects is quite small, less than 1 in 400,* or 0.0025. So the p-value, the probability of observing O given H, is much lower than .05.

We are inexorably led to conclude, with a high degree of statistical confidence, that H is incorrect: the subjects in the sample are not human beings.

It’s tempting to think of “very improbable” as meaning “essentially impossible,” and, from there, to utter the word “essentially” more and more quietly in our mind’s voice until we stop paying attention to it. But impossible and improbable are not the same—not even close. Impossible things never happen. But improbable things happen a lot. That means we’re on quivery logical footing when we try to make inferences from an improbable observation, as reductio ad unlikely asks us to.



Math Problems vs. REALITY

I blame word problems. They give a badly wrong impression of the relation between mathematics and reality. “Bobby has three hundred marbles and gives 30% of them to Jenny. He gives half as many to Jimmy as he gave to Jenny. How many does he have left?” That looks like it’s about the real world, but it’s just an arithmetic problem in a not very convincing disguise. The word problem has nothing to do with marbles. It might as well just say: type “300 − (0.30 × 300) − (0.30 × 300)/2 =” into your calculator and copy down the answer!

But real-world questions aren’t like word problems. A real-world problem is something like “Has the recession and its aftermath been especially bad for women in the workforce, and if so, to what extent is this the result of Obama administration policies?” Your calculator doesn’t have a button for this. Because in order to give a sensible answer, you need to know more than just numbers. What shape do the job-loss curves for men and women have in a typical recession? Was this recession notably different in that respect? What kind of jobs are disproportionately held by women, and what decisions has Obama made that affect that sector of the economy? It’s only after you’ve started to formulate these questions that you take out the calculator. But at that point the real mental work is already finished. Dividing one number by another is mere computation; figuring out what you should divide by what is mathematics.