Since science is all about making things predictable, it is sort of a surprise that many of the advances in science in the last hundred years have been made using mathematics about things which are inherently and intrinsically unpredictable: the mathematics of probability, and its applied-math stepchild, statistics.

The usual example of something that’s inherently unpredictable is flipping a fair coin. Take a quarter from your purse, flip it, and it comes up either heads or tails.

Now, because I know my readers, I can tell someone is getting set to write me a comment about how there’s no such thing as a perfectly fair coin, or that it can also land on an edge, or explaining how they learned to flip a coin so it made exactly one turn and so they could always predict how it would land, so let me just say: this is mathematics, it’s a perfectly fair coin, and we’re going to be catching it in the air so it never lands on edge. So just stop.

As I said, when you flip this perfectly fair coin, it either comes up heads or tails. The next time you flip it, it also comes up either heads or tails, and which comes up doesn’t depend on the previous flip at all. Technically, we’d say it “has no memory”, it’s memory-less. Random things with this memory-less property are going to be important, so remember the word.

The gambler’s fallacy is imagining that something like a fair coin actually has memory — in other words, if you’ve had a run of heads, you’re “due for” tails to come up. The truth is that every time you flip a coin, what comes up is independent of all the previous flips. What makes you think you’re “due for” a tails is that over many coin flips, the likelihood of getting a run of many heads or tails gets smaller, and it gets smaller quickly.

Let’s start with the simplest case. If you flip a coin exactly once, the chances of getting all heads are exactly 50-50. It’s either heads or tails, which we’re going to represent as 0 for heads and 1 for tails. Flip the coin twice, and the chance of getting all heads drops to 1 in 4: 00, 01, 10, 11. Three times, and it’s 1 in 8: 000, 001, 010, 011, 100, 101, 110, 111. I won’t carry out the examples any further, but it’s easily shown that this pattern carries on forever, and the chance of getting a run of heads of length n is exactly 1/2n. Now think about flipping a fair coin many many times: for every run of 10 coin flips, we won’t get a run of 10 heads 1023 out of 1024 times. So you’re right that you learned to expect that you won’t get ten heads in a row; the fallacy is that if you have gotten nine heads in a row, you’re still going to get that tenth heads exactly half the time.

This is what’s called a combinatoric argument, and it really is the basis of all probability and statistics. There are 1024 possible sequences of ten coin flips, and only one of them is all heads. (And, of course, only one is all tails.)

Since we know that it’s a fair coin, and we all believe intuitively in the Gambler’s Fallacy, we expect to see certain things if we flip a coin 10 times:

2. We expect them to be roughly evenly distributed, with no long runs of either heads or tails.

In other words, our intuition is that a sequence of 10 coin flips will give us about 5 heads and 5 tails, and the sequence will “look like” 0101010101 or 1010101010. Of course we expect a little bit of randomness, so maybe 0011010011 or 1001011010. Depending on how we define “evenly distributed” there are at most 5 or 6 of those sequences that we think is “even” or “fair”. Since there are a total of 1024 sequences of 10 coin flips, there is only about 1 chance in 200 of getting what we expect to be a “fair” distribution over all.

In other words, the “fair” distribution of heads and tails is in fact very improbable. The most probable distributions of heads and tails are the “unfair” ones.

I thought of this yesterday when I read a story in the UK Daily Mail Online about a woman in Beaverton, Oregon who had about the worst luck imaginable: she noticed a lump in her breast, and went to the doctor — who told her it was stage 4 breast cancer. Eleven days later, her 3 year old was diagnosed with leukemia.

You hear these stories every so often, and a very common reaction is to assume that there must have been something environmental to blame. Other examples are cases of cancer near high-voltage power lines, and in a happier direction, people who win the lottery twice in a short period of time.

Our natural intuition is shaped by the gamblers fallacy in these cases too: we expect cancer cases to be evenly distributed, and lottery winnings to go to a different person every time. If they don’t, we suspect one way or the other that the “fix was in”.

The reality is that when things happen randomly, just like our coin flips, the outcome will almost always seem unfair.

****

image courtesy shutterstock / patpitchaya