The parity of zero, the primality of two, and other mysteries

As we know,
There are known knowns.
There are things we know we know.
We also know
There are known unknowns.
That is to say
We know there are some things
We do not know.
But there are also unknown unknowns,
The ones we don’t know
We don’t know.
— Donald Rumsfeld, 2/12/2002

From time to time, I try to speak or write about mathematics for general (non-mathematical) audiences.  If you've done this, you know it's pretty hard -- in large part because it's hard to know what people know, despite my best attempts to find out.

Enter Google Surveys.  For a pretty reasonable fee, it turns out anyone can run a survey through Google; the respondents are randomly selected and reweighted by demographics (age, gender, location).  So I decided to find out:  What percentage of Americans over the age of 18 know what a prime number is?  What about an even number?  I also tried to design the questions so they tested a bit more than basic knowledge; for example, I wanted to know whether the respondents knew that zero is even (a surprisingly controversial topic).

Methodology

Here are the two surveys I ran, as they would appear to respondents.  Each survey received about 250 responses from randomly selected Americans over the age of 18.  (And cost me a well-spent $25.)

Even numbers:

You'd think this one would be pretty easy...

I included 0 because I suspected it would be the most "difficult" number to identify as even; I included 774 to check that people know how to deal with large-ish numbers.  17 and 99 were supposed to be easy, whereas 257 was aimed at checking if people were simply looking for an even digit.

Prime numbers:

Maybe a little tougher.

Here 57 is included in honor of Grothendieck.

The order of the answers was reversed for a random half of the respondents.  As I understand it, Google shows these questions on sites with some premium content -- users can take the survey in lieu of paying.

Data

You can download the raw data for the survey on even numbers here, and the survey on prime numbers here.  The data includes the type of website on which the survey was taken (news, arts and entertainment, reference, etc.), the gender of the respondent, their approximate age, region within the US, whether they are browsing from a rural, suburban, or urban area, their approximate income, and the amount of time it took them to respond to the question.  Google infers much of this data from the browsing habits of the user, though, so I don't know how reliable it is.

Analysis

So, what percentage of American know that 2 is a prime number?  That zero is even?

Well 8 is pretty even, I guess.

The percentages indicate how many survey-takers thought the number in question was even.  So about 75.7% of people think 8 is even (not bad!) but 774 is much harder.  I don't know what was going on with the 0.8% of people who thought that 17 was even, but maybe this is an example of the Lizardman constant.

Yeesh.

(Note that the histogram above says that there were 199 respondents.  In fact, there were 250, but because of the reweighing, the survey only had the power of the survey with 199 truly randomly-chosen respondents.)  The good news is that more than 40% of survey-takers knew that 13 is prime; on the other hand, 17% thought that 9 is prime.  That said, I founded it heartening that the top three answers were indeed the three primes.  That's the wisdom of crowds for you.

How did the respondents do overall?  Below are graphs indicating what percentage of respondents got 0,1, ..., 6 answers correct on each survey.

Even numbers:

Not bad!

In particular, more than half of the survey-takers were able to get 5 or 6 answers correct.  Not too shabby!  To get a perfect score, one had to identify zero as even, which only 24% of the respondents were able to do, so I think this is a pretty good result.  Interestingly, about 2/3 of the people who correctly identified zero as even got perfect scores.  The median number of correct answers was 5 out of 6; the mean was about 4.5.

Prime numbers:

Pretty tough.

Identifying primes was evidently much harder.  The median number of correct answers was 3 out of 6 (no better than chance), and the mean was about 3.6.

I did do some more detailed analysis (e.g. breaking the results down by demographics, looking at the response time, etc.) but didn't find anything particularly interesting.  But for your edification, here is a plot of median response time (in milliseconds) against the number of correct answers to the survey on even numbers.

Hmm.

There seems to be a weak relationship between time spent and the number of correct answers (though the people who answered almost everything wrong did so pretty slowly), but maybe this isn't surprising.

Conclusions

I actually found these results pretty heartening!  My biggest worry is that I'm now addicted to polls, at $25 a pop.

I was a bit surprised how few respondents knew that 0 is even.  Parity is a concept which actually comes up in daily life -- for example, when one wants to know which side of the street a given address is on, or in certain regulatory questions.  I was also a bit surprised that it was so difficult to identify 2 as a prime.

Of course there are some problems with these polls.  The biggest, in my opinion, is that they don't let people indicate how sure they are -- one worry I have is that if people weren't sure if, say, 2 was prime, they'd just leave it blank.  So, for the sake of symmetry, I should really run another survey, asking people to identify non-prime numbers.  I suspect far fewer than 70% of respondents would say 2 is composite.  If I decide to run another survey, I'll post about it here, of course.

Please let me know if you download and do anything with the data!  (Data on even numbers, data on primes.)