Polls with Large Voter Samples All Favor Romney; Smaller, Less Reliable Polls All Favor Obama. Why?
October 24, 2012 - 7:03 pm
We can only speculate. I’ll posit some theories here, but I welcome speculations in the comments section as well.
• Theory #1: Non-respondents refuse to answer because they don’t want to reveal to a stranger that they’re voting for Romney.
As I noted in an earlier post, only 9% of people respond to poll questions: The other 91% either refuse to participate in the poll, or don’t even pick up the phone in the first place. I argued back then that it’s likely the majority of those non-responders are Romney voters, and this new polling trend confirms that thesis. It’s not clear why some pollsters have higher sample sizes than others: it could be that IBD/TIPP, NBC, WashTimes and CBS merely aimed low, and intended to have small poll samples — but it’s more likely that they tried to get more people to reply but had a significant non-response rate, and so “gave up” after reaching some number under 1000. Perhaps something about their methodologies, or the type of people hired to ask the questions, or their wording turned off or offended a certain type of voter inclined to favor Romney, and those people tended to hang up rather than state their preference for Romney. That would mean that IBD/TIPP, NBC, WashTimes and CBS are unintentionally under-sampling Romney voters, leading to their pro-Obama poll results.
• Theory #2: Certain pollsters are purposely publishing polls with high margins of error, so they can later have wiggle room when their pro-Obama slant proves to be inaccurate.
This theories supposes deviousness or malice on the part of certain pollsters: They want to sway the electorate with pro-Obama poll results, but want to give themselves room for plausible deniability if those polls later prove to be inaccurate. If challenged on their dubious published results, they can say, “Yes, our poll seemed to favor Obama, but you see his advantage was within the margin of error, so it’s plausible that it was just a statistical fluke, now that we see in retrospect that Romney won.” But a flaw in this theory is that two of the four pro-Obama polls were published by conservative-leaning media — IBD and Washington Times — who presumably have no interest in helping Obama.
• Theory 3: Sloppy polls simply give inaccurate results.
The smaller the sample, the more loosey-goosey the poll is, and the more likely it will produce an outlier result. But this fails to explain why all the outliers tilt toward Obama.
• Theory 4: The larger sample sizes also tend to be the more recent polls — all this trend reveals is that Romney’s lead is growing.
This is partly true, but there’s a lot of statistical “noise” in the recent/large/pro-Romney correlation. But it may account for some of the trend.
Otherwise, I’m stumped. I’ve love to hear what your theories are about this poll-sample trend. But perhaps it’s best to just bask in the knowledge that this week’s polls confirm that Romney has solidified his lead, and not worry about why some polls are off the mark.