Poll Flippery Explained!

For indispensable reporting on the coronavirus crisis, the election, and more, subscribe to the Mother Jones Daily newsletter.

Suppose you conduct an opinion poll and get answer X on a particular question.  If you follow up with a question like “But what if…..” then X is likely to change.  But how much?  Is there some minimum amount of change you’ll get no matter what followup question you ask?

I asked that question a couple of weeks ago, and Dave Munger of Cognitive Daily decided to investigate.  The result was a cheap-and-cheerful nonscientific online poll that gauged whether some people would change their minds no matter what the followup question was.  I’ve been sworn to secrecy until now, but here are the results:

While it is true that someone changed their answer for each question, in some cases, very few people did. Consider the responses to the question “Should the United States withdraw all troops from Afghanistan?”….While 35 percent of respondents said they’d change their answer if the US kept one base in Afghanistan to address only the terrorist threat, only 4 percent said they’d change their answer to the original question if the US also closed the prison at Guantanamo Bay.

Aside from one genuinely out-of-the-blue question, that seems to have been the baseline: you can get 4% of your respondents to change their minds no matter what the followup is.  That’s actually pretty low.

But there’s more!  Who changes their minds more, liberals or conservatives?  Click to link to find out.

DEMOCRACY DOES NOT EXIST...

without free and fair elections, a vigorous free press, and engaged citizens to reclaim power from those who abuse it.

In this election year unlike any other—against a backdrop of a pandemic, an economic crisis, racial reckoning, and so much daily crazy—Mother Jones' journalism is driven by one simple question: Will America will move closer to, or further from, justice and equity in the years to come?

If you're able to, please join us in this mission with a donation today. Our reporting right now is focused on voting rights and election security, corruption, disinformation, racial and gender equity, and the climate crisis. We can’t do it without the support of readers like you, and we need to give it everything we've got between now and November. Thank you.

DEMOCRACY DOES NOT EXIST...

without free and fair elections, a vigorous free press, and engaged citizens to reclaim power from those who abuse it.

In this election year unlike any other—against a backdrop of a pandemic, an economic crisis, racial reckoning, and so much daily crazy—Mother Jones' journalism is driven by one simple question: Will America will move closer to, or further from, justice and equity in the years to come?

If you're able to, please join us in this mission with a donation today. Our reporting right now is focused on voting rights and election security, corruption, disinformation, racial and gender equity, and the climate crisis. We can’t do it without the support of readers like you, and we need to give it everything we've got between now and November. Thank you.

We Recommend

Latest

Sign up for our newsletters

Subscribe and we'll send Mother Jones straight to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.

Subscribe

Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.

Donate