The Perils and Pitfalls of Statistical Analysis

Fight disinformation: Sign up for the free Mother Jones Daily newsletter and follow the news that matters.

This is mostly in the pointless frivolity category, but the chart below from Matt Glassman shows total annual volume of email received by Congress since 1996. Matt has a few observations about what this all means, which you should read, but what I’m curious about is the huge drop in 2008-09. What happened? Matt says it’s a technical artifact: “The large peak in 2007 and the drop-off following it are almost certainly due to the explosion of more intelligent spam and the corresponding adoption of powerful new and improved spam filters in both chambers that year.”

If that’s true — and corroboration would be welcome from anyone with working knowledge of this stuff — it’s an object lesson in statistical analysis. Land mines are everywhere! If you saw this chart and concluded, say, that the financial crisis had somehow wiped out people’s desire to email their congresscritters, and then built an elaborate theory around that guess, you’d be totally wrong. It would be a perfectly reasonable theory, but it would be wrong. In reality, nothing interesting happened at all. Caveat emptor.

WE'LL BE BLUNT:

We need to start raising significantly more in donations from our online community of readers, especially from those who read Mother Jones regularly but have never decided to pitch in because you figured others always will. We also need long-time and new donors, everyone, to keep showing up for us.

In "It's Not a Crisis. This Is the New Normal," we explain, as matter-of-factly as we can, what exactly our finances look like, how brutal it is to sustain quality journalism right now, what makes Mother Jones different than most of the news out there, and why support from readers is the only thing that keeps us going. Despite the challenges, we're optimistic we can increase the share of online readers who decide to donate—starting with hitting an ambitious $300,000 goal in just three weeks to make sure we can finish our fiscal year break-even in the coming months.

Please learn more about how Mother Jones works and our 47-year history of doing nonprofit journalism that you don't find elsewhere—and help us do it with a donation if you can. We've already cut expenses and hitting our online goal is critical right now.

payment methods

WE'LL BE BLUNT

We need to start raising significantly more in donations from our online community of readers, especially from those who read Mother Jones regularly but have never decided to pitch in because you figured others always will. We also need long-time and new donors, everyone, to keep showing up for us.

In "It's Not a Crisis. This Is the New Normal," we explain, as matter-of-factly as we can, what exactly our finances look like, how brutal it is to sustain quality journalism right now, what makes Mother Jones different than most of the news out there, and why support from readers is the only thing that keeps us going. Despite the challenges, we're optimistic we can increase the share of online readers who decide to donate—starting with hitting an ambitious $300,000 goal in just three weeks to make sure we can finish our fiscal year break-even in the coming months.

Please learn more about how Mother Jones works and our 47-year history of doing nonprofit journalism that you don't elsewhere—and help us do it with a donation if you can. We've already cut expenses and hitting our online goal is critical right now.

payment methods

We Recommend

Latest

Sign up for our free newsletter

Subscribe to the Mother Jones Daily to have our top stories delivered directly to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.

Subscribe

Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.

Donate