
God, Guns, and Suicide
Published May 28, 2013 • Read time: 8m
Join the Conversation
0Last week, Ross Douthat wrote a column tying the recent rise in suicide rates nationally to the retreat of society from traditional institutions, including religion and marriage. Nate Cohn of The New Republic responded with a column in which he argued:
Contrary to what Douthat might expect, there’s no correlation – zero -- between a states’ [sic] suicide rate and religion, marriage rates, or single occupancy homes. State economic growth or unemployment don’t line up, either. … If anything correlates with suicide rates, it’s a states’ [sic] population density: In populous areas, suicide rates are low; in the sparsely populated hinterlands, suicide rates are high. … A more intriguing possibility is gun ownership, which, like suicide rates, is highest in the West and lowest in the Northeast. … Then again, the South has high levels of gun ownership and higher levels of depression than the inland West, but suicide is rarer in Alabama than Montana.
Cohn has since followed up with this article, and to be fair I’m not entirely certain how much of the above is still his argument. He now appears to contend, for example, that economic development actually does play a substantial role in driving suicides.
Regardless, my purpose here isn’t so much to look at the merits of the various claims and counterclaims -- I have no particular dog in this fight, because I doubt I’m going to add much to a question that has been studied and debated extensively by sociologists for decades. Rather, I want to focus on the particular example excerpted above from Cohn’s first piece, because I think there’s something valuable about the use of statistics to be learned here.
In particular, I found it intriguing that Cohn didn’t discern any relationship between religiosity and suicide rates, when there are a raft of studies using international, state, and individual data sets concluding that there is such a relationship.
Indeed, at first blush, it seems that Cohn is correct: If you run simple, bivariate regressions of state suicide rates against states’ levels of religiosity, population density, and gun ownership, the latter two factors have statistically significant relationships with suicide rates, while the former does not (divorces per 1,000 males actually is significantly related here, but there are varying ways of measuring this, and I’m assuming Cohn is just using a different data set).
But simple regressions have their limits, especially when explaining complex phenomena. Sometimes relationships become apparent only after you control for other factors. For example, assume we are trying to figure out something relatively simple: Which factors affect how much gas our (unfortunately hypothetical) C5 Corvette consumes.
Our initial -- perfectly reasonable -- hypothesis is that this is largely a function of how many miles we drive. So, every time we stop for gas, we write down the mileage on the odometer, as well as the number of gallons of gas we put in the tanks.* At the 15th stop, we calculate the following:
Note that the first stop was when we first wrote down our mileage, so we couldn’t calculate total miles driven on that tank.
After running the regression analysis, we find, surprisingly, that there actually isn’t a statistically significant correlation between the number of miles driven and the amount of gas consumed at the “industry standard” of 95 percent confidence. We only explain about 18 percent of the variance overall. How can this be?
Well, it turns out that the relationship between miles driven and gas consumed is dependent on an additional piece of data: A C5 Corvette does about 10 miles per gallon better on the Interstate than in cities.
So we would prefer a multivariate regression analysis here. While simple regression simply looks at the relationship between factors “A” and “B,” multivariate analysis looks at what sort of relationship there is between “A” and “B” when you hold factor “C” constant. If we’d taken note of what percent of our driving had been on the Interstate (here, generated randomly), our chart might have looked like this:
If we run our regression using both “miles driven” and “freeway” as variables, we now explain 99 percent of the variance, and both of the variables are strongly significant. (Of course, in the real world, temperature, air density, tire wear and inflation, and a host of other factors will impact our mileage.)
If we compare the data output for the first and second regressions, we can see what has happened. Controlling for freeway/street driving changes our understanding about the magnitude of the coefficient for miles driven, as well as the precision with which that coefficient is estimated (and thus its statistical significance). Put in lay terms, a necessary precondition to understanding the relationship between miles driven and gallons consumed is considering the type of miles driven.
This problem manifests in our suicide/religion debate in a couple of ways. Cohn suggests that population density and gun ownership are related to the suicide rate. As it turns out, however, this is saying something of the same thing: There’s a statistically significant relationship between state population density and gun ownership. In fact, once you control for gun ownership across states, the population density variable adds nothing to our analysis and is no longer anywhere close to significant.
What about religiosity? As it turns out, once you control for gun ownership, religiosity does have a statistically significant relationship with suicide (p
In other words, in a hypothetical state with no guns and no religion, we’d expect a suicide rate of 17 (per 100,000), give or take a few points. In a state where everyone had guns, and no one practiced religion, we’d expect a suicide rate of 39. If everyone were religious, but no guns: 11. Everyone religious, everyone owns a gun: 21. From a political perspective, there’s really something for both the left and right to like here.
When you add divorces per 1,000 men, it is still significantly related to suicide rates in a state, and population density is even less related.
Of course, to really get this right, we’d probably need a few more variables (although with the few I messed around -- income, foreclosure rate, race, male/female ratio -- the religion/guns axis remains significant by any commonly accepted measure). We’d also probably want to break down our data among different religions. Perhaps most importantly, to get around the substantial ecological fallacy problem, we would want to do better than the state level (unfortunately, county-level data on firearms possession doesn’t exist, although some rough proxies are available). But as noted above, studies performed at the individual level seem to reach roughly the same conclusions.
We must also remember that all we’re really finding here are correlations. Making the leap to causation is just that: a leap. Whenever you find a correlation between A and B, it’s possible that B causes A (hard to see how that’s possible here, but think of the rooster crowing followed by sun rising, though the causation runs in the other direction). It’s possible that outside factor C causes both A and B (perhaps whites have a greater disposition toward depression, are more likely to own guns, and are less likely to be religious).
It’s also possible that we’re just finding one of the instances of random noise that pop up more frequently than you’d expect (between 1932 and 2004, there’s a statistically significant correlation between the Washington Redskins’ margin of victory or defeat in their last home game before an election, and the incumbent president’s margin of victory or defeat).
There is one other point worth making here. In both articles, Cohn concludes that “[a]fter all, suicide rates are lower today, even for the middle-aged, than they were in 1960 and 1970 -- that is, back in the good old days of traditional institutions that, if Douthat were right, should have discouraged people from killing themselves.”
This is a bit too cute. As Cohn notes, there are other factors that increase suicide rates, such as gun ownership and (in his telling) light population density. Both have declined over the past 50 years; in the case of gun ownership it’s been pretty substantial. Perhaps the suicide rate would be lower if traditional institutions hadn’t likewise shrunk? There are ways to test for this, and perhaps a time-series analysis wouldn’t find the relationship Douthat posits. The point is, there are quite a few more steps that need to be taken before the simultaneous declines in suicide rate and religiosity can be taken as evidence that Douthat’s hypothesis is incorrect.
Regardless, it does appear quite possible that the suicide rate has something to do with marriage and religion, once you put a few basic controls in place.
*A C5 actually has two 9.2 gallon tanks. When I ran the numbers I assumed the 20-gallon tank used by a C4 and randomly generated numbers between 18 and 21.1 (virtually running the car completely dry, which is extremely inadvisable). It doesn’t really matter for our illustration though.
RCP Today
Top stories on RealClearPolitics
The Takeaway
Polling intelligence and analysis delivered to your inbox
World News
Featuring the latest world news
Policy
Featuring the latest policy news
Support Our Mission
As part of RealClearPolitics, authors aim to provide balanced, non-partisan analysis by presenting top reporting and commentary from all sides of the political spectrum.
Trusted by policymakers and citizens alike since 2000






