Monday, September 17, 2007

From the department of "Well Yes"

From Stephen Levitt's latest paper on the Ku Klux Klan:

"Perhaps the most limiting feature of our data is that we were unable to obtain any records on Klan members or activities in the Deep South.

Indeed. Perhaps more on this later, particularly if a non-gated version turns up. As it is, I've looked at it and it epitomises all that's good and bad about Levitt's research. The "unique dataset" that they've put together (basically a fuzzy-match of Klan membership lists to census data) is quite cool. The uses they've put it to are crazy - in particular, it looks to me as if a lot of the regressions they've run on Klan membership versus lynchings, Republican vote share, net migration etc, are structurally very similar to the "more guns less crime" model, and reproduce all of that model's problems with endogeneity, reverse causation etc.

But the big two problems they have are 1) the dataset is dominated by Pennsylvania and Ohio, and it clearly doesn't pass the laugh test to be doing a "rigorous" assessment of the effectiveness and aggressiveness of the Ku Klux Klan as a terrorist organisation based on what happened in non-Confederate states, and 2) they just totally ignore the literature. There is no mention, for example, of any secret societies other than the KKK (they claim that the Know-Nothings were the only precedent, which is just not true). This is quite an ommission in the context of Indiana - recall that the Supreme Tribe of Ben-Hur were big in Indiana too. And they act like they have made a massive discovery that the Klan acted like a pyramid-selling scheme generating money for those at the top, whereas this is like an utter commonplace of the history of secret societies in the USA - the business was so institutionalised that there were plenty of professional insurance lodge salesmen hanging about (and indeed the revival Klan was partly founded by one).

So, dodgy use of interesting data in order to partially reinvent the wheel, hyped to the sky as definitive and rigorous. Freakofreakinomics.

Update: Aha, here ye go, via the Marginal Revolution comments. Note that the stereotype of KKK members as ill-educated hicks is really a hell of a straw man; the demographics of the Klan (that they skewed lower-middle class, like the Poujadists, Blackshirts and basically every other fascist movement ever) have been known for a long time by all serious historians, who have dug through the registers and names, although not on this sort of systematic basis. To be honest, the pure and simple cost of the KKK as a hobby more or less ensured that it was mainly a well-off man's pleasure.

Update Update: (via Cian in the comments) - look at this. There surely is no excuse for that? At some point, the constant drip drip of this rubbish surely has to have some sort of effect on Levitt's academic credibility? Either he thinks that the NYT article linked is good enough research to be published under his name, which would be really worrying, or he knows it's crap and is publishing it anyway for the cash, which is also not hugely edifying.

3 comments:

  1. They also had this article in the NYT yesterday:

    http://www.nytimes.com/2007/09/16/magazine/16wwln-freakonomics-t.html?ex=1347595200&en=a76ad5fa1791d047&ei=5090&partner=rssuserland&emc=rss

    Apart from the rather dubious argument, which lacks internal consistency, and the inept discussion of risk/attitudes towards; note how he recycles the right wing talking point about Jane Fonda being responsible for America being anti-nuke.
    I also find his trust in companies to be rather bizarre. It doesn't take much work to discover that the American nuclear industry is run by disreputable, cheapskate, lying bastards, much like our own.

    And where does he get the idea that France has 80% nuclear power due to global warming? Is he simply allergic to history?

    ReplyDelete
  2. That is possibly the worst article, on any topic at all, that I have ever read (at least, it's a strong contender for winner in the "Not Nirpal Dhaliwal Category").

    Not even any real economics in there either - if the USA had gone heavy on nukes, then that would have had an effect on the world price of oil, gas and coal (and uranium), which in turn would have had implications for Indian and Chinese policy, among other things.? Surely to hell if economists are worth anything at all, it's because of thinking about these system-wide effects?

    "The answer lies in a PhD dissertation ...". It always does, Steve (and Steve), it always fucking does. But they don't even go anywhere with Knightian uncertainty (which was hardly 100% an innovation of Knight anyway) and the Ellsberg paradox - they just mention them and on we go. Pure fucking awful.

    More information on the research behind this column is online at www.freakonomics.com

    the mind boggles.

    ReplyDelete
  3. So basically you're saying that Levitt has written a history of inter-war British trade unionism based on membership rolls of the Windsor and Chalfont St Giles areas?

    ReplyDelete