A subtle change has been made to the comments links, so they no longer pop up. Does this in any way help with the problem about comments not appearing on permalinked posts, readers?
Wednesday, November 30, 2005
And Gladwell is right; the waving of the fingers in the air is indeed the main argumentative and rhetorical technique by which this book attempts to establish its conclusions. There are a number of things I don't like about Levitt's approach, but the biggest problem I have with him is his[2] habit of saying (in various forms of words) "whichever way you look at the numbers, XYZ" when he means "whichever way I look at the numbers, XYZ". On a lot of these subjects (by far the most obvious example is abortion/crime, but it is an issue in all of them to a greater or lesser degree), Levitt is looking at quite large, clearly multicausal issues where any model is likely to be partial and all manner of conflicting theories can claim support from the data. "Freakonomics" absolutely does not recognize this fundamental truth of econometrics; it might be because the authors don't have the statistical chops to understand it but I think it is much more likely that they are just trying to copy the monolithic tone of voice adopted by social reformers and similar blowhards who hand out their assertions with no data at all. In all honesty, I think that theL&D approach is a retrograde step; it's easy for the untrained reader to spot when someone has no empirical support at all for his position, but much more difficult to deal with someone who systematically overstates the empirical support that he does have. This is at least 90% of what makes John Lott so pernicious, and it seems to me that L&D are involved at least partly in the same sort of game. It's the game of pretending that difficult social questions have easy non-sociological answers. There are lots of people in this space, and not all of it is by any means bad. Any look at a difficult question is going to be either hopelessly oversimplified or hopelessly unreadable, and I would certainly prefer it if people erred in the first direction. There's also a decent Hayekian (or indeed Bayesian) point to be made here that if you're entering into the marketplace of ideas to try and extract the truth from a number of differing viewpoints, then you want everyone to give you their idea, not to caveat it all about with bits and pieces of other people's ideas. That's why I'm prepared to give a (limited) free pass to Malcolm Gladwell or James Surowiecki when they write books like this which, in my view, present absurdly oversimplified views of the world, because I understand what they're trying to do; to present their view on a question, not to give the final indisputable answer. The problem comes in when someone attempts to present their view of a question as if it is the final indisputable answer. A lot of the things in Freakonomics are things that I wouldn't make too much of a fuss about if the authors were just advancing them as their view of one way of explaining the facts. But they don't do that; at key points in the book, they keep claiming that they're reporting the facts when they're clearly (to me at least) reporting a particular spin on the facts. This is the pop-science approach to social questions, because it's trying to combine the authority of a scientific investigation with the unequivocal certainty of a theoretical pronouncement. What Levitt and Dubner are doing is exactly the same thing that Thomas Friedman does; telling a bunch of stories and then explaining how these stories fit into their view of the world. However, in the case of Friedman it's always obvious that someone else could tell entirely different stories about the same kinds of people and events and fit them into an entirely different worldview. Because of the way that Freakonomics has pitched itself at the pop-science crowd (constantly banging on about Levitt's John Bates Clark medal and referring to all the statistical analyses; for fans of cringeworthy exegesis, page 161 of the American edition contains what I strongly believe to be the worst description of the linear regression model ever committed to print), however, they are always either implying or outright saying that their stories are the only ones consistent with the facts, so we can either fit their stylized facts into our own worldview or (preferably) drop ours and buy theirs. As you can tell, I don't like this. The pop-science approach to economics is dangerous and irritating in itself (Krugman's "Pop Internationalism" refers). But when combined with the panache of a seasoned magazine journalist, it becomes downright sloppy. What actually set me off on this trail � the initial clue that there was something very wrong about Freakonomics was a throwaway remark, presumably inserted by Dubner and certainly unsupported by any of Levitt's work, to the effect that "the typical prostitute earns more than the typical architect". This remark is asinine. What on earth are they talking about? There is probably a reasonable working definition of a "typical architect" (though I can think of about five different types of architect off the top of my head), but what is a "typical prostitute"? Do they mean per hour or on an average annual earnings basis? Is there any data to back this up (the only study I could find put average earnings for street prostitutes in Los Angeles, who are about as "typical" as any other prostitutes at $23485 in 1991, which seems low for an architect)? Fair enough, this is really just a throwaway remark aimed at illustrating a point about labour market theory, but surely the whole freakonomicsing selling point of this book was meant to be that the authors didn't make lazy assumptions and throwaway remarks but checked things against the data. I'm sorry, but if a bloke says "of course, prostitutes make a mint, they do, they earn much more than you or I", then in my estimation it is going to count very much against his subsequent claim to never take things on trust or to tirelessly question conventional wisdom. And once you start looking at Freakonomics with a critical eye and the view that some of the facts in it might not have been checked all that well, you find a lot of other things start shimmering and vibrating with the temper of a fact at bay. The factoid about swimming pools and guns on page 150, for example, is really troubling to me. As presented in the book, the argument is obviously wrong. Levitt divides the number of child deaths caused by guns by the number of guns, then divides the number of child deaths caused by swimming pools by the number of swimming pools, compares the two numbers and says "if you have a gun in your house and a swimming pool, the pool is more likely to kill your child than the gun". Which might or might not be true, but this calculation can't possibly be the right way to prove it. Riddle me this; what proportion of the guns in the USA are held in households with no children in them? What proportion of the swimming pools in the US are owned by households with no children in them? Is there perhaps a pretty good reason to believe that households which differ in their gun ownership and swimming-pool ownership will also differ in other potentially relevant ways? Is there a good reason to believe that the fact that a house has a child in it will be informative about the relative likelihood of gun ownership and pool ownership? Now, Levitt might, for all I know, have actually done the more rigorous analytic work which would support his claim here. But if he did, I bet he did it in a proper journal where he stated the claim with the proper caveats and was totally clear about the degree of confidence that could be placed in it. But that's not what he does in "Freakonomics". He just a) puts the factoid straight in front of the reader with no qualifications at all and b) backs it up with a calculation that is clearly flat out wrong. He's simultaneously teaching the lay reader to make definitive statements without acknowledging estimation problems, and to ignore correlations between explanatory variables. How on earth can this not be worsening the overall level of debate? So we've got two central problems here; first, the admixture of empirical evidence and extrapolated conclusions, and second the curious mixture of carefully checked scientific work and completely unrigorous off the cuff assertions. We can find both of these problems hard at work in the chapter of the book where it is discussed what insights neoclassical economics can bring to understanding criminal gangs. From now on in, I'm going to assume that you have read the relevant chapter of Freakonomics; to be honest if you haven't you can probably work out what I'm talking about and it will help you to later pretend to have read the book at dinner parties[3]. The first thing I have to note in expounding an alternative theory of the criminal firm is that there is only a loose requirement on me to be consistent with the contents of the spiral notebooks which contained the "accounts" of the gang and which form the centerpiece of the chapter. With due respect to the risks Venkatesh took in the name of science in getting them, I think that by treating these notebooks as "data" on a par with the output of the BLS, Levitt is behaving in an extremely na�ve fashion. In particular, one of the things that (presumably) Dubner's attempts to make the overall narrative swing along doesn't fully conceal is that in Chapter 1 of the book, Levitt and Dubner are telling us that high school teachers cheat and misreport numbers all the time because there is an incentive for them to do so. However, when it comes to looking at the unaudited self-reported incomes of street crack dealers to a nominal boss who exercises next to no direct supervision over them, this cynicism is gone and we are meant to assume that what the numbers say is what happened. I simply don't buy this. Because of police busts if nothing else (and the street dealer's policy of swallowing the drugs he has on him if he even suspects a bust, after which operation the crack is no longer resaleable), the shrinkage in crack dealing must be at least as bad as in other forms of retailing. The opportunity for the street dealer to under-report sales, over-report losses and skim profits is very obvious and in the absence of either audit or supervision I would expect that this would happen all the time. If JT were to attempt to have an IPO of the Disciples, I would certainly not buy shares in it on the basis of the spiral notebooks[4]. They do present some anecdotal evidence that the gangsters were not well paid that doesn't depend on the notebooks, but it's if anything even weaker. The simple fact that someone lives with his mother is not actually knockdown proof that he is strapped for cash; something like thirty per cent of young Italian men do it for the simple reason that it's better than cooking and cleaning for yourself. I also think it's quite na�ve to assume that when the gang members (who were, we shall remember, full-time drug dealers) asked Venkatesh to try and get them a janitorial job at the university, this showed that anything, even cleaning toilets on minimum wage, was a better life than the Gangster Disciples. I am hardly the most streetwise guy around, but even I can work out a couple of other possible reasons why a full time drug dealer might want a job which allowed him to wander round a university campus more or less at will. Students buy drugs[5]. Furthermore, even if we take the numbers in the notebooks as reliable, we are faced with the observable fact that crack dealers (even street soldiers) have expensive tastes and hobbies. Even leaving aside the question of trainers and jewellery (on which I have no hard data about ownership to argue against Levitt), it is an undeniable fact that even the most junior members of the Gangster Disciples were able to engage in the hobby of pistol shooting, a popular but expensive middle-class pastime which I would consider to normally be beyond the means of a burger-flipper at McDonalds. The non-salary compensation of JT's street dealers might be really quite high; access to guns, free admission to nightclubs, favourable deals on stolen goods and clothing, regular social events with local rappers, it all adds up and compares really quite well to the fast food trade, and as far as I can see the informal healthcare plan was also quite generous compared to most mainstream employers in that it covered family members and had substantial death-in-service benefits which would have been worth quite a lot in a neighbourhood that was not exactly Hampstead even for non-gang members. I find the seeming absence of any analysis of the non-salary component of compensation quite strange, particularly since the underlying work was done working with a sociologist who would at least have some analytical framework which one might use to measure the value of the benefit to the gang member of being in a gang and thus having some degree of status in a community where status mattered. Once more, I'm not saying here that my own interpretation of the evidence is the right one, just that Levitt and Dubner are in the business of telling stories here (as opposed to adding up numbers), that other stories can be told, and that in my opinion the authors of Freakonomics try much too hard to give the impression that they are reporting facts when they are actually just telling stories. So anyway, on to the two central claims of the Freakonomics crack gang chapter. These are 1) that a criminal gang is reasonably similar to a capitalist business and 2) that a criminal gang is usefully modeled as a "tournament" reward structure where people are prepared to accept a very low initial reward and/or very unsatisfactory conditions because there is a small chance of rising to a level where there is a very high reward. I'll deal with the second claim first; Levitt & Dubner describe the economics of a tournament as I have described above. It is about at this point that they make the silly claim about prostitutes and architects, and then go on to say that "cheerleaders from Nebraska" are prepared to move to Hollywood and accept low wages as waitresses (unless, I suppose, they choose to become prostitutes, given that this is apparently Adam Smith rewritten as Letters to Penthouse) because they dream of getting a big break as movie starlets. Fair enough, but this implies a whole host of rather shaky looking empirically testable propositions. In general, do organized crime gangs recruit youngsters by promising them that if they knuckle down and perform well, they might end up being the top man? In existing organized crime gangs, is the whole thing set up so as to reward young chaps who want to rise to the very top and take over (was The Godfather completely deceitful on this point?) Subjectively as reported, do street-level crack dealers aspire to being gang bosses themselves? There is no evidence in the book at all from the gangsters themselves that they do (as opposed to Levitt and Dubner attributing this motivation to them in circumstances where other motivations are entirely possible). There are a few organizational predictions that would normally drop out of this theoretical framework too, none of which look all that attractive. In most companies which operate "tournament" reward structures (paradigmatically, law firms structured as partnerships), there is a clear culture of "up or out". Employees are encouraged to leave if they are not making progress up the hierarchy. This doesn't seem particularly like the culture of a criminal gang at all; gangs don't like people leaving them. In fact, if you read between the lines of the description of the gang in Freakonomics, it seems pretty clear that JT spent a lot of time and effort on keeping his street-level soldiers contented with their lot. There's really no sense in there that the Gangster Disciples were all aware that life as a low-level gangster was meant to be rough and that it wouldn't be worth living unless they could get to the top. Quite the opposite, in fact. In any case, there's a more fundamental oddity in the reward structure that Levitt & Dubner describe, and that's that according to Freakonomics, the street dealers of the Black Disciples were paid a wage by their leader (which went up or down depending on how dangerous the streets were), and didn't make any material part of their income from sales commissionThis is an extremely weird way to structure the remuneration of a sales force (actually, if I had my own Freakonomics hat on, I would almost say that it's so weird that it calls into question the credibility of all of the other claims made about the economic organization of the crack gang). It might be that Levitt & Dubner are speaking loosely and when they say "wages" they mean "total compensation including sales-related commission", but if they are, it's unforgivably sloppy; if there's one distinction that an economist ought to be persnickety about, this is it, so I think they aren't. If it really is true that the Disciples paid their gang members purely on the basis of hard work and/or bravery rather than revenue productivity, then this means that the "tournament" if tournament it is, is a pretty strange one. It's made clear at numerous points during the chapter that sales performance is almost irrelevant to this "tournament"; not only is there no commission, but promotion to the upper ranks is dependent on intangibles like "personality" and "leadership", coupled with actively counterproductive behaviour like starting turf wars and killing customers. Even Tyco didn't have an executive incentive scheme this warped. But given that the organization doesn't reward behaviours which contributed to the economic success of the business, what's to make anyone think that the individuals in the organization valued economic success above anything else? If the Black Gangster Disciple Nation was prepared to reward and promote people who systematically undermined its main business activity by starting turf wars and killing for honour, then might this not be taken as good evidence that the Black Gangster Disciples cared more about turf and honour than they did about money? And if that's the case, then why do we assume that people joined the gang with the main objective of enjoying the lifestyle of its top members? I am now shading into my critique of the other main assertion of the chapter on the Disciples, however; the claim that there is any meaningful analogy between a criminal gang and the neoclassical theory of the firm. I think that there isn't, but this argument merits a separate post (coming soon), in which I will attempt to see if other economic traditions can do any better and develop "The Heterodox Economic Theory Of The Criminal Firm". So long for now. [1] Just to make it clear, the reason that I'm posting this here is that the quality of content on D2D has been right down the toilet recently, rather than anything more sinister with respect to Crooked Timber. [2] (possibly Dubner's, but it is a figure of speech that I think sounds more like an economist than a journalist). In general I'm going to say "Levitt" as if he was the only author of the book; I will explain why I am following this policy in a future post. [3] I of course mean by "you can pretend to have read the book at dinner parties" that when you are at parties you can pretend to have read the book, not that you can pretend to be the kind of person who goes to a party and sits in the corner reading Freakonomics. [4]Actually, the fact that they are specifically referred to as "spiral notebooks" is not just a minor detail of stationary which gives descriptive colour to the story, and if Venkatesh had gone to the business school rather than the economics department to find a co-author someone might have tipped him off. If you get a job doing audit work at Deloittes, try going round writing things on a spiral pad and see how long it takes for someone to give you a bollocking. Spiral pads are not acceptable stationary for scientific lab-books or for auditing, precisely because it is easy to rip pages out of them. I don't have any evidence that this happened with respect to the notebooks in question, but it's the sort of thing that needs to be taken into consideration. [5] As well as the fact that students buy drugs, there are other good reasons why drug dealers would want to have minimum wage jobs other than to supplement their meager incomes. The police are in general much more difficult to deal with if they believe that you are a "career criminal", so it makes sense to have at least a token stab at gainful employment; obviously you would out of preference want something with little or no supervision and hours that did not conflict with your criminal business. In his autobiography, the British celebrity villain "Dodgy Dave" Courtney mentions having been given this advice in the 1960s and getting a job as a binman as a result, and I suspect that gangsters in Chicago would have worked it out too. 0 comments this item posted by the management 11/30/2005 08:16:00 AM
|
