Informed Comment

Thoughts on the Middle East, History, and Religion

Juan Cole is President of the Global Americana Institute

Wednesday, October 11, 2006

655,000 Dead in Iraq since Bush Invasion

It is a big news day. Don't miss my interview with veteran Iraq reporter Rajiv Chandrasekaran, below.

Among other things, on Tuesday guerrillas blew up a bakery in Baghdad and killed and wounded a lot of people; police found over 50 bodies in the streets of the capital; guerillas claimed to have hit a US ammunition depot with mortar shells, setting off huge explosions that rocked Baghdad for hours but were not known to have killed anyone; and 5 US soldiers were reported killed in separate incidents.

But the big news is a big new Johns Hopkins study published in The Lancet that suggests that the US misadventure in Iraq is responsible for setting off the killing of twice as many civilians as Saddam managed to polish off in 25 years.

A careful Johns Hopkins study has estimated that between 420,000 and 790,000 Iraqis have died as a result of war and political violence since the beginning of the US invasion in March, 2003.

Interesting conclusions are that we are wrong to focus so much on suicide car bombings. The real action is just shooting enemies down with bullets. Only 30 percent of the deaths have been caused by the US military, and that percentage has declined this year because of the sectarian war.

And, folks, this is a major civil war, with something close to 200,000 dying every year.

I once warned that a precipitate US withdrawal could result in a million dead a la Cambodia or Afghanistan. Little did I know that the conditions created by the US invasion and occupation have all along been driving toward that number anyway!

This study is going to have a hard ride. In part it is because many of us in the information business are not statistically literate enough to judge the sampling techniques. Many will tend to dismiss the findings as implausible without a full appreciation of how low the margin of error is this time. Second, it is a projection, and all projections are subject to possible error, and journalists, being hardnosed people, are wary of them.

The New York Times report has already made a serious error, saying that deaths in the Saddam period were covered up. The families interviewed knew whether their loved ones were disappearing in 2001 and 2002 and had no reason to cover it up if they were. The survey established the baseline with a contemporary questionnaire. It wasn't depending on Iraqi government statistics.

Another reason for the hard ride is that the Republican Party and a significant fraction of the business elite in this country is very invested in the Iraq War, and they will try to discredit the study. Can you imagine the profits being made by the military-industrial complex on all this? Do they really want the US public to know the truth about what the weapons they produce have done to Iraqis? When you see someone waxing cynical about the study, ask yourself: Does this person know what a chi square is? And, who does this person work for, really?

Then Anthony Cordesmann told AP that the timing and content of the study were political. But is he saying that 1800 households from all over Iraq conspired to lie to Johns Hopkins University researchers for the purpose of defeating Republicans in US elections this November? Does that make any sense? And, if Cordesmann has evidence that the authors and editor set their timetable for completion and publication according to the US political calendar, he should provide it. If he cannot, he should retract.

Ironically enough, the same journalists who will question this study will accept without query the estimates for deaths in Darfur, e.g., which are generated by exactly the same techniques, and which are almost certainly not as solid.

The study concludes that an average of 470 Iraqis per day have likely died as a result of political violence since March 19, 2003, though the number could be as low as 350 per day if the margin of error skewed to the low side. United Nations estimates based on figures from Iraqi morgues are more like 100 per day.

I follow the violence in Iraq carefully and daily, and I find the results plausible.

First of all, Iraqi Muslims don't believe in embalming or open casket funerals days later. They believe that the body should be buried by sunset the day of death, in a plain wooden box. So there is no reason to expect them to take the body to the morgue. Although there are benefits to registering with the government for a death certificate, there are also disadvantages. Many families who have had someone killed believe that the government or the Americans were involved, and will have wanted to avoid drawing further attention to themselves by filling out state forms and giving their address.

Personally, I believe very large numbers of Iraqi families quietly bury their dead without telling the government of all people anything about it. Another large number of those killed is dumped in the Tigris river by their killers. A fisherman on the Tigris looking for lunch recently caught the corpse of a woman. The only remarkable thing about it is that he let it be known to the newspapers. I'm sure the Tigris fishermen throw back unwanted corpses every day.

Not to mention that for substantial periods of time since 2003 it has been dangerous in about half the country just to move around, much less to move around with dead bodies.

There is heavy fighting almost every day at Ramadi in al-Anbar province, among guerrillas, townspeople, tribes, Marines and Iraqi police and army. We almost never get a report of these skirmishes and we almost never are told about Iraqi casualties in Ramadi. Does 1 person a day die there of political violence? Is it more like 4? 10? What about Samarra? Tikrit? No one is saying. Since they aren't, on what basis do we say that the Lancet study is impossible?

There are about 90 major towns and cities in Iraq. If we subtract Baghdad, where about 100 a day die, that still leaves 89. If an average of 4 or so are killed in each of those 89, then the study's results are correct. Of course, 4 is an average. Cities in areas dominated by the guerrilla movement will have more than 4 killed daily, sleepy Kurdish towns will have no one killed.

If 470 were dying every day, what would that look like?

West Baghdad is roughly 10% of the Iraqi population. It is certainly generating 47 dead a day. Same for Sadr City, same proportions. So to argue against the study you have to assume that Baquba, Hilla, Kirkuk, Kut, Amara, Samarra, etc., are not producing deaths at the same rate as the two halves of Baghad. But it is perfectly plausible that rough places like Kut and Amara, with their displaced Marsh Arab populations, are keeping up their end. Four dead a day in Kut or Amara at the hands of militiamen or politicized tribesmen? Is that really hard to believe? Have you been reading this column the last three years?

Or let's take the city of Basra, which is also roughly 10% of the Iraqi population. Proportionally speaking, you'd expect on the order of 40 persons to be dying of political violence there every day. We don't see 40 persons from Basra reported dead in the wire services on a daily basis.

But last May, the government authorities in Basra came out and admitted that security had collapsed in the city and that for the previous month, one person had been assassinated every hour. Now, that is 24 dead a day, just from political assassination. Apparently these persons were being killed in faction fighting among Shiite militias and Marsh Arab tribes. We never saw any of those 24 deaths a day reported in the Western press. And we never see any deaths from Basra reported in the wire services on a daily basis even now. Has security improved since May? No one seems even to be reporting on it, yes or no.

So if 24 Iraqis can be shot down every day in Basra for a month (or for many months?) and no one notices, the Lancet results are perfectly plausible.

The abstract for the study says:


' Methods: Between May and July 2006 a national cluster survey was conducted in Iraq to assess deaths occurring during the period from January 1, 2002, through the time of survey in 2006. Information on deaths from 1,849 households containing 12,801 persons was collected. This survey followed a similar but smaller survey conducted in Iraq in 2004. Both surveys used standard methods for estimating deaths in conflict situations, using population-based methods.

Key Findings: Death rates were 5.5/1000/year pre-invasion, and overall, 13.2/1000/year for the 40 months post-invasion. We estimate that through July 2006, there have been 654,965 “excess deaths”—fatalities above the pre-invasion death rate—in Iraq as a consequence of the war. Of post-invasion deaths, 601,027 were due to violent causes. Non-violent deaths rose above the pre-invasion level only in 2006. Since March 2003, an additional 2.5% of Iraq’s population have died above what would have occurred without conflict.
The proportion of deaths ascribed to coalition forces has diminished in 2006, though the actual numbers have increased each year. Gunfire remains the most common reason for death, though deaths from car bombing have increased from 2005. Those killed are predominantly males aged 15-44 years. '


More on the techniques from the text:

' The surveyors from the School of Medicine of Al Mustansiria University in Baghdad conducted a national survey between May and July 2006. In this survey, sites were collected according to the population size and the geographic distribution in Iraq. The survey included 16 of the 18 governates in Iraq, with larger population areas having more sample sites. The sites were selected entirely at random, so all households had an equal chance of being included. The survey used a standard cluster survey method, which is a recommended method for measuring deaths in conflict situations. The survey team visited 50 randomly selected sites in Iraq, and at each site interviewed 40 households about deaths which had occurred from January 1, 2002, until the date of the interview in July 2006. We selected this time frame to compare results with our previous
Human Cost of Iraq War survey, which covered the period between January 2002 and September 2004. In all, information was collected from 1,849 households completing the survey, containing 12,801 persons.

This sample size was selected to be able to statistically detect death rates with 95% probability of obtaining the correct result. When the preliminary results were reviewed, it was apparent three clusters were misattributed. These were dropped from the data for analysis, giving a final total of 47 clusters, which are the basis of this study. '

31 Comments:

At 12:04 PM, Blogger pseudonymous in NC said...

On the statistics: Daniel Davies' assessment of the various critiques of the earlier Lancet study should be necessary reading, since it delineates hackish critiques from merely misguided ones.

Those who say 'the earlier study was wrong, so this is wrong' are the biggest hacks of all. The irrepressibly ignorant William Sjostrom appears to believe that Iraqi families are faking death certificates, or that researchers are faking their results, simply to affect the US mid-terms. People like him can be easily dismissed as unserious.

 
At 12:39 PM, Blogger Dan said...

On whether the timing is political: iirc, one of the authors of the 2004 John Hopkins/lancet mortality survey (who are essentially the same folks that did this) did say it was rushed through publication to be available before hte elections that year. I'm sure the pro-war bloggers will have an exact quotation pretty soon; if not I'll track it down myself.

More importantly, you say many relatives of the dead wouldn't have gone through the hassle of getting death certificates. But the John Hopkins team found that 90% of relatives did produce a death certificate when asked (they only asked 87% of them) - see the Baltimore Sun

Also: it looks like you have seen the full text of the paper. Is it available online yet, or have you just been emailed it in advance?

 
At 12:56 PM, Blogger Spin proof said...

A large percentage of the Iraqis wounded in the violence die of their wounds or complications later due to the limited and poor healthcare and medicine shortages.

Another good reason to bury your dead quietly is that being a victim in Iraq incriminates your family! If the local Salafi or Mahdi turbans murder a member of your family, then you are either dishonoured (if the killing is for non-Islamic behavior like wearing a necklace or playing soccer,) or become a suspect of being an agent of another group.

 
At 12:56 PM, Blogger historyguy said...

Dear Juan, Another devastating post.

Just to be statistically correct in one's Chi squares is meaningless if the data are corrupt. In my freshman year of college -- which began while LBJ was president -- I promised to do a survey for my statistics class, and of course it turned out that smoking pot and chasing girls were much more important pursuits. So I totally faked a set of data, with immaculate Chi squares.

Anyway, if survey teams are going to public or semi-public sites and talking to the first forty family groups who wish to talk about their deaths, then there would seem to be a risk of "self-selection of population" by people who were most aggrieved about their deaths. Those deaths most probably all have occurred, yet these are the 40 families out of X who are most concerned about their deaths, probably because they have suffered disporportionally to other families. Now maybe the survey methodology takes account of all this, and certainly from the researchers POV it's a convenient method of working in a conflicted area and may have some studies to back up its validity as a method.

The Koranic injunction on burials is an important correction to morgue figures, so I'm not disputing the possibility of the Lancet figures being correct. It depends on what measures the methodology has taken to prevent population self-selection, if I am correctly understanding the survey method.

 
At 1:32 PM, Blogger grytpype said...

"Second, it is a projection"

As I understand the methodology, the estimate of deaths is based on sampling, using a method that is well accepted in epidemiology.

What is a projection is what the death rate would have been if the invasion had not occurred, the difference -- the "excess deaths" -- being attributed to the war.

 
At 2:19 PM, Blogger Cyrus said...

This figure, of course, does not include the 300,000-500,000 Iraqi children who died as a result of the pre-invasion US sanctions and destruction of water treatment facilities, as estimated UNICEF/WHO and by also by Richard Garfield: http://www.casi.org.uk/info/garfield/dr-garfield.html.

 
At 2:43 PM, Blogger Randal said...

the same journalists who will question this study will accept without query the estimates for deaths in Darfur, e.g., which are generated by exactly the same techniques

You make an important point here, which should give everyone in the west pause for thought about how the received opinion on matters in foreign countries is formed.

From my perspective, the point reinforces the urgent need for the primacy of strict non-intervention as the basis for governmental action. What we think we "know" about foreign countries is almost certainly inaccurate, and that is why our interventions more often than not will cause catastrophes, as in the cases of Iraq and Kosovo.

The same applies somewhat differently to experts (such as yourself, Professor Cole). An entire nation is simply too complex for any human being to fully comprehend, and all we achieve, generally, by personal experience of a foreign nation's affairs (whether by travel or by academic study) is to attain a greater (but still dramatically incomplete) general level of knowledge at the unavoidable cost of acquiring personal bias. Thus, the opinion of experts arguing that something must be done is just as likely to mislead.

The above is not to deny the undoubted value of studying foreign countries, or the clear benefits of personal experience of foreign cultures. When the resulting opinions argue for interference, though, we should be mindful of the profound limitations of this kind of expertise.

 
At 2:52 PM, Blogger ripa said...

I agree with you that it is ridicule that people who are likely to know nothing about statistics (e.g. "Frederick Jones, a spokesman for the National Security Council", who is cited in the USA Today link you provide) can label this study as "flawed" and get away with it. And I would add that Cordesmann's remarks about publication timing are off the mark also because Lancet is a peer reviewed journal, where the publication time depends on the reviewers of the paper and not on the authors.

From the technical (statistical) point of view, the only remark which actually makes sense to me is the one by "Robert Blendon, director of the Harvard Program on Public Opinion and Health and Social Policy", who was quoted by the NYT saying that "the number of deaths in the families interviewed [...] was too few to extrapolate up to more than 600,000 deaths across the country.".
I tried to estimate how big this effect might be through some numerical simulations, and found that in this respect the margins of error which are quoted in the summary you provide are extremely solid, except in the case of a very uneven mortality distribution (e.g. one in which you assume that most of Iraq is as peaceful as before the invasion, but the remainder is in total chaos), where there exists a decent chance (say 1%-5%) that the real mortality increase is about half of what was measured. Even in this case, the war death toll would be 300,000, and it is practically impossible to get below that (unless the authors are lying..).

However, I would like to read the paper itself (for example, I would like to know if they base their conclusions upon means or medians), and I cannot find its text: could you provide a link, or is it behind some subscription firewall?

Thank you for all the effort you put in your blog.

 
At 3:12 PM, Blogger wardog100 said...

Well, not to brag, Juan, but Wardog years ago told you that Bush's policy of death squads is to promote catastrophe. So welcome to the club! Its good to see you change your views. "I once warned that a precipitate US withdrawal could result in a million dead a la Cambodia or Afghanistan. Little did I know that the conditions created by the US invasion and occupation have all along been driving toward that number anyway!"

 
At 3:15 PM, Blogger springrecall said...

I am a physician who worked at the CDC as an EIS Officer in 2003-2005. I also have an MPH in epidemiology from the University of Michigan. I am convinced that this study's conclusions are completely valid.

Today's Washington Post article indicates that "The recent survey got the same estimate for immediate post-invasion deaths as the early survey, which gives the researchers confidence in the methods. The great majority of deaths were also substantiated by death certificates."

The Washington Post article also stated that, "The interviewers asked for death certificates 87 percent of the time; when they did, more than 90 percent of households produced certificates."

And let us remember that Johns Hopkins University's Bloomberg School of Public Health is by far the leading and most prestigious public health research school in the world. And The Lancet is one of the top 3 peer-reviewed medical journals in the world. Both Johns Hopkins University's Bloomberg School of Public Health and The Lancet require very rigorous and statistically sound methods before allowing publication.

 
At 4:24 PM, Blogger David Wearing said...

Juan - you're quite right to warn of the attempts that will be made to bury this report. This is exactly what happened two years ago, when the same researchers estimated 100,000 killed by our invasion of Iraq. Then all manner of people (not epidemiologists mind you, but editorial writers, columnists etc) piped up to challenge the findings. The findings, having been "challenged" by an assortment of amateurs with a political agenda (including the politicians responsible for the deaths), were then deemed to be "controversial" and banished to what George Orwell described as the "memory hole".

Imagine if you will a peer-reviewed report, using accepted scientific techniques, estimating a certain death toll for the USSR's war in Afghanistan, being dismissed as "controversial" by the Western media on the basis that the report's findings were challenged by the Kremlin and Pravda. Or the conclusion that smoking causes cancer being dismissed as "controversial" because on the one hand the entire medical community thinks it does but on the other hand Big Tobacco and some of its media lackeys disagree.

The UK pressure group Medialens (who use Chomsky's famous Propaganda Model as their starting point) have produced an excellent and illuminating commentary on how that previous Lancet report was buried by the Western political class. You can read part 1
here

and part 2 here. They detail the responses they received when they challenged those who had attacked the report with the scientific merits of its methodology. They also facilitated debate between one of the report's authors and some of those critics. The extent to which the critics are out of their depth is almost embarrassing. Yet, as Medialens show, it was the critics that carried the day and shaped the public perception of the report, not the people with the scientific expertise which would actually qualify them to make a judgement on the matter.

I also recommend this article by Stephen Soldz, which gives some excellent informed comment on the methodology used by the researchers.

Those of us who are concerned should note the techniques that were used by the press and politicians last time and work to ensure that this time around the Lancet's findings can not be so easily buried. If editors fail to cover the story we should contact them and complain. If editors fail to cover the story with due prominence we should contact them and complain. If journalists juxtapose the reports' findings with criticisms from people who know nothing of the relevant science then we should contact them and complain. And we should repeat this behaviour relentlessly until the Lancet report is acknowledged for what it is: the best estimate available of the death toll in Iraq.

If we fail to do this, hundreds of thousands of innocent people will effectively have been killed twice. Once by the war we started and then a second time, by our refusal to acknowledge that the killings had ever happened.

 
At 4:52 PM, Blogger John Koch said...

Business elites might have been happy to normalize with Saddam. Certainly, there would be more money to make in a peaceful, if authoritarian, Iraq than one that is in violent chaos.

The people most critical of the Lancet article's estimates of civilian deaths may also be the ones most ready to accept astronomic estimates of carnage inflicted by enemies. There is no way to count whether more Russians or Ukrainians died because of collectivization, drought, or German armies. Armenians, Amerindians, and Jews suffered mass calamities. All one can say is "many" perished. People will hype or diminish numbers because of an axe to grind.

Japanese are not fond of victims' views of their military exploits in the 1930s and 1940s. Curtis LeMay was candid enough to recognize that his city bombings could qualify as war crimes, save for the fact that victors don't get put on trial. American school boards will not approve history books that make any more than fuzzy reference to violence in "post liberation Iraq." Odds are, most violence will be handily attributed to al Qaeda. W will be deified to Son of Ronnie. A publisher who features a picture from Abu Ghraib will run a big risk.

An "objective" historian will find it hard to measure what number and portion of Iraqi deaths to attribute to battles, persecutions, terrorism, militias, crime, or counterinsurgency operations by the US. It will be very fuzzy to compare deaths in the 1980s Iran war, the 1991 Gulf War, the deprivations of the sanctions, the predations of Saddam, and the post 2003 violence.

Iraqis themselves will probably subscribed to a big number for the post 2003 casualties, almost certainly showing greater grudge towards the US than tyrant Saddam. Once deceased, they will rehabilitate Saddam to appease Sunnis. They will revile the US, UK, and Israel, eschewing any distinction of Republican or Democrat, Likudnik or not, Tory or Laborite.

 
At 5:00 PM, Blogger dancewater said...

"I once warned that a precipitate US withdrawal could result in a million dead a la Cambodia or Afghanistan. Little did I know that the conditions created by the US invasion and occupation have all along been driving toward that number anyway!"

oh, when the US/UK leaves, it will be a bloodbath, that you can count on. And the longer we wait, the worse it will be.

I think you missed (or I am mistaken) the fact that over 90% of the reported deaths did produce death certificates when asked.

 
At 5:20 PM, Blogger karlof1 said...

So, since the first Gulf War, we've enabled the deaths of about 3 million Iraqis, almost as many as our greatest war criminals Nixon and Kissinger killed in Cambodia and Laos over a much shorter period. I once argued that genocide is a fundamental part of US policy in Iraq; I've yet to see convincing evidence it's not. How long before we see renewed discussion of the Iraqi Holocaust. Which White House journalist will be bold enough to ask if Cheney is satisfied with the level of death, or does he think it still too low?

Was the study's timing politically related? Hell Yes!! The killing must stop; and for that to happen, the policy must change; and for the policy to change, the regime must be changed and then enchained.

 
At 5:55 PM, Blogger Denis said...

Thanks for your insight on this issue (by the way, you have an extra zero in your household figure in the discussion of Anthony Cordesmann's comments: 18,000 vs 1,800 - though you have the correct figure at the end). I find it deeply disturbing that, once again, Iraqi's are being treated as political objects by defenders of the US war. 650,000 people are dead and we argue over the methodology. The timing! We stand in the midst of a human tragedy of unbelievable proportions, and one we willfully created, yet we refuse absolutely to deal honestly with the situation. We cannot see the dead at our feet.

 
At 7:16 PM, Blogger Mike in Austin TX said...

For those dubious of the Lancet's claims or methodology, I'd encourage you to listen to an episode of NPR's This American Live out of WBEZ Chicago.

The story is about 36 minutes long, and begins around the 7 minute mark, although I'd encourage y'all to listen to the whole hour of the very well done radio show.

You can find the specific episode at http://207.70.82.73/pages/descriptions/05/300.html or search for "Lancet" at the http://www.thislife.org/ website.

Also - do those who question the 650,000 figure choose instead to accept the 30,000 put forth by our War President?

 
At 8:27 PM, Blogger ivorybill said...

From my diary on DailyKos:

Let me preface this diary by saying the recent Johns Hopkins study on mortality in Iraq may well be accurate, and that I'm not debating the larger questions of US complicity in the war or culpability in Iraqi deaths. I agree with the basic rationale for the study, which is that mortality rates based on morgue information and public news sources underreport violent deaths. However, I was a little shocked by the findings of this report. If the report is true, the death rate from this current war is equal in scale to the Iran-Iraq war, which lasted a couple years longer, but cost an estimated one million lives.

First, the most violent governorates are relatively oversampled. The provinces experiencing full-scale war - Anbar, Ninevah, Salahaddin, Diyala - (>10 violent deaths per 1,000 per year) were sampled at a rate of one cluster per 459,000 people. Baghdad was sampled at 1:540,000. In predominantly Shia' governorates that have experienced some inter-shia' political violence and some bombing incidents (Babel, Qadisiyya, Basra, the rate is one cluster per 809,000. In Kirkuk (Tamim), where violence is highly variable but with large areas that are peaceful, the rate is 1:881,000. In areas without significant violence, one cluster per 530,000 was sampled - but they did not survey the two most secure governorates in the north and south - Dohuk and Muthanna, respectively. Dohuk is the only Kurdish governorate that has experienced no fighting and no bombings of any sort. Likewise, Muthanna is the calmist governorate in the Shia' area. It's so calm, the US sent the Japanese there. Admittedly, these are small governorates, but they do have an aggregate population of 1.5 million people who are essentially unaffected by the war, other than soldiers recruited there who agree to fight elsewhere.

Put another way, the Sunni governorates were sampled 1:450,000; the mixed ethnicity governorates sampled 1:532,000; the Kurdish governorates 1:626,000 and the Shia' governorates 1:660,000. Violence is far higher in the Sunni and mixed-ethnicity governorates, because the fight between the US and the insurgency is in primarily Sunni areas, and the civil war is primarily in mixed ethnicity areas. Violence is lower in Shia' areas and very low in Kurdish areas. Finally, the populations in the Sunni and mixed ethnicity governorates may be slightly overestimated for two reasons: First, the UNDP data is based at least partially on Iraqi census figures before 2003, which tended to undercount Shia' and Kurds, and second, there has been massive migration out of Baghdad, Ninevah and Diyala governorates to safer, ethnically homogenous areas since the war - there are 250,000 registered IDPs in Iraq, but there could be twice that many or more who have quietly moved in with relatives outside of the most violent governorates.

My biggest concern however, is that violence is highly unequally distributed within governorates, both geographically and according to ethnic community. If there appears to be an unintentional sampling bias toward the most violent governorates, there could also be a trend to sample the more violent locations within each governorate. I know the report states that clusters were selected randomly, but the locations of those clusters are really important for assessing accuracy. For example, the study only sampled one cluster in Kirkuk (Tammim). If you survey a mixed-ethnicity neighborhood near the center of the city, the mortality rate would be sky high, among the highest in Iraq. If you measured an ethnically homogenous neighborhood in the city, the rate would be moderate to high. If you measured an ethnically homogenous village west or south of Kirkuk, the rate would be very variable from relatively high to low. If you measure a town or village in the east of the province, the rate would be negligible. It seems to me very hard to get an accurate reading on Kirkuk from one cluster.

Likewise, they used three cluster sites to determine the mortality rate for Ninevah governorate, Iraq's second largest governorate. The northeastern third and about 35% of the population are under Kurdish control and experience virtually no violence, rural areas and areas along the Syrian border experience localized violence depending to a great extent on the ethnic composition of the community, and Mosul city and Tel Afar are insanely violent. The location of those clusters is really important, even within Mosul city itself. The west side of town is much more violent than the east. Without information on the location of the clusters, it is hard to be 100% convinced of accuracy. Diyala is similar - with extraordinarily violent areas (Khalis, Baquba) and relatively safe ones (Khanaqin, Kifri). I can travel safely to Khanaqin and have lunch in a restaurant, but I would be killed or kidapped immediately if I tried a stunt like that in Baquba.

Unfortunately, the ethnic affiliation of the surveyor is also important (i.e. Arab communities would not accept a Kurd and vice versa). I know that they achieved gender balance, but it is hard to imagine how one could get accurate figures in mixed ethnicity governorates like Diyala or Kirkuk without first, a number of clusters and second, withou careful attention to assure an ethnic mix of researchers to assure trust on the part of participants and accurate interviews. They may well have done the latter, but it is not stated in the report.

I offer these critiques as grains of salt. The report may in fact be accurate. I do not dispute the honesty of the researchers. I know from experience that one never has much control over operations in Iraq, and without a great deal of control, information errors can creep in. Despite what appears to be oversampling of the most violent parts of the country, the Hopkins study may yet be accurate if sampling clusters within governorates do not skew to the more violent neighborhoods or districts. But I would need to know where the clusters were before I can fully credit this report.

 
At 9:20 PM, Blogger pseudonymous in NC said...

The New York Times has a regrettable history of seeking out naysayers on both occasions, while the Post does a better job.

Anyway, the study is here, with plenty of detail on the methodology.

 
At 10:40 PM, Blogger Sulayman said...

If the study shows at least 420,000 dead as the minimum, and 30% of the deaths were from the US military, that means the US has killed over 126,000 people! It could be as high as 237,000!

I'm nearly dumbfounded by people who claim that Bush is so much better than Bin Laden. If Bush only killed 5000 people it might be different. I don't want to hear the same old line "the US never deliberately kills civilians, Bin Laden did." The US targeted the Amiyrah bomb shelter in Iraq, killing hundreds of hiding civilians in the first Gulf war, for example, and has yet to apologize. I never liked the claim that the US feels bad about what it does but Al Qaeda doesn't. They both have their own goals and pursue them ruthlessly.

 
At 11:40 PM, Blogger OD said...

On the question of death certificates, the NYT says:
'Iraqi authorities say morgue counts are more accurate than is generally thought. Iraqis prefer to bury their dead immediately, and hurry bodies of loved ones to plots near mosques or, in the case of Shiites, in sacred burial sites. Even so, they have strong incentives to register the death with a central morgue or hospital in order to obtain a death certificate, required at highway checkpoints, by cemetery workers, and for government pensions. Death certificates are counted in the statistics kept by morgues around the country.'

Has the Health Ministry ever released statistics based on the total number of death certificates issued?

I was under the impression that in Anbar in July, the Health Ministry's casualty figure was zero, because there was no death reporting or the system broke down.

The Lancet study, which suggests that the vast majority of these families produced death statistics, also implies that the Health Ministry must know about most of these deaths.

One note about the new Lancet study I find odd is that the pre-war mortality rate is described as 5.5 deaths per 1000 per year. That is in line with previous estimates. But it's an amazingly low figure, half the death rate per 1000 per year in Britain or France.

Obviously, if the true figure were higher, that would imply that the EXCESS mortality since 2003 is lower than suggested. However, that doesn't explain why so many violent deaths are reported.

Another odd artefact of this study is the finding that, among non-violent deaths since 2003, males outnumber females by 1.8 to 1. There's no immediate explanation for this.

By the way, for those who were wondering, the study is online at www.thelancet.com

 
At 12:44 AM, Blogger Christiane said...

Ripa wrote :
"However, I would like to read the paper itself (for example, I would like to know if they base their conclusions upon means or medians)..."

I haven't been able to find the full text of the study either; However I was able to read their former study.

Your question sounds weird : they aren't working with means or medians, they are looking for ratios : aka the number of dead persons with respect to a given population.

The cluster method is based on the creation of groups where people are selected either randomly, or choosing the first randomly and then looking for the next neighbour untill you get your quota for the region.

Once you have that quota, it is extrapolated for the whole population living in the region. Then at the national level, you ponder each cluster result with the population living in this region/cluster.
The main problem IMO is that there hasn't been any census in Iraq since eons, so they don't really have a good reference population to infer the total number of deaths. May be that they are using the UN ration cards ? that could be a good solution to the problem.

For the rest, I agree with the former commenters who believe the data are credible. The study looks very honnest.

 
At 1:00 AM, Blogger Richard Slay said...

In Vietnam, we were responsible for 1 to 2 million deaths (not counting Cambodia).

Truly, we seem to be repeating ourselves.

 
At 3:21 AM, Blogger OD said...

Having talked to someone who knows about epidemiology, I gather it's not at all odd that Iraq's pre-war death-rate should be lower than Britain or France's since the population is so much younger. So I take back what I said about that.

 
At 3:25 AM, Blogger John Francis Lee said...

SulaymanF :

If the study shows at least 420,000 dead as the minimum, and 30% of the deaths were from the US military, that means the US has killed over 126,000 people! It could be as high as 237,000!

Richard Slay :

In Vietnam, we were responsible for 1 to 2 million deaths (not counting Cambodia).

Truly, we seem to be repeating ourselves.


And we will do it again, if we do not crash and burn, victims of the Republican Borrow and Spend and bi-partisan all-war, all the time, let our grandchildren pay tomorrow policies.

No... there must be an Anglo-American War Crimes Tribunal if we are ever to avoid this again.

 
At 4:37 AM, Blogger dancewater said...

taking 600,000 dead as a rounded off figure, that means the USA killed 200 people for every one killed on 9/11.


except we are not done yet.

 
At 8:47 AM, Blogger Tim said...

Juan, your math is very likely better than mine, but I wanted to understand how you got to the average of 470 a day from the study. I got to a similiar but different sum, and I wanted to check.

The study covered a timeframe between the March 18th invasion till July 2006. 1231 days by my quick math.

It found somewhere between 426,369 to 793,663 additional Iraqis have died due to the invasion in with 654,965 the statistically most probable death toll. Divide 654,965 by 1,231 and you get 532.

When you look those the study says have been killed in political violence the number is a likely 601,027. Divide that by 1,231 and you get 488 a day.

(I think, but could be wrong)

Thanks,

tim

 
At 4:51 PM, Blogger Christiane said...

Ivorybill,
I've read your comment attentively. Working as a statistician myself, I don't think that the fact the different regional clusters don't have the same size constitute a problem, on the contrary : the bigger the size of the cluster, the higher the precision of the result should be; hence it makes sense to have more smaller clusters in a violent zone : this way, you ensure that you aren't overevaluating the casulties, if the place you are sampling was especially hardly hitted.

Then, at the national level, when you compute the global rate of death per 1000 persons, having cluster of different size doesn't matter, provided that the different cluster results are weighted by the cluster's population. I think that the method adopted is quite robust and is the only practical one in a zone like Iraq. To my ears, the result sounds alas possible. It's impossible for the international press to get notice of every death. I'm sure that what is reported is only the tip of the iceberg.

 
At 12:13 PM, Blogger Lopakhin said...

OD: Another odd artefact of this study is the finding that, among non-violent deaths since 2003, males outnumber females by 1.8 to 1. There's no immediate explanation for this.

I'm not sure where you're getting that from. I'm looking at Table 2 in the Lancet study (http://www.thelancet.com/webfiles/images/journals/lancet/s0140673606694919.pdf). Adding up the male (15-59) non-violent deaths, I get 37+15+5+5+5+1+6=74. The female ones are 39+11+14+3+6+1+4=78. The proportions of men and women in the study are around normal - 48.9% male - so where do you get that figure from?

One note about the new Lancet study I find odd is that the pre-war mortality rate is described as 5.5 deaths per 1000 per year. That is in line with previous estimates. But it's an amazingly low figure, half the death rate per 1000 per year in Britain or France.

Obviously, if the true figure were higher, that would imply that the EXCESS mortality since 2003 is lower than suggested. However, that doesn't explain why so many violent deaths are reported.


Indeed. The report tries to back it up with reference to CIA World Factbook figures, but that's kind of invalidated by the fact that if you look at the Factbook in more recent years, they give a similar figure - around 5.5/1000 - which, if it were true, would obviously invalidate the Lancet figures. See also here and also the UN's World Population Prospects surveys which gives higher pre-2003 death rate figures.

 
At 7:45 PM, Blogger Suskind said...

This study, like the previous 2004 Lancet study excludes Fallujah. Care to comment?

 
At 10:07 PM, Blogger mjtimber said...

It seems as though the actual, current "excess" death rate would need to be much higher than the 470 figure that Juan uses, assuming the previous study from two years ago was also proximately correct. With 455,000 deaths since, the rate would be over 700 per day.

Also, I would tend to agree that the release date is political. The previous study was released October 29th, 2004, right before the last election. I guess they decided they needed a bit more time for this study to sink in. Additionally, the editor of the Lancet is extremely outspoken in his opposition to the war, so it doesn't seem unreasonable that he might delay or push forward publication a month or two. I just hope it works, but I doubt it will have much effect on anyone other than the chorus (i.e. me).

That said, none of this should compromise the results of the study. It seems all too likely that every other estimate would be well below the actual number. It seems we only hear about the bombs that go off, no gunshot victims, and at this point only those that can be heard from the green zone. And with regards to extrapolation, a better example would be every poll we see for political elections; sample size rarely exceeds 1,000.

 
At 4:02 PM, Blogger govtwatch said...

Thank you, Juan, for publishing information about this study. It is apparent that in the American media, we will go to any length to minimize focus on the casualties of Iraq. It goes to show how closely tied the government, industrial, and media powers are. (for example - NBC is majority owned by GE! Can we trust them to provide an unbiased report?)
The best place to find more information is at the website www.655000.org - it has more information and links to further discussions about the study.

 

Post a Comment

<< Home