Story Tools: PRINT | Text Size: S M L XL | REPORT TYPO | SEND YOUR FEEDBACK

In Depth

REALITY CHECK: Robert Sheppard

Iraq's death toll, the numbers debate

October 12, 2006

There is no doubt Iraq is a dangerous place and probably getting more deadly by the month. But how many Iraqis have really died there since the United States invaded the country in 2003 and toppled President Saddam Hussein?

Is it roughly 49,000 civilian deaths, the upper estimate of an independent group called Iraq Body Count, which takes its numbers from local media reports and triple-checks them, when it can, with calls to hospitals and morgues?

Or is it 12 times that estimate — 601,000 violent deaths since the war began, over and above what might have occurred anyway.

That is the newest figure just published by a team of Iraqi and U.S. doctors, as well as statisticians working out of the Bloomberg School of Public Health at Johns Hopkins University in Maryland.

Both approaches have their detractors. The Body Count number is often said to underestimate the true death toll of the war because ordinary Iraqis have become so inured to the conflict they are simply burying their dead where they can, without resorting to hospitals, morgues or official death certificates.

The Johns Hopkins estimate (this is their second one) is even more controversial in some circles. That is because it is so at odds with official estimates and because it is based on a random survey of 50 neighbourhoods scattered throughout Iraq, with the results extrapolated to the country as a whole.

Its proponents argue that such epidemiological studies have historically proven to be much more exact than the so-called passive surveillance methods (like that of the Body Count group).

This one was extensively peer-reviewed and was published in the prestigious British medical journal The Lancet. (See The Human Cost of the War in Iraq, a Mortality Study in The Lancet)

But it is still based on a number of assumptions, the chief one being: Can you do a truly random "household survey" in a country as chaotic as Iraq?

Fun with figures

This is the second survey from the doctors and statisticians at Johns Hopkins and al Mustansiriya University in Baghdad. The first, published two years earlier, suggested nearly 100,000 Iraqi civilians had died as a result of the war.

This one, using the same methodology but a slightly larger sample, basically restates the earlier study and comes out with an estimate that is six times greater. One of the reasons for this is that the death rate in the past year, the study claims, is nearly three times what it was in the first year of fighting.

What the researchers did was send teams to 50 randomly selected sites in 16 of Iraq's 18 regions over a two-month period this summer.

At each site researchers would choose a household at random, interview its occupants about anyone who had lived there and died over the past four years, going back to January 2002, almost 1½ years prior to the invasion. They would then repeat the process in 39 of the nearest homes.

The researchers said they were presented with death certificates in 92 per cent of the cases they inquired about. And in the end they ended up with data on 12,801 people in 1,849 homes in which there had been 629 deaths and 1,474 births between January 2002 and June 2006.

The sample - 12,801 people - represents slightly less than .05 per cent of the Iraqi population. Though the actual "polling sample" is much smaller, proabably fewer than 2,000, as the researchers took their information from the heads of households in most cases.

From these numbers, the researchers extrapolated the results to the entire 26.1 million Iraqi citizens and concluded that there were somewhere between 426,369 and 795,663 violent deaths in the country since 2003, over and above what would have happened under Iraq's pre-war death rate.

The most statistically probable number, it said, was 601,027, the one that made all the headlines. It represents almost 2.5 per cent of the Iraqi population.

The confidence factor

Extrapolating from small random surveys like this to entire populations is an accepted form of statistical study and is often used by health scientists to track the incidence of disease or such things as childhood obesity in developed countries.

It is the technique used by researchers to estimate deaths in war-torn countries such as the Congo or Sudan. Small representative groups are surveyed and the results are extrapolated to the larger population.

The United Nations is testing a pilot project of using small random surveys like this, with very similar methodology, to help it gauge the success of some of its humanitarian efforts.

Still, these techniques rely on a number of assumptions and adjustments to account for important variables, which in Iraq would include a highly mobile and fearful population, widespread sectarian violence, and a conflict that has been much more intense in certain parts of the country than in others.

The first issue here: Iraq's pre-war mortality rate. The first Johns Hopkins study from 2004 pegged it at five per every 1,000 population, based on what those interviewed recalled. This one was 5.5/1,000.

But UN reports had suggested Iraq's crude death rate was higher than this in the 1980s and '90s. It was in at least the 6.8/1,000 range and rising, which would make the difference between normal deaths and what the researchers called "excess deaths" brought about by the war quite a bit smaller.

The other issue here is what statisticians call the "confidence interval."

In their first study in 2004, the confidence interval was huge: The Johns Hopkins team basically concluded that it had 95-per-cent confidence the war had caused somewhere between 8,000 and 194,000 extra deaths by that point. Its 100,000 figure was the most probable number on this large continuum, which of course assumes violent deaths in Iraq can be plotted on the same bell curve as, say, breast cancer rates in North America.

That earlier study interviewed 30 households in each of 33 neighbourhoods. This one roughly 40 households in each of 50 sites and as a result the confidence continuum has narrowed considerably to between 426,369 and 795,663 — which is still quite a range.

If this was a political poll, it would be like saying a prime minister's popularity was anywhere between 35 and 65 per cent.

Random versus actual

So which is more accurate? The random, detailed survey extrapolated to a population at large? Or the "passive" actual account attempted, in the face of considerable odds, by groups like Body Count?

The full story of civilian deaths in this war will probably never be known until there is stable government in Iraq and someone can do a proper census.

But whatever you might think of this latest Johns Hopkins study (which, coincidentally, has turned up twice now in the midst of U.S. election campaigns), it has at least helped put a face on the type of violence confounding Iraq.

Of those surveyed, researchers found 56 per cent of those who died violently were killed by guns. Slightly more than 27 per cent were killed by explosions, including car bombs, and 13 per cent lost their lives because of American air strikes (which of course were heavily concentrated in key areas).

Not surprisingly perhaps, the largest group killed were young males under 30. There was not an unusual number of women killed, the study found: The death rate for women in Iraq was about the same as that for other countries.

But among female deaths, the largest single group was, quite noticeably, those under 15.

Go to the Top

REALITY CHECK MENU

Main page
John Gray
Robert Sheppard

ABOUT ROBERT SHEPPARD

Biography

Robert Sheppard

Robert Sheppard began his career at the Montreal Star (may it rest in peace), spent 22 years at the Globe and Mail and was recently senior editor at Maclean's magazine. He has co-authored a book on the Canadian Constitution and writes on a variety of subjects.

Reality Check columns from Robert Sheppard
[an error occurred while processing this directive] [an error occurred while processing this directive]
Story Tools: PRINT | Text Size: S M L XL | REPORT TYPO | SEND YOUR FEEDBACK

World »

updated U.K. attack suspects were focus of past security probes video
WARNING: This story contains graphic content. Two men accused of butchering a British soldier had featured in previous investigations by security services, a British official said, as investigators tried to determine whether the men were part of a wider radical Islamic plot.
Tornado damage estimate tops $2B as cleanup begins video
Residents in Moore, Okla., begin returning to their homes to start the cleanup process as officials say the damage estimate could reach $2 billion.
updated Boy Scouts of America to vote on approving gay youth members video
The Boy Scouts of America's national leadership will vote Thursday in Texas on whether to allow openly gay scouts in its membership ranks, a critical and emotionally charged moment for one of the nation's oldest youth organizations and its millions of members.
more »

Canada »

updated Man in chained-teen case pleads guilty to sex assault, kidnapping
A man accused of chaining up a teenager and sexually assaulting him last fall at a home in rural Nova Scotia has pleaded guilty to some of the charges against him.
updated RCMP moving to freeze assets in widening SNC-Lavalin probe
The RCMP is moving to freeze millions of dollars in bank accounts and real estate holdings in Montreal and Florida as part of its expanding probe into Canadian engineering firm SNC-Lavalin.
B.C. teen saves pet dog in 'terrifying' cougar attack video
A teenager who says he heard a horrible "scream" from his beloved black labrador outside the family home in Belcarra, B.C., looked out his window and then went into action to save the dog from a vicious cougar.
more »

Politics »

Harper 'not consulted' about Duffy Senate expense repayment video audio
Prime Minister Stephen Harper says that not only did he not know about his chief of staff's "gift" to repay Senator Mike Duffy's expenses before the story broke in the media, he was not consulted and did not sign off on Nigel Wright's decision to write a personal cheque.
analysis Neil Macdonald: Harper no Obama when it comes to dealing with scandals video
Beset by three so-called scandals at the moment, Barack Obama has been meeting his accusers and the press head on, Neil Macdonald writes. The same cannot be said for how Stephen Harper operates.
Mike Duffy's primary home not P.E.I., unedited Senate report says video
A copy of the original report by an internal Senate committee on Senator Mike Duffy's expense claims, obtained by CBC News, makes it clear the committee believes Duffy's primary residence is in Ottawa, and not in P.E.I.
more »

Health »

Chronic fatigue may be reversed with exercise
Taking it easy is not the best treatment for chronic fatigue syndrome, rather exercise and behaviour therapy are, a large study finds.
AT&T buys T-Mobile USA for $39B US
AT&T Inc. said Sunday it will buy T-Mobile USA from Deutsche Telekom AG in a cash-and-stock deal valued at $39 billion US, becoming the largest cellphone company in the U.S.
Milky Way home to 50 billion planets: NASA
Scientists have compiled the first cosmic census of planets in our galaxy: at least 50 billion planets are estimated to call the Milky Way home.
more »

Arts & Entertainment»

Gershwin-winner Carole King feted by Barack Obama
U.S. President Barack Obama saluted Carole King's five decades as an award-winning singer-songwriter on Wednesday evening in Washington, presenting her with this year's Gershwin Prize for Popular Song.
Beatles lyrics donated to British Library
The British Library on Wednesday added substantially to its already formidable collection with handwritten lyrics to Beatles' classics Strawberry Fields Forever, She Said She Said and In My Life.
Lydia Davis wins $93K Man Booker International Prize
Lydia Davis, an American writer of short stories —some of them just a single line long — has won the £60,000 ($93,230 Cdn) Man Booker International Prize.
more »

Technology & Science »

Arctic bacteria discovered breeding at record –15 C
Bacteria that can live and multiply in High Arctic permafrost at temperatures well below the freezing point of water have been discovered by a Canadian-led team of researchers, offering clues about the types of organisms that might exist in similar extreme environments elsewhere in our solar system.
Video forensics: How easy would it be to fake a Rob Ford video? video
Two media outlets reported last week that they had seen a cellphone video of Mayor Rob Ford allegedly smoking crack, a claim that has gone global. If a video does surface, how easy would it be to determine its authenticity? CBC News asked video forensic analyst David McKay.
Internet bill would unlock personal details, says watchdog
The Harper government's recent bid to give police more information about Internet users would have unlocked numerous revealing personal details — from web-surfing habits to names of friends, says a new study by the federal privacy watchdog.
more »

Money »

new World stocks slump as Japan's Nikkei loses 7%
Financial markets around the world were roiled Thursday after Japanese stocks suffered their biggest slide since the country was hit by a devastating tsunami more than two years ago.
new EI claims trend lower for 5th straight month
The number of people receiving regular Employment Insurance claims declined for the fifth consecutive month in March, dropping one per cent to 523,700.
TD Bank profit up 2% to $1.7B
TD Bank Group says it had $1.723 billion in net income in its second quarter, up nearly two per cent from a year earlier.
more »

Consumer Life »

Honda recalls Fit subcompacts
Honda Canada says it will recall 14,640 of its 2009 and 2010 Fit subcompact cars to replace lost motion springs.
U.S. travel fee proposal criticized by Harper
Prime Minister Stephen Harper says he doesn't think much of a new border tax that's being proposed by the United States, calling it a cash grab designed to help a budget crisis.
Bell class action suit approved by Que. court
A Quebec Superior Court judge has authorized a class action lawsuit to go ahead against Bell Mobility.
more »

Sports »

Scores: NHL NBA

Stanley Cup Stories: Penguins' stars burn Senators video
There was no stopping the Pittsburgh Penguins in Game 4 as Sidney Crosby and company surged past the Ottawa Senators to take a commanding series lead in the only NHL playoff game on Wednesday night.
video Did You See That? Sidney Crosby continues to amaze
Sidney Crosby continues to amaze. The Pittsburgh Penguins superstar centre produced yet another highlight-reel goal on Wednesday night against the Ottawa Senators.
blog Wharnsby: Senators down to final lifeline
CBC Sports senior hockey writer Tim Wharnsby explains how a promising start in Game 4 for the Ottawa Senators turned into an ugly 7-3 loss to the Pittsburgh Penguins.
more »

Diversions »

[an error occurred while processing this directive]
more »