Story Tools: PRINT | Text Size: S M L XL | REPORT TYPO | SEND YOUR FEEDBACK

In Depth

REALITY CHECK: Robert Sheppard

Iraq's death toll, the numbers debate

October 12, 2006

There is no doubt Iraq is a dangerous place and probably getting more deadly by the month. But how many Iraqis have really died there since the United States invaded the country in 2003 and toppled President Saddam Hussein?

Is it roughly 49,000 civilian deaths, the upper estimate of an independent group called Iraq Body Count, which takes its numbers from local media reports and triple-checks them, when it can, with calls to hospitals and morgues?

Or is it 12 times that estimate — 601,000 violent deaths since the war began, over and above what might have occurred anyway.

That is the newest figure just published by a team of Iraqi and U.S. doctors, as well as statisticians working out of the Bloomberg School of Public Health at Johns Hopkins University in Maryland.

Both approaches have their detractors. The Body Count number is often said to underestimate the true death toll of the war because ordinary Iraqis have become so inured to the conflict they are simply burying their dead where they can, without resorting to hospitals, morgues or official death certificates.

The Johns Hopkins estimate (this is their second one) is even more controversial in some circles. That is because it is so at odds with official estimates and because it is based on a random survey of 50 neighbourhoods scattered throughout Iraq, with the results extrapolated to the country as a whole.

Its proponents argue that such epidemiological studies have historically proven to be much more exact than the so-called passive surveillance methods (like that of the Body Count group).

This one was extensively peer-reviewed and was published in the prestigious British medical journal The Lancet. (See The Human Cost of the War in Iraq, a Mortality Study in The Lancet)

But it is still based on a number of assumptions, the chief one being: Can you do a truly random "household survey" in a country as chaotic as Iraq?

Fun with figures

This is the second survey from the doctors and statisticians at Johns Hopkins and al Mustansiriya University in Baghdad. The first, published two years earlier, suggested nearly 100,000 Iraqi civilians had died as a result of the war.

This one, using the same methodology but a slightly larger sample, basically restates the earlier study and comes out with an estimate that is six times greater. One of the reasons for this is that the death rate in the past year, the study claims, is nearly three times what it was in the first year of fighting.

What the researchers did was send teams to 50 randomly selected sites in 16 of Iraq's 18 regions over a two-month period this summer.

At each site researchers would choose a household at random, interview its occupants about anyone who had lived there and died over the past four years, going back to January 2002, almost 1½ years prior to the invasion. They would then repeat the process in 39 of the nearest homes.

The researchers said they were presented with death certificates in 92 per cent of the cases they inquired about. And in the end they ended up with data on 12,801 people in 1,849 homes in which there had been 629 deaths and 1,474 births between January 2002 and June 2006.

The sample - 12,801 people - represents slightly less than .05 per cent of the Iraqi population. Though the actual "polling sample" is much smaller, proabably fewer than 2,000, as the researchers took their information from the heads of households in most cases.

From these numbers, the researchers extrapolated the results to the entire 26.1 million Iraqi citizens and concluded that there were somewhere between 426,369 and 795,663 violent deaths in the country since 2003, over and above what would have happened under Iraq's pre-war death rate.

The most statistically probable number, it said, was 601,027, the one that made all the headlines. It represents almost 2.5 per cent of the Iraqi population.

The confidence factor

Extrapolating from small random surveys like this to entire populations is an accepted form of statistical study and is often used by health scientists to track the incidence of disease or such things as childhood obesity in developed countries.

It is the technique used by researchers to estimate deaths in war-torn countries such as the Congo or Sudan. Small representative groups are surveyed and the results are extrapolated to the larger population.

The United Nations is testing a pilot project of using small random surveys like this, with very similar methodology, to help it gauge the success of some of its humanitarian efforts.

Still, these techniques rely on a number of assumptions and adjustments to account for important variables, which in Iraq would include a highly mobile and fearful population, widespread sectarian violence, and a conflict that has been much more intense in certain parts of the country than in others.

The first issue here: Iraq's pre-war mortality rate. The first Johns Hopkins study from 2004 pegged it at five per every 1,000 population, based on what those interviewed recalled. This one was 5.5/1,000.

But UN reports had suggested Iraq's crude death rate was higher than this in the 1980s and '90s. It was in at least the 6.8/1,000 range and rising, which would make the difference between normal deaths and what the researchers called "excess deaths" brought about by the war quite a bit smaller.

The other issue here is what statisticians call the "confidence interval."

In their first study in 2004, the confidence interval was huge: The Johns Hopkins team basically concluded that it had 95-per-cent confidence the war had caused somewhere between 8,000 and 194,000 extra deaths by that point. Its 100,000 figure was the most probable number on this large continuum, which of course assumes violent deaths in Iraq can be plotted on the same bell curve as, say, breast cancer rates in North America.

That earlier study interviewed 30 households in each of 33 neighbourhoods. This one roughly 40 households in each of 50 sites and as a result the confidence continuum has narrowed considerably to between 426,369 and 795,663 — which is still quite a range.

If this was a political poll, it would be like saying a prime minister's popularity was anywhere between 35 and 65 per cent.

Random versus actual

So which is more accurate? The random, detailed survey extrapolated to a population at large? Or the "passive" actual account attempted, in the face of considerable odds, by groups like Body Count?

The full story of civilian deaths in this war will probably never be known until there is stable government in Iraq and someone can do a proper census.

But whatever you might think of this latest Johns Hopkins study (which, coincidentally, has turned up twice now in the midst of U.S. election campaigns), it has at least helped put a face on the type of violence confounding Iraq.

Of those surveyed, researchers found 56 per cent of those who died violently were killed by guns. Slightly more than 27 per cent were killed by explosions, including car bombs, and 13 per cent lost their lives because of American air strikes (which of course were heavily concentrated in key areas).

Not surprisingly perhaps, the largest group killed were young males under 30. There was not an unusual number of women killed, the study found: The death rate for women in Iraq was about the same as that for other countries.

But among female deaths, the largest single group was, quite noticeably, those under 15.

Go to the Top

REALITY CHECK MENU

Main page
John Gray
Robert Sheppard

ABOUT ROBERT SHEPPARD

Biography

Robert Sheppard

Robert Sheppard began his career at the Montreal Star (may it rest in peace), spent 22 years at the Globe and Mail and was recently senior editor at Maclean's magazine. He has co-authored a book on the Canadian Constitution and writes on a variety of subjects.

Reality Check columns from Robert Sheppard

News Features

Story Tools: PRINT | Text Size: S M L XL | REPORT TYPO | SEND YOUR FEEDBACK

World »

Iranian-Canadian journalist talks of prison ordeal Video
Iranian-Canadian journalist Maziar Bahari says he was regularly beaten and threatened with execution while imprisoned in Iran for 118 days.
Indonesian ferry sinks in storm
Rescuers saved more than 240 people aboard an Indonesian passenger ferry that sank Sunday in rough waters off Sumatra island, but at least 29 people have died, officials said.
Iranian forces practise defending nuke sites
Iran on Sunday began large-scale air defence war games aimed at protecting the country's nuclear facilities against any possible attack, state television reported.
more »

Canada »

Afghan prisoner transfers halted 'more than 1 time' Video
Canadian officials have halted the transfer of prisoners to Afghanistan's intelligence service "more than one time," because of the possibility of torture, Canada's chief of defence staff said Sunday.
Teens named in 4-death crash near Calgary
Police have released the names of three young women killed in a two-vehicle crash south of Calgary on Saturday afternoon, but have yet to reveal the name of a fourth woman who died.
Vancouver Island residents survey flood damage
Hundreds of people on south Vancouver Island forced from their homes by flooding have been allowed to return, but most won't be able to stay because of damage to their houses.
more »

Politics »

Journalists enhance Canadians' freedom: PM
Prime Minister Stephen Harper urged journalists to "shine light into dark corners" of government affairs during a speech late Saturday, but wouldn't take questions from reporters covering the event.
Colvin's job safe despite Afghan torture testimony Video
The Conservatives will not try to remove Richard Colvin from his post in Washington, Defence Minister Peter MacKay says, even though they question the credibility of his testimony on Afghan prisoners.
Hillier didn't hear detainee torture allegations Video
Former chief of defence staff Rick Hillier says he's never heard suggestions that Canada may have been complicit in the torture of detainees in Afghanistan.
more »

Health »

More H1N1 vaccine, ventilators to come Video
Ontario supplied hospitals with 200 additional ventilators on Friday in anticipation of a surge in swine flu cases.
Trade show pitches surgical passages to India Video
Exhibitors at a Toronto trade fair are hoping to add surgery to the list of reasons Canadians travel, but a medical ethicist questions the lack of oversight.
Weight gain in pregnancy guides updated
Health Canada is formally replacing its guidelines on weight gain during pregnancy to match new U.S. recommendations.
more »

Arts & Entertainment»

Plaskett double winner at Canadian Folk Music Awards
Joel Plaskett's triple album Three earned the Halifax singer-songwriter a double win at the Canadian Folk Music Awards on Saturday.
Kirov ballerina steps out at Cultural Olympiad
Uliana Lopatkina, principal dancer with the Kirov Ballet, will make her Canadian debut Feb. 10 at the Vancouver 2010 Cultural Olympiad
Documentary explores carbon trading business
Carbon Hunters is about a new breed of entrepreneurs working to get rich and save the planet at the same time.
more »

Technology & Science »

Bell quietly drops system access fee
The cellphone system access fee is all but extinct. Bell Canada has quietly axed the charge, joining rivals Rogers and Telus.
Beam sent around Large Hadron Collider
The operators of the Large Hadron Collider have successfully sent a beam of particles around the ring of the world's largest particle collider in Switzerland.
Astronauts complete 6-hour spacewalk
Astronauts from space shuttle Atlantis completed the second of three scheduled spacewalks Saturday, spending just over six hours installing equipment on the International Space Station.
more »

Money »

Ottawa will stay course on stimulus: Flaherty Video
Rather than turning off the stimulus taps or pouring more fuel on the economic fire, Ottawa will stand pat with the $61 billion in stimulus spending announced in January, Finance Minister Jim Flaherty says.
Canada Post struggles to innovate
Canada's postal service is reinventing itself as it struggles to make up for dwindling demand in the face of a devastating global economic slowdown.
The 10-billion-barrel battle
Henry Lyatsky wants B.C.'s coast opened to oil drilling but environmentalists stand opposed.
more »

Consumer Life »

Bullying is a public health issue: researcher
Bullying should be considered a public health problem and governments should adopt national strategies against it, says a Canadian professor who led a study of bullying in 40 countries.
Early Canadian stamps auction nets $3.2M US Video
A New York stamp collector auctioned parts of his collection in New York on Thursday, including a Canadian-issued stamp that is one of the world's rarest.
Fake hairstyling irons pop up in Regina
Hundreds of knock-off hairstyling irons were seized Friday morning by RCMP acting on a hot tip.
more »

Sports »

Scores: NHL NBA

Roughriders will meet Als in Grey Cup
The Saskatchewan Roughriders are headed to the Grey Cup in Calgary after Darian Durant passed for 204 yards and three touchdowns in a 27-17 win over the defending champion Stampders in Sunday's West Division final.
Alouettes off to Grey Cup after devouring Lions
The Montreal Alouettes humbled the B.C. Lions on Sunday afternoon, earning their seventh trip to the Grey Cup game since 2000.
Virtue, Moir clinch Skate Canada gold
Tessa Virtue and Scott Moir put down a superb free program to win the ice dance competition at the 2009 HomeSense Skate Canada International.
more »