Information overload? Digital data could exceed storage space by 2010
Last Updated: Tuesday, March 6, 2007 | 9:34 AM ET
The Associated Press
Related
Internal Links
A new study that estimates how much digital information the world is generating (hint: a lot) finds that for the first time, there might soon not be enough storage space to hold it all. Good thing we delete some stuff.
The report, assembled by the technology research firm IDC, sought to account for all the ones and zeros that make up photos, videos, e-mails, web pages, instant messages, phone calls and other digital content zipping around. The researchers also assumed that on average, each digital file gets replicated three times.
Add it all up and IDC determined that the world generated 161 billion gigabytes — 161 exabytes — of digital information last year.
Oh, the equivalents! That's like 12 stacks of books that each reach from the Earth to the sun. Or you might think of it as three million times the information in all the books ever written, according to IDC. You'd need more than two billion of the most capacious iPods on the market to get 161 exabytes.
The previous best estimate came from researchers at the University of California, Berkeley, who totalled the globe's information production at five exabytes in 2003.
But that report followed a different trail. It included non-electronic information, such as analog radio broadcasts or printed office memos, and tallied how much space that would consume if digitized. And it counted original data only, not all the times things got copied.
In comparison, the IDC numbers were made much higher by including content as it was created and as it was reproduced — for example, as a digital TV file was made and every time it landed on a screen. If IDC tracked original data only, its result would have been 40 exabytes.
Still, even the 2003 figure of five exabytes is enormous — it was said at the time to be 37,000 Libraries of Congress — so why does it matter how much more enormous the number is now?
For one thing, said IDC analyst John Gantz, it's important to understand the effects of the factors behind the information explosion — such as the profusion of surveillance cameras and regulatory rules for corporate data retention.
In fact, the supply of data technically outstrips the supply of places to put it.
IDC estimates that the world had 185 exabytes of storage available last year and will have 601 exabytes in 2010. But the amount of stuff generated is expected to jump from 161 exabytes last year to 988 exabytes (closing in on one zettabyte) in 2010.
No scarcity of space
"If you had a run on the bank, you'd be in trouble," Gantz said. "If everybody stored every digital bit, there wouldn't be enough room."
Fortunately, storage space is not actually scarce and continues to get cheaper. That's because not everything gets warehoused. Not only do e-mails get deleted, but some digital signals are also not made to linger, like the contents of phone calls.
But even if the IDC findings don't raise the prospect that disk drives will be virtually bursting at the seams, the study has intriguing implications. Among them: We'll need better technologies to help secure, parse, find and recover usable material in this universe of data.
Chuck Hollis, vice-president of technology alliances at EMC Corp., the data-management company that sponsored the IDC research and the earlier Berkeley studies, said the new report made him wonder whether enough is being done to save the digital data for posterity.
"Someone has to make a decision about what to store and what not," Hollis said. "How do we preserve our heritage? Who's responsible for keeping all of this stuff around so our kids can look at it, so historians can look at it? It's not clear."
Share Tools
Top News Headlines
- Everest victim's husband says family not seeking government help
- The husband of a Toronto woman who died trying to climb Mt. Everest on Saturday says his family is not seeking government help to cover the cost of bringing his wife's body home. more »
- B.C. premier unhappy with disgraced Mountie's transfer
- B.C. Premier Christy Clark says she is not happy with the RCMP decision to transfer a disgraced Alberta Mountie to the West Coast. more »
- Henrique's OT goal sends Devils into Stanley Cup final
- The New Jersey Devils will vie for a potential fourth Stanley Cup in franchise history after defeating the New York Rangers in six games in the Eastern final, courtesy of rookie Adam Henrique's goal early in overtime. more »
- Employment Insurance review boards to be scrapped
- The federal government is scrapping two review boards used by people appealing decisions made about their employment insurance. more »
Latest Technology & Science News Headlines
- Unloading of docked SpaceX capsule to start Saturday
- The privately bankrolled SpaceX Dragon capsule made a historic arrival at the International Space Station on Friday, and astronauts will begin unloading some of the 544 kilograms of food, water, clothing and other supplies its carrying starting Saturday.
more »
- South Africa, Australia to share world's largest telescope
- South Africa and Australia will jointly host the Square Kilometre Array, which promises to be the world's largest telescope, the international consortium in charge of the project said Friday. more »
- Bonavista, N.L., 'coyote' was really wolf, tests confirm
- Wolves have not been seen in Newfoundland since around 1930 and were believed to have been hunted to extinction on the island, but genetic tests have confirmed that an 82-pound animal shot on the Bonavista Peninsula in March was, in fact, a wolf. more »
- Once-rare argus butterfly thriving thanks to climate change
- Global warming is threatening the existence of many species, such as the giant polar bear, but in the case of Britain's brown argus butterfly, it took a species in trouble and made it thrive. more »
- Yahoo scraps digital magazine designed for iPad
- Yahoo has killed Livestand, a tablet magazine, just six months after its debut on the iPad. more »
Bob McDonald's Blog
Government to shut down unique fresh water research area May. 25, 2012 12:31 PM The Experimental Lakes Area research facility in Northern Ontario is being closed down after 44 years of providing invaluable data to scientists in Canada and internationally, a decision that has stunned researchers and environmental groups.
Quirks & Quarks
- May 26: Before the Lights Go Out May. 25, 2012 4:15 PM A new book, "Before the Lights Go Out: Conquering the Energy Crisis Before It Conquers Us", suggests that the unpredictable, unplanned, ad-hoc way our energy use developed in the past will shape our energy future.
Latest Features
- Aylmer triple stabbing leads to first-degree murder charges
- Everest victim's husband says family not seeking government help
- B.C. premier unhappy with disgraced Mountie's transfer
- Third B.C. salmon farm quarantined
- What a Greek euro exit could mean for Canada
- RCMP officer charged in fatal crash
- Canada ending 'Buffalo shuffle' for visas, closing consulate
- Reclaiming the dead on Mt. Everest
- Employment Insurance review boards to be scrapped

