INTERNET
Web traffic
Becoming popular on web is hard, staying popular harder: study
Last Updated: Monday, September 22, 2008 | 12:48 PM ET
CBC News
Related
External Links
(Note: CBC does not endorse and is not responsible for the content of external sites - links will open in new window)
On the surface, the World Wide Web appears to be a static structure, with establishment web sites like Google, Yahoo and Wikipedia consistently among the most visited. But take a closer look at individual web pages instead of sites and measure popularity by the number of other pages that link to it, and a different picture appears; as in high school or high-fashion, popularity on the web is a fickle thing, according to a Canadian researcher.
Only slightly more than half of the most popular web pages right now would have been on a similar list a year ago, according to University of Regina assistant professor Nima Sarshar, a finding that underlies the constantly changing structure of the web.
Sarshar, working with two colleagues from the University of California, Los Angeles, looked at how talent, experience and the deletion of web pages affected the overall popularity of a page, where a page's popularity is measured not in page views, but by the number of links it attracts.
Publishing their findings in the recent issue of the Proceedings of the National Academy of Sciences of the U.S.A., Sarshar and lead author Vwani Roychowdhury and Joseph Kong from UCLA expected to find that experience plays an important role, since the longer a web page has been around the more links it will accumulate.
And in a case of the rich getting richer, the more links a page accumulates, the more likely it will pop up in a search engine like Google.
But what role "talent" played was less clear, so to measure it they tracked which pages had accumulated 1,000 links during a 12-month period.
A web page that started the survey of 22 million web pages with more than 1,000 links was defined as an "experienced" page, while one that finished the 12-month survey with more than 1,000 links was defined as a "winner."
What they found was that even with search engines more likely to send readers to established pages, 48 per cent of the winners at the end of the 12 months were not experienced.
The result is surprising, they say, since it is extremely rare for a less-established web page to receive 1,000 links.
Constant growth
Part of the reason for this, they say, is that the web is constantly growing, with the number of new pages growing at a rate that could be as high as 35 per cent annually. At the same time, they say, pages are constantly being deleted at a rate of about 10 per cent per month. And every time a page is deleted, the pages they pointed to die a little in popularity, too.
The net result is that for every new page created, 0.77 are deleted.
"Web page structure evolves in a matter of weeks," said Sarshar. "It really tells us that within a year or two, the web is a totally new web."
Translating these numbers to the actual number of web pages is a difficult task, since no one can say for certain how many pages exist on the web at any given moment.
Sarshar, Roychowdhury and Kong put the total number at over 12 billion, but acknowledge that is just a best estimate.
'Web page structure evolves in a matter of weeks.'— Nima Sarshar, University of Regina
In July, Google software engineers, posting on the company blog, said their systems that process links found one trillion unique URLs on the web at once. But they admit addresses are not equivalent to web pages, and suggest that strictly speaking, the number of web pages is infinite, since a web calendar could have a "next day" link that could send the user to a new "page" theoretically forever.
Regardless of which estimate one looks at, the 22 million pages the authors looked at represents a tiny fraction of the total size of the web, Sarshar acknowledges. He said a longer-term study that casts a wider net would give greater insight into the changing shape of the web. But he and his colleagues see parallels between the way web pages connect to each other and existing societal models.
"The balancing act between experience and talent on the web allows newly introduced pages with novel and interesting content to grow quickly and surpass older pages," the authors write.
"In this regard, it is much like what we observe in high-mobility and meritocratic societies: People with entitlement continue to have access to the best resources, but there is just enough screening for fitness that allows for talented winners to emerge and join the ranks of the leaders."
Share Tools
Top News Headlines
- Greece passes new austerity deal amid rioting
- Greek lawmakers have approved harsh new austerity measures demanded by bailout creditors to save the debt-crippled nation from bankruptcy, after riots in Athens and other cities left stores looted and burned and more than 120 people hurt. more »
- Quebec town 'heartbroken' after killing of woman, sisters
- A small Quebec town is in mourning Sunday after a Quebec man was charged with killing his nieces and his mother, who were found dead in their family home. more »
- Houston autopsy results withheld by police
- Whitney Houston was found in a hotel bathtub but it'll take weeks to determine precisely how she died, a Los Angeles coroner's official says. more »
- Musicians who died before their time
- The growing list of musicians who have died young. more »
Latest Technology & Science News Headlines
- Ancient Antarctic lake may harbour microbial life
- If scientists find microbes in a frigid lake 3.2 kilometres beneath the thick ice of Antarctica, it will illustrate once again that somehow life finds a way to survive in the strangest and harshest places, and it will offer hope that life exists beyond Earth. more »
- B.C. killer whale habitat protection ruled a legal duty
- The federal minister of fisheries has no discretion when it comes to protecting the critical habitat of B.C.'s southern resident killer whales, the Federal Court of Appeal has ruled. more »
- Game developer seeks $400K, makes $1M in a day
- Videogame studio Double Fine went on the website Kickstarter to raise $400K US in a month to develop a new game. They reached that target in a matter of hours. more »
- McGill asbestos study review criticized
- A group of anti-asbestos activists and scientists are criticizing McGill University's plans for an internal review of a major asbestos research study that has been called into question. more »
Bob McDonald's Blog
Glacier Discovery Walk: Will the visitor centre enhance the view? Feb. 10, 2012 3:17 PM Environment minister Peter Kent has announced the construction of a new Glacier Discovery Walk and visitor centre on the Icefields Parkway in Jasper National Park. It raises the issue of how to balance commercial development in our National Parks against the preservation of the last refuges of wilderness.
Quirks & Quarks
- February 11: Inside the Mind of a Neandertal Feb. 10, 2012 4:01 PM Can we get inside the mind of a species that's been dead for 30,000 years? A new book, How to Think Like a Neanderthal, suggests we can. The authors reconstruct a creature like us in many ways, but with important differences.
Latest Features
- Pop queen Whitney Houston dies at 48
- Houston autopsy results withheld by police
- Greece passes new austerity deal amid rioting
- Foo Fighters win 5 Grammys
- Carleton University confirms death of student
- Quebec town 'heartbroken' after killing of woman, sisters
- Ultimate Tazer Ball combines shock and soccer
- Manitoba man dies after falling off moving SUV
- Adults-only trade show cancelled in B.C. Bible belt

