Computer beats Jeopardy! champs
Ambiguity of language a challenge for computer
Last Updated: Friday, January 14, 2011 | 9:54 AM ET
The Associated Press
Jeopardy! champions Ken Jennings, left, and Brad Rutter, right, were soundly beaten by Watson in the female archeologists category, but had better success on questions about children's books and the initials M.C. (Seth Wenig/Associated Press) The clue: It's the size of 10 refrigerators, has access to the equivalent of 200-million pages of information and knows how to answer in the form of a question.
The correct response: "What is the computer IBM developed to become a Jeopardy! whiz?"
Watson, which IBM claims as a profound advance in artificial intelligence, edged out game-show champions Ken Jennings and Brad Rutter on Thursday in its first public test, a short practice round ahead of a million-dollar tournament that will be televised next month.
Later, the human contestants made jokes about the Terminator movies and robots from the future. Indeed, four questions into the round you had to wonder if the rise of the machines was already upon us — in a trivial sense at least.
Watson tore through a category about female archeologists, repeatedly activating a mechanical button before either Ken Jennings or Brad Rutter could buzz in, then nailing the questions: "What is Jericho?" "What is Crete?"
'Sorting out the context — especially in a game show filled with hints and jokes — is an enormous job for the computer.'— David Ferrucci, IBM
Its gentle male voice even scored a laugh when it said, "Let's finish 'Chicks Dig Me."'
Jennings, who won a record 74 consecutive Jeopardy! games in 2004-05, then salvaged the category, winning $1,000 by identifying the prehistoric human skeleton Dorothy Garrod found in Israel: "What is Neanderthal?"
He and Rutter, who won a record of nearly $3.3 million in prize money, had more success on questions about children's books and the initials "M.C.," though Watson knew about Harold and the Purple Crayon and that it was Maurice Chevalier who sang Thank Heaven for Little Girls in the film Gigi. The computer pulled in $4,400 in the practice round, compared with $3,400 for Jennings and $1,200 for Rutter.
Watson is powered by 10 racks of IBM servers running the Linux operating system. It's not connected to the internet but has digested encyclopedias, dictionaries, books, news, movie scripts and more.
4 years of work
The system is the result of four years of work by IBM researchers around the globe, and although it was designed to compete on Jeopardy! the technology has applications well beyond the game, said John Kelly III, IBM director of research. He said the technology could help doctors sift through massive amounts of information to draw conclusions for patient care, and could aid professionals in a wide array of other fields.
Alex Trebek, host of the Jeopardy! quiz show, is shown during a competitive practice round between Watson and two champions on Thursday. The real contest takes place Friday and will air Feb. 14-16. (Seth Wenig/Associated Press) "What Watson does and has demonstrated is the ability to advance the field of artificial intelligence by miles," he said.
Watson, named for IBM founder Thomas J. Watson, is reminiscent of IBM's famous Deep Blue computer, which defeated chess champion Garry Kasparov in 1997. But while chess is well-defined and mathematical, Jeopardy! presents a more open-ended challenge involving troves of information and complexities of human language that would confound a normal computer.
"Language is ambiguous; it's contextual; it's implicit," said IBM scientist David Ferrucci, a leader of the Watson team. Sorting out the context — especially in a game show filled with hints and jokes — is an enormous job for the computer, which also must analyze how certain it is of an answer and whether it should risk a guess, he said.
The massive computer was not behind its podium between Jennings and Rutter; instead it was represented by an IBM Smart Planet icon on an LCD screen.
Real contest Friday
The practice round was played on a stage at an IBM research centre in Yorktown Heights, N.Y., 60 kilometres north of Manhattan and across the country from the game show's home in Culver City, Calif. A real contest among the three, to be televised Feb. 14-16, will be played at IBM on Friday.
The winner of the televised match will be awarded $1 million. Second place gets $300,000, third place $200,000. IBM, which has headquarters in Armonk, said it would give its winnings to charity while Jennings and Rutter said they would give away half theirs.
In a question-and-answer session with reporters after the practice round, Rutter and Jennings made joking reference to the jump in technology Watson represents.
"When Watson's progeny comes back to kill me from the future," Rutter said, "I have my escape route planned just in case."
Jennings said someone suggested his challenge was like the legend of John Henry, the 19th-century labourer who beat a steam drill in a contest but died in the effort. Jennings prefers a comparison to Terminator, where the hero was a little more resilient.
"I had a friend tell me, 'Remember John Henry, the steel-drivin' man.' And I was like … 'Remember John Connor!"' Jennings said. "We're gonna take this guy out!"
Share Tools
Top News Headlines
- Obesity now recognized as a disease
- The American Medical Association has voted to recognize obesity as a disease, while doctors in Canada say they also treat it as such. more »
- B.C. First Nation sets fires to save bison
- A First Nation band is reviving the age-old practice of controlled burning in order to improve the health of forests and restore the population of the wood bison in a corner of northeastern B.C. more »
- 1 in 8 bird species threatened with extinction
- One in eight bird species worldwide faces the threat of extinction, according to a report released by Birdlife International. more »
- Canada buys rare War of 1812 collection for $573K
- The government of Canada was the winning bidder for a large collection of letters, maps and other papers that once belonged to Sir John Sherbrooke, the lieutenant-governor of Nova Scotia who conquered Maine for the British during the War of 1812. The collection sold for $573,000 at auction in London. more »
Must Watch
Latest Technology & Science News Headlines
- How open is Ottawa's new 'open data' website?
- Treasury Board President Tony Clement is touting the federal government's revamped data portal as a "new natural resource." But that online window for previously published data arrives at the same time the government faces controversy over just how open it really is. more »
- Genetically-modified crop inventors win World Food Prize
- Three pioneers of plant biotechnology whose work brought the world genetically modified crops have been awarded this year's World Food Prize. more »
- Anti-social media app helps you avoid other people
- A cheeky new app, billed "an experiment in ant-social media," leverages a user's own social network to decrease the likeliness of actually crossing paths with someone in it. more »
- 'Tweet' gets 21st century update in Oxford dictionary
- Tweeting in the social-networking sense has become so pervasive that the Oxford English Dictionary has broken one of its own rules to add new meanings for "tweet" as both a noun and a verb. more »
Bob McDonald's Blog
After Hadfield, who's the next Canadian in space? Jun. 13, 2013 12:01 PM Canada's singing astronaut announced his retirement this week, leaving Jeremy Hansen and David Saint-Jacques to fill his space boots. But there is no date set for when the next Canadian will fly in space.
Quirks & Quarks
- June 22: How to Build a Brain Jun. 19, 2013 10:42 AM Scientists are embarking on ambitious projects to understand the incredible complexity of the human brain and to simulate it in a computer. They hope it will help us understand mental disorders, as well as the nature of thought, memory, and conciousness.
Latest Features
- Sopranos star James Gandolfini dies in Italy
- Wearing a mask at a riot is now a crime
- Dozens of children seized from Manitoba Mennonite community
- B.C. teacher duct-taped students' mouths
- B.C. First Nation sets fires to save bison
- Obesity now recognized as a disease
- Richmond widow racks up $1,800 hospital parking bill
- Bob Rae quits as MP in 'very emotional' decision
- Hail, flash floods hit southeast Alberta

