Computer beats Jeopardy! champs
Ambiguity of language a challenge for computer
Last Updated: Friday, January 14, 2011 | 9:54 AM ET
The Associated Press
Jeopardy! champions Ken Jennings, left, and Brad Rutter, right, were soundly beaten by Watson in the female archeologists category, but had better success on questions about children's books and the initials M.C. (Seth Wenig/Associated Press) The clue: It's the size of 10 refrigerators, has access to the equivalent of 200-million pages of information and knows how to answer in the form of a question.
The correct response: "What is the computer IBM developed to become a Jeopardy! whiz?"
Watson, which IBM claims as a profound advance in artificial intelligence, edged out game-show champions Ken Jennings and Brad Rutter on Thursday in its first public test, a short practice round ahead of a million-dollar tournament that will be televised next month.
Later, the human contestants made jokes about the Terminator movies and robots from the future. Indeed, four questions into the round you had to wonder if the rise of the machines was already upon us — in a trivial sense at least.
Watson tore through a category about female archeologists, repeatedly activating a mechanical button before either Ken Jennings or Brad Rutter could buzz in, then nailing the questions: "What is Jericho?" "What is Crete?"
'Sorting out the context — especially in a game show filled with hints and jokes — is an enormous job for the computer.'— David Ferrucci, IBM
Its gentle male voice even scored a laugh when it said, "Let's finish 'Chicks Dig Me."'
Jennings, who won a record 74 consecutive Jeopardy! games in 2004-05, then salvaged the category, winning $1,000 by identifying the prehistoric human skeleton Dorothy Garrod found in Israel: "What is Neanderthal?"
He and Rutter, who won a record of nearly $3.3 million in prize money, had more success on questions about children's books and the initials "M.C.," though Watson knew about Harold and the Purple Crayon and that it was Maurice Chevalier who sang Thank Heaven for Little Girls in the film Gigi. The computer pulled in $4,400 in the practice round, compared with $3,400 for Jennings and $1,200 for Rutter.
Watson is powered by 10 racks of IBM servers running the Linux operating system. It's not connected to the internet but has digested encyclopedias, dictionaries, books, news, movie scripts and more.
4 years of work
The system is the result of four years of work by IBM researchers around the globe, and although it was designed to compete on Jeopardy! the technology has applications well beyond the game, said John Kelly III, IBM director of research. He said the technology could help doctors sift through massive amounts of information to draw conclusions for patient care, and could aid professionals in a wide array of other fields.
Alex Trebek, host of the Jeopardy! quiz show, is shown during a competitive practice round between Watson and two champions on Thursday. The real contest takes place Friday and will air Feb. 14-16. (Seth Wenig/Associated Press) "What Watson does and has demonstrated is the ability to advance the field of artificial intelligence by miles," he said.
Watson, named for IBM founder Thomas J. Watson, is reminiscent of IBM's famous Deep Blue computer, which defeated chess champion Garry Kasparov in 1997. But while chess is well-defined and mathematical, Jeopardy! presents a more open-ended challenge involving troves of information and complexities of human language that would confound a normal computer.
"Language is ambiguous; it's contextual; it's implicit," said IBM scientist David Ferrucci, a leader of the Watson team. Sorting out the context — especially in a game show filled with hints and jokes — is an enormous job for the computer, which also must analyze how certain it is of an answer and whether it should risk a guess, he said.
The massive computer was not behind its podium between Jennings and Rutter; instead it was represented by an IBM Smart Planet icon on an LCD screen.
Real contest Friday
The practice round was played on a stage at an IBM research centre in Yorktown Heights, N.Y., 60 kilometres north of Manhattan and across the country from the game show's home in Culver City, Calif. A real contest among the three, to be televised Feb. 14-16, will be played at IBM on Friday.
The winner of the televised match will be awarded $1 million. Second place gets $300,000, third place $200,000. IBM, which has headquarters in Armonk, said it would give its winnings to charity while Jennings and Rutter said they would give away half theirs.
In a question-and-answer session with reporters after the practice round, Rutter and Jennings made joking reference to the jump in technology Watson represents.
"When Watson's progeny comes back to kill me from the future," Rutter said, "I have my escape route planned just in case."
Jennings said someone suggested his challenge was like the legend of John Henry, the 19th-century labourer who beat a steam drill in a contest but died in the effort. Jennings prefers a comparison to Terminator, where the hero was a little more resilient.
"I had a friend tell me, 'Remember John Henry, the steel-drivin' man.' And I was like … 'Remember John Connor!"' Jennings said. "We're gonna take this guy out!"
Share Tools
Top News Headlines
- Oda's travel expenses cause dissent in Tory caucus
- Conservative MP John Williamson, who was once head of the Canadian Taxpayers Federation, has raised the issue of International Co-operation Minister Bev Oda's spending habits behind closed doors with the Conservative caucus. more »
- Canada accused of 'complicity' in torture in UN report
- The United Nations Committee Against Torture has condemned what it calls Canadian "complicity" in torture and human rights violations of Muslim men caught up in the post-9/11 security net. Terry Milewski has exclusive details. more »
- Diamond Jubilee: Your photos of royal encounters
- The CBC Community team asked you to submit your best photos of the Queen's visits to Canada, or visits by any member of the Royal Family. The result was tremendous! more »
- Helicopter crash kills 3 near Terrace, B.C.
- All three people aboard a helicopter that went down west of Terrace, B.C., died in the crash, the aircraft's owners say. more »
Latest Technology & Science News Headlines
- Newly mapped tomato genome could yield tastier, hardier fruit
- You might think you know all you need to know about the humble tomato, but now, you can truly get a look at what this fleshy fruit is made of thanks to the work of about 300 scientists who have identified almost all of the genes that make up one common variety. more »
- Last chance to see Venus transit across sun
- If you happen to glance at the sun in the early evening next Tuesday and notice a black dot moving across it, fear not, that's not dust in your eye or an early sign of glaucoma — it's Venus. more »
- Call of Duty creators, Activision settle legal fight
- Activision has reached a settlement with the creators of the hit video game series Call of Duty following a bitter legal battle. more »
- Google flags censored search words to Chinese users
- Google has fired a new salvo in its censorship battle with Beijing by adding a feature that warns users in China each time they enter keywords into its search engine that might produce blocked results and suggests they try other terms. more »
- Social mapping software turns neighbourhoods into 'Livehoods'
- You might have no doubt about what neighbourhood you live in, but can you pinpoint your livehood? If you're in Montreal, you can now, thanks to a new mapping software that redraws traditional city boundaries using data gleaned from social media applications such as Twitter and Foursquare. more »
Bob McDonald's Blog
SpaceX got it right when things went wrong Jun. 1, 2012 2:55 PM It was back slaps and hugs all around this week as the Dragon space capsule, the first privately-built spacecraft to visit the International Space Station, returned safely to Earth. What's most impressive is how problems that arose during the mission were solved along the way.
Quirks & Quarks
- June 2: The Day the World Discovered the Sun Jun. 1, 2012 4:32 PM We'll look back at the Transit of Venus in 1769, which sparked a worldwide competition among aspiring global superpowers, each sending its own scientific expedition to far-flung destinations to track the transit, in order to measure the distance to the Sun.
Latest Features
- Body-parts victim a Chinese student in Montreal
- Edmonton teacher suspended for giving 0s
- Flooding closes Toronto subway hub Union station
- Owner defends 'gore' site connected to Luka Magnotta
- New duty-free limits will challenge Canadian retailers
- Copyright board to charge for music at weddings, parades
- Helicopter crash kills 3 near Terrace, B.C.
- Alberta teen hospitalized after fight involving dozens of students
- 2,000 jobs cut as GM to close Oshawa plant

