IBM's Watson trounces humans at Jeopardy
Last Updated: Wednesday, February 16, 2011 | 10:01 PM ET
The Associated Press
Related
External Links
(Note: CBC does not endorse and is not responsible for the content of external sites - links will open in new window)
Victory for the machine, centre, yes, but try making song, romance, smiles, sadness and all that jazz. (Associated Press) Machines first out-calculated us in simple math. Then they replaced us on the assembly lines, explored places we couldn't get to, even beat our champions at chess. Now a computer called Watson has bested our best at Jeopardy.
A gigantic computer created by IBM specifically to excel at answers-and-questions left two champs of the TV game show in its silicon dust after a three-day tournament, a feat that experts call a technological breakthrough.
Watson earned $77,147 US, versus $24,000 for Ken Jennings and $21,600 for Brad Rutter. Jennings took it in stride, writing, "I for one welcome our new computer overlords" alongside his correct Final Jeopardy answer.
The next step for the IBM machine and its programmers: taking its mastery of the arcane and applying it to help doctors plow through blizzards of medical information. Watson could also help make internet searches far more like a conversation than the hit-or-miss things they are now.
'The way to think about this is: can Watson decide to create Watson?'—Pradeep Khosla, Carnegie Mellon
Watson's victory leads to the question: what can we measly humans do that amazing machines cannot do or will never do?
The answer, like all of Jeopardy, comes in the form of a question: Who — not what — dreamed up Watson? While computers can calculate and construct, they cannot decide to create. So far, only humans can.
"The way to think about this is: can Watson decide to create Watson?" said Pradeep Khosla, dean of engineering at Carnegie Mellon University in Pittsburgh. "We are far from there. Our ability to create is what allows us to discover and create new knowledge and technology."
Experts in the field say it is more than the spark of creation that separates man from his mechanical spawn. It is the pride creators can take, the empathy we can all have with the winners and losers, and that magical mix of adrenalin, fear and ability that kicks in when our backs are against the wall and we are in survival mode.
Essence of humanity
What humans have that Watson, IBM's earlier chess champion Deep Blue, and all their electronic predecessors and software successors do not have and will not get is the sort of thing that makes song, romance, smiles, sadness and all that jazz.
It's something the experts in computers, robotics and artificial intelligence know very well because they can't figure out how it works in people, much less duplicate it. It's that indescribable essence of humanity.
Nevertheless, Watson, which took 25 IBM scientists four years to create, is more than just a trivia whiz, some experts say.
Richard Doherty, a computer industry expert and research director at the Envisioneering Group in Seaford, N.Y., said he has been studying artificial intelligence for decades. He thinks IBM's advances with Watson are changing the way people think about artificial intelligence and how a computer can be programmed to give conversational answers — not merely lists of sometimes not-germane entries.
"This is the most significant breakthrough of this century," he said. "I know the phones are ringing off the hook with interest in Watson systems. The internet may trump Watson, but for this century, it's the most significant advance in computing."
Humans are different
And yet Watson's creators say this breakthrough gives them an extra appreciation for the magnificent machines we call people.
"I see human intelligence consuming machine intelligence, not the other way around," David Ferrucci, IBM's lead researcher on Watson, said in an interview Wednesday. "Humans are a different sort of intelligence. Our intelligence is so interconnected. The brain is so incredibly interconnected with itself, so interconnected with all the cells in our body, and has co-evolved with language and society and everything around it."
"Humans are learning machines that live and experience the world and take in an enormous amount of information — what they see, what they taste, what they feel, and they're taking that in from the day they're born until the day they die," he said. "And they're learning from all the input all the time. We've never even created something that attempts to do that."
The ability of a machine to learn is the essence of the field of artificial intelligence. And there have been great advances in the field, but nothing near human thinking.
"I've been in this field for 25 years and no matter what advances we make, it's not like we feel we're getting to the finish line," said Carnegie Mellon University professor Eric Nyberg, who has worked on Watson with its IBM creators since 2007. "There's always more you can do to bring computers to human intelligence. I'm not sure we'll ever really get there."
Bart Massey, a professor of computer science at Portland State University, quipped: "If you want to build something that thinks like a human, we have a great way to do that. It only takes, like, nine months, and it's really fun."
One task: answer questions
Working on computer evolution "really makes you appreciate the fact that humans are such unique things and they think such unique ways," Massey said.
Nyberg said it is silly to think that Watson will lead to an end or a lessening of humanity. "Watson does just one task: answer questions," he said. And it gets things wrong, such as saying grasshoppers eat kosher, which Nyberg said is why humans won't turn over launch codes to it or its computer cousins.
Take Tuesday's Final Jeopardy, which Watson flubbed and its human competitors handled with ease. The category was U.S. cities, and the clue was: "Its largest airport is named for a World War II hero; its second largest, for a World War II battle."
The correct response was Chicago, but Watson weirdly wrote, "What is Toronto?????"
IBM's hardware: Watson inside (Seth Wenig/Associated Press) A human would have considered Toronto and discarded it because it is a Canadian city, not a U.S. one, but that's not the type of comparative knowledge Watson has, Nyberg said.
"A human working with Watson can get a better answer," said James Hendler, a professor of computer and cognitive science at Rensselaer Polytechnic Institute. "Using what humans are good at and what Watson is good at, together we can build systems that solve problems that neither of us can solve alone."
That's why Paul Saffo, a longtime Silicon Valley forecaster, and others, see better search engines as the ultimate benefit from the Jeopardy-playing machine.
"We are headed toward a world where you are going to have a conversation with a machine," Saffo said. "Within five to 10 years, we'll look back and roll our eyes at the idea that search queries were a string of answers and not conversations."
The beneficiaries, IBM's Ferrucci said, could include technical support centres, hospitals, hedge funds or other businesses that need to make lots of decisions that rely on lots of data.
For example, a medical centre might use the software to better diagnose disease. Since a patient's symptoms can generate many possibilities, the advantage of a Watson-type program would be its ability to scan the medical literature faster than a human could and suggest the most likely result. A human, of course, would then have to investigate the computer's finding and make the final diagnosis.
IBM isn't saying how much money it spent building Watson. But Doherty said the company told analysts at a recent meeting that the figure was around $30 million. Doherty believes the number is probably higher, in the "high dozens of millions."
In a few years, Carnegie Mellon University robotic whiz Red Whittaker will be launching a robot to the moon as part of Google challenge. When it lands, the robot will make all sorts of key and crucial real-time decisions — like Neil Armstrong and Buzz Aldrin did 42 years ago — but what humans can do that machines can't will already have been done: Create the whole darn thing.
Share Tools
FILM REVIEW: Jack the Giant Slayer by Eli Glasner Mar. 3, 2013 10:40 AM Bryan Singer, a director known for his superhero cinema (including X-Men and Superman Returns), is injecting a dose of modern movie magic into the classic tale of Jack and the Beanstalk. Though Jack the Giant Slayer features a strong cast, the action adventure sacrifices story for spectacle, says Eli Glasner.
Top News Headlines
- Cardinals begin pre-conclave meetings amid scandal
- Cardinals from around the world gathered inside the Vatican for their first round of meetings before the conclave to elect the next pope, amid scandals inside and out of the Vatican and the continued reverberations of Benedict XVI's decision to retire. more »
- Dad gets $22,000 data roaming 'shock' from Fido
- A B.C. dad is accusing Rogers of price gouging, after his 11-year-old mistakenly racked up $22,000 worth of data charges on his father's phone, during a family trip to Mexico. more »
- Queen remains in hospital after overnight stay
- Queen Elizabeth remains in a London hospital for a second day because of an apparent stomach infection. more »
- Egypt's politician skewer, testing the limits of post-revolution satire
- Meet Egypt's Jon Stewart, a former heart surgeon turned late-night TV host whose biting satire has not endeared him to the country's political class. But, as Nahlah Ayed reports, comedian Bassem Youssef may be the revolution's real star. more »
- Quebec papal contender 'ready' but wary of media spotlight
- Quebec Cardinal Marc Ouellet, who is considered by some to be a leading contender for the Vatican's top post, tells CBC's Peter Mansbridge in an exclusive interview he knows he must be ready to become the next pope as cardinals prepare to select Benedict's successor. more »
Latest Arts & Entertainment News Headlines
- War Witch triumphs at Canadian Screen Awards gala
- War Witch swept away nearly all competition at the inaugural Canadian Screen Awards broadcast gala Sunday night, with the searing child soldier drama capturing best picture and nine other trophies, while TV favourites Flashpoint and Less Than Kind also earned further accolades.
more »
- The Miracles founder, Motown singer Bobby Rogers dies
- Bobby Rogers, a founding member of Motown group The Miracles and a collaborator with Smokey Robinson, has died. He was 73. more »
- Jack the Giant Slayer sacrifices story for spectacle
- X-Men director Bryan Singer injects modern movie magic into Jack the Giant Slayer, but despite a strong cast, the action adventure sacrifices story for spectacle, says Eli Glasner. more »
- Why an Oscar-winning visual effects firm has gone broke
- VFX veteran Scott Ross explains to Day 6's Brent Bambury what led to the dire state of the industry today, why even Life of Pi's Oscar-winning firm Rhythm & Hues can go broke and what visual effects artists must do to turn things around. more »
- Justin Bieber: 19 key moments as the pop star turns 19
- Friday is Justin Bieber's 19th birthday and he faces a watershed moment: transitioning from pop upstart to credible adult artist with appeal beyond teen girls. CBC looks at 19 moments of his remarkable career so far. more »
Q Blog
Rebecca Marino on tennis and depression Mar. 1, 2013 4:34 PM
CBC Books
The future of the book Mar. 1, 2013 4:16 PM Journalists Sean Prpick and Dave Redel explore the rise of e-books, social reading, and whether they'll fundamentally change the way we consume and share stories.
- Baby born HIV-positive apparently cured, say scientists
- Dad gets $22,000 data roaming 'shock' from Fido
- Quebec papal contender 'ready' but wary of media spotlight
- Body of man found in home where police officer was killed
- War Witch triumphs at Canadian Screen Awards gala
- Heavy snow blankets southern Alberta
- Florida sinkhole home mostly demolished
- Expectant NYC couple dies in car crash, baby delivered alive
- Iceland tests find meat pies contain no meat at all


