Saturday October 21, 2017
A computer taught itself the toughest game on the planet. And it's just getting started
more stories from this episode
Go-ing one better than humans
A new version of Deepmind's AlphaGo game-playing Artificial Intelligence system is now the world's best player of the world's most difficult game - the ancient Asian board-game Go. Last year an older version of AlphaGo beat the world's best human player, but this new version is more than just an upgrade.
Researchers at Deepmind, part of the Google family of companies, have taken a new approach with this AI. According to team leader, Dr. David Silver, older versions learned by assimilating the playing styles of the best human Go players. The new version, called AlphaGo Zero, taught itself how to play, and practiced against itself as well. AlphaGo Zero then beat the program that beat the best humans in 100 straight games.
How to Go from good to better
The new self-taught version of AlphaGo is not only more effective than older versions, it's more creative. In teaching itself, it re-discovered many of the patterns of play that humans have developed and used, but also found new ones on its own which were superior to the ones human players used. AlphaGo Zero is also more efficient that human-taught AIs. It learned faster, and required far less computing power than previous versions.
But not quite the best
AlphaGo Zero is not the last word in AI. According to Dr. Doina Precup, a professor in the School of Computer Science at McGill University, and research team lead for Deepmind's newly formed Montreal team, self-teaching is best for well defined and well understood problems - like games, that can be played out in simulation in a computer.
Its near-term applications could include modelling chemical reactions, drug discovery or materials science, or even finance. It's not as well suited for real world problems that can't be easily simulated. However a combination of self-teaching and human teaching could be a powerful way to explore more generally applicable kinds of artificial intelligence. In the meantime, it may be time for a little role-reversal, as humans are earning how to play Go better, by studying how AlphaGo Zero plays.