The Sunday Edition

How an algorithm can predict the next J.K. Rowling or Danielle Steele

A computer algorithm called the "bestseller-ometer" has found 2,800 elements that can predict whether a novel will hit it big -- and publishers are using it. Michael talks to Susanne Althoff, who teaches writing, literature and publishing at Emerson College in Boston.
Bangalore, INDIA: An Indian couple walks past a roadside book stall where copies of 'The Da Vinci Code' are on display. The book has been translated into 56 languages; over 200 million copies are in print. (AFP/Getty Images)
Listen15:30

The book trade is at once a high-minded and a grubby pursuit. Publishers solemnly assume the mantle of guardians and creators of culture … enlightening and delighting readers by printing and selling books that change not only people's lives, but culture and the language itself. 

There's much honour in that. But not a lot of money. To pay for those cultural and artistic landmarks, they need bestsellers that are lapped up by masses of readers irrespective of literary or any other kind of merit. 

The trick is to spot the next Girl With The Dragon Tattoo, Da Vinci Code or Fifty Shades of Grey buried in the stacks of manuscripts of mediocre potboilers, thrillers and bodice rippers submitted to publishers every year. 

It's been an inexact process. Just ask the 12 publishers who turned down J. K. Rowling's manuscript for Harry Potter and the Philosopher's Stone. 

But publishing is putting data and computing power to work to find — or create — the next big hit. 

The Bestseller Code, a book by Jodie Archer and Matthew Jockers published last year, describes an algorithm they devised to sequence the DNA of bestselling novels. They call it the bestseller-ometer, and it's found 2800 elements encompassing language, character types and plot structures that can predict whether a novel will become a bestsellier. It boasts an 80 percent accuracy rate.

Susanne Althoff, assistant professor, department of writing, literature and publishing, Emerson College (Emerson College)
The suggestion that writing a bestselling novel is as much a science as an art might be disconcerting or even upsetting to a lot of readers, but some publishers see it as a godsend that might take the guesswork out of picking the right manuscripts to publish and promote.

Susanne Althoff wrote about the use of big data and algorithms in publishing in a recent article in Wired magazine called "Algorithms could save book publishing — but ruin novels."

Susanne Althoff is an assistant professor at Emerson College, and she's the former editor of the Boston Globe Sunday Magazine.

Click the button above to hear Michael's interview with Susanne Althoff.

Comments

To encourage thoughtful and respectful conversations, first and last names will appear with each submission to CBC/Radio-Canada's online communities (except in children and youth-oriented communities). Pseudonyms will no longer be permitted.

By submitting a comment, you accept that CBC has the right to reproduce and publish that comment in whole or in part, in any manner CBC chooses. Please note that CBC does not endorse the opinions expressed in comments. Comments on this story are moderated according to our Submission Guidelines. Comments are welcome while open. We reserve the right to close comments at any time.