U.S. researchers turn words to music
Last Updated: Tuesday, September 25, 2007 | 4:16 PM ET
CBC News
Related
External Links
(Note: CBC does not endorse and is not responsible for the content of external sites - links will open in new window)
U.S. electrical engineers and computer scientists have developed "Google for music," a search engine that takes words and finds tunes to match.
Gert Lanckriet and colleagues have developed a computer system that allows users to find music using words, such as 'funky guitar solos.'
(University of California, San Diego)
Users can search "high energy instrumental with piano," "funky guitar solos" or "upbeat music with female vocals" and locate the songs they want, said the researchers, from the University of California in San Diego.
They have built a system that allows a computer to annotate a song using algorithms they created. Once annotated, a user can retrieve it with a text-based search engine, they said in a statement Tuesday.
But it's not quite that simple. Before the computer can categorize songs, it has to be trained. Gert Lanckriet, a UCSD electrical engineering professor, said that the scientists have developed what they call Listen Game, which can capture the word-song combinations necessary to train the system to label large numbers of songs automatically.
Part of the problem in assigning attributes to songs is human: "A pre-teen girl might consider a Backstreet Boys song to be 'touching and powerful' whereas a DJ at an indie radio station may consider it 'abrasive and pathetic,' " the authors wrote in a paper presented in Vienna this week.
Listen Game helps address that. The online game gets players to tag songs with words, determining which words are most — or least — relevant to the song. Players earn points when they pick the same words as others listening to the same songs.
The researchers use these "semantic annotations of music" to train their computer to accurately label songs it has not previously encountered, they reported in the paper.
"We've shown — in academic terms — that our game works. We're close to the performance we get with comparable survey data from the music undergrads we paid to fill out music surveys," said Doug Turnbull, a computer science PhD student who wrote the paper with Lanckriet.
The researchers presented three papers at the International Conferences on Music Information Retrieval. As well as the one on Listen Game, they reported on identifying words that are most likely to be meaningful to music search engines, and detecting boundaries within songs.
Boundary detection is important for generating music thumbnails, efficient browsing and music information retrieval.
"Maybe you want to listen to the Beatles, but mellow Beatles. You don’t want to listen to Back in the USSR," said Turnbull. "We are building a system that lets you use natural language to search for music with this level of detail."
Listen Game is free and has no advertising. An updated version is planned.
"A bunch of engineers made Listen Game. The second generation will have a livelier look and feel," Lanckriet said.
Share Tools
Top News Headlines
- Everest victim's family asks for government help
- The family of a Toronto woman who died in pursuit of her lifelong dream to climb Mount Everest is asking the Canadian government for help in bringing her body back to Canada. more »
- Employment Insurance review boards to be scrapped
- The federal government is scrapping two review boards used by people appealing decisions made about their employment insurance. more »
- Teens share bullying tales in confession booth
- Raw stories about bullying emerged when a video booth was set up inside a Quebec high school. more »
- Canada ending 'Buffalo shuffle' for visas, closing consulate
- The federal government is shutting the Canadian consulate in Buffalo less than two years after costly renovations, while dropping a requirement for visas to be renewed outside the country, CBC News has learned. more »
Latest Technology & Science News Headlines
- SpaceX capsule docked at International Space Station
- The privately bankrolled unmanned SpaceX Dragon capsule has been securely bolted to the Harmony module of the International Space Station. . more »
- Bonavista, N.L., 'coyote' was really wolf, tests confirm
- Wolves have not been seen in Newfoundland since around 1930 and were believed to have been hunted to extinction on the island, but genetic tests have confirmed that an 82-pound animal shot on the Bonavista Peninsula in March was, in fact, a wolf. more »
- Once-rare argus butterfly thriving thanks to climate change
- Global warming is threatening the existence of many species, such as the giant polar bear, but in the case of Britain's brown argus butterfly, it took a species in trouble and made it thrive. more »
- How curry spice helps the immune system kill bacteria
- A spice used in curry dishes helps to prevent infection and now scientists think they've got a lead on how. more »
Bob McDonald's Blog
Government to shut down unique fresh water research area May. 25, 2012 12:31 PM The Experimental Lakes Area research facility in Northern Ontario is being closed down after 44 years of providing invaluable data to scientists in Canada and internationally, a decision that has stunned researchers and environmental groups.
Quirks & Quarks
- May 26: Before the Lights Go Out May. 24, 2012 10:14 AM A new book, "Before the Lights Go Out: Conquering the Energy Crisis Before It Conquers Us", suggests that the unpredictable, unplanned, ad-hoc way our energy use developed in the past will shape our energy future.
Latest Features
- Victim's husband to be charged in Aylmer triple stabbing
- Reclaiming the dead on Mt. Everest
- Everest victim's family asks for government help
- Employment Insurance review boards to be scrapped
- Teens share bullying tales in confession booth
- Conservatives move again to have robocalls suits tossed
- Workers' EI history to affect claim under new rules
- Canada ending 'Buffalo shuffle' for visas, closing consulate
- SpaceX capsule docked at International Space Station
Gert Lanckriet and colleagues have developed a computer system that allows users to find music using words, such as 'funky guitar solos.'
