A Star Trek-style universal translator may sound like the stuff of science fiction, but Microsoft is developing a new type of software that can convert your words into another language while preserving the sound of your voice. Here, a quick look at the futuristic new technology that could revolutionize the way we travel:
How does it work?
The prototype is part of Microsoft's Speech Platform, which can translate text to speech in 26 languages. The system requires an hour of training to create a model for your voice, taking into account accent, timbre, and intonation. "This model is then mushed into Microsoft's standard text-to-speech model for the target translation language," says Sebastian Anthony at ExtremeTech. For example: Microsoft's model in Spanish will replace its default "S" sound with the way you pronounce "S." This is done for every individual sound, or phoneme. Then you speak into the device in your native tongue, and it plays back what you said in another language, while sounding like you.
Does the artificial voice sound authentic?
The creator of the software, Frank Soong, gave a live demonstration at a conference earlier this year. (Listen to it here at around the 17 minute mark.) In the soundbite, he had Microsoft's chief research officer, Rick Rashid, say a long sentence in English, and the software translated his words into Spanish, Italian, and Mandarin. You can hear how the sound of his voice becomes digitized, says Anthony, "but overall it's remarkable how the three translations still sound just like Rashid."
How useful will this really be in daily life?
One day this technology could make it onto smartphones (Windows 8, anyone?), making it easier for travelers to cope in foreign countries. "The number of times I've massacred another language in an attempt to simply get a pint a beer makes me shudder," says Sam Gibbs at Gizmodo U.K. "Turn this into a phone app and you'll have an instant communicator." The software could also be huge for businesses, says Eileen Brown at ZDNet, which "could have the opportunity to break into new markets around the globe without the overhead of human based translation services."
THE WEEK'S AUDIOPHILE PODCASTS: LISTEN SMARTER
- 43 TV shows to watch in 2014
- How to be the most productive person in your office — and still get home by 5:30 p.m.
- Ted Cruz is the new Sarah Palin
- How liberals are unwittingly paving the way for the legalization of adult incest
- How the Simpsons/Family Guy crossover revealed the worst of both shows
- Watch out, China — America is working on dogfighting drones
- 6 things the happiest families all have in common
- Libertarianism's terrible, horrible, no good, very bad idea
- Fall film guide: All the movies you should see in October
- Why you probably don't have Ebola — even if you shook hands with America's 'patient zero'
Subscribe to the Week