A Star Trek-style universal translator may sound like the stuff of science fiction, but Microsoft is developing a new type of software that can convert your words into another language while preserving the sound of your voice. Here, a quick look at the futuristic new technology that could revolutionize the way we travel:
How does it work?
The prototype is part of Microsoft's Speech Platform, which can translate text to speech in 26 languages. The system requires an hour of training to create a model for your voice, taking into account accent, timbre, and intonation. "This model is then mushed into Microsoft's standard text-to-speech model for the target translation language," says Sebastian Anthony at ExtremeTech. For example: Microsoft's model in Spanish will replace its default "S" sound with the way you pronounce "S." This is done for every individual sound, or phoneme. Then you speak into the device in your native tongue, and it plays back what you said in another language, while sounding like you.
Does the artificial voice sound authentic?
The creator of the software, Frank Soong, gave a live demonstration at a conference earlier this year. (Listen to it here at around the 17 minute mark.) In the soundbite, he had Microsoft's chief research officer, Rick Rashid, say a long sentence in English, and the software translated his words into Spanish, Italian, and Mandarin. You can hear how the sound of his voice becomes digitized, says Anthony, "but overall it's remarkable how the three translations still sound just like Rashid."
How useful will this really be in daily life?
One day this technology could make it onto smartphones (Windows 8, anyone?), making it easier for travelers to cope in foreign countries. "The number of times I've massacred another language in an attempt to simply get a pint a beer makes me shudder," says Sam Gibbs at Gizmodo U.K. "Turn this into a phone app and you'll have an instant communicator." The software could also be huge for businesses, says Eileen Brown at ZDNet, which "could have the opportunity to break into new markets around the globe without the overhead of human based translation services."
THE WEEK'S AUDIOPHILE PODCASTS: LISTEN SMARTER
- 7 things the world's happiest people do every day
- 9 things you probably didn't know about the moon
- Israel has only two choices: Eliminate the Palestinians or make peace
- Why are so many parents being arrested?
- What would a U.S.-Russia war look like?
- 7 grammar rules you really should pay attention to
- 29 adorable slang terms for sex (from the last 600 years)
- What if The Purge was real?
- Why I choose not to be rich
- Here's the last time Russia shot down a passenger plane
Subscribe to the Week