Android and iPhone app instantly translates Spanish, Italian and French to English using your camera
Most of us have faced that terror of being trapped in a foreign country with little understanding or comprehension of the language.
Whether it is a parking sign that makes no sense, or a menu that is all Greek to you, an app for Android and iPhone could be the solution by translating words on-the-fly with the help of your camera lens.
WordLens uses your phone’s inbuilt camera to recognize text that is viewed through the lens, and then translating them to English.
So far the app works for French, Spanish and Italian (so actually, if a menu is all Greek to you, it won’t be much help).
Word Lens in action: The app instantly translates written signs into English (and vice versa)
As the app says, you do not need a costly overseas internet connection to use the app, as it has dictionaries pre-installed
WordLens uses text recognition to work out what the word or phrase is, and then automatic translation software translates it into the new language.
The translation is then pasted over the original location, practically in real time.
The app has been available on the iPhone with Spanish translation for about 18 months, but is now available on both major smartphone platforms with the new range of languages.
A promotional video for the app which shows it instantly translating a number of signs in both languages has already become an internet hit.
The app is not perfect: But it gives you a good heads-up as to what to expect, especially in a foreign restaurant
One visitor to technology website Mashable wrote: ‘This is probably the greatest augmented reality I’ve seen yet. To add layers and distinguish things is amazing. But photoshop translated words in well, that’s incredible.’
Not every phrase translated in the app is grammatically correct with mangled English such as ‘Recent attack of shark’ and ‘Tongue Bolivian with a sauce spicy of anchovies’ resulting from literal translation.
But the speed and accuracy of the app’s software is still good enough to make sense of simple road signs or restaurant menus.
Otavio Good, one of the developers behind the Word Lens, told TechCrunch: ‘It tries to find out what the letters are and then looks in the dictionary. Then it draws the words back on the screen in translation.’
He says that more languages are going to be introduced, and he is even considering a reader for the blind, which would read out loud the words the app sees on signs.
He said: ‘The translation isn’t perfect, but it gets the point across.’
Word Lens bears some similarities to Google’s own application called Google Goggles, which lets users take a picture of a phrase and then search the web using that word.