AI translation feature tested in Montreal

Embarking on a trip to Montreal, I had the opportunity to test Meta's new AI translation feature on their Ray-Ban smart sunglasses. The feature is designed to provide a quick, hands-free method for understanding text written in foreign languages, a tool that proved both intriguing and challenging during my two days of exploration.

Upon my arrival, I was immediately thrown into a construction zone filled with confusing orange detour signs. The AI ​​translation feature was put to the test when I asked my sunglasses to interpret the signs. However, the first limitation of the software became apparent; can only understand written text, not spoken words. This meant that when a local construction worker started yelling directions at me, the sunglasses were useless.

Over the course of 48 hours, I tested AI translation on a variety of written materials, from street signs and business signs to children's books and menus. The results varied widely. At times, he was competent, correctly translating the title of a children's book, Trois Beaux Bébés, to “three beautiful babies.” However, it also had its shortcomings. For example, it did not provide a detailed translation of menu items at a local restaurant, providing only a broad summary of the offerings.

The process to enable AI translation is simple. The user has to say, “Hey Meta, look at…” and then ask it to translate what they're looking at. The glasses take a snapshot of what's in front of them and then provide a translation after a few seconds of processing. However, translations are often paraphrased or summarized, rather than a word-by-word breakdown.

In conclusion, while the AI ​​translation feature on Meta's Ray-Ban Smart Sunglasses is an interesting concept, it currently serves more as a novelty than a reliable travel tool. Its limitations, particularly its inability to translate spoken words and its tendency to provide broad summaries rather than detailed translations, make it less useful for practical purposes. However, it is a step towards a future where language barriers can be overcome effortlessly with the help of technology.