Look & Learn

AR Application that translates what you are looking at in the language you are trying to learn

Key 🔑	Value
Project Status	Complete. Unfortunately, Translation & Object recognition endpoints have expired, so the application is now in a state which may compile but not work properly.
Date	10/06/2021
Built with
Quick Links	View Source Code on Github View a Demo Video

Details

Look and Learn is an AR (Augmented Reality) experience that helps with language learning by encouraging the user to go out and explore objects in their world to collect phrases. The user can get the translation of that object by simply tapping on the object while in AR mode.

The application can translate up to 86 different languages and can run on both iOS and Android.

You may see a demo here on iOS:

This application was created for a Mixed Reality module in Year 3. The application to be made was supposed to aid in a specific domain from a set of domains. I chose education, and to aid with language learning.

Sadly, many of the APIs, like the Translation API (Microsoft Translate) and Imagga (Image Recognition) API have all their free credits used up, so I cannot provide a proper demo that you can use.