AR Camera Translator

Traditional translation apps often suffer from high latency, poor offline support, and — most notably — unstable or "jumping" translated text overlaid on the camera screen.

We developed a mobile app that turns smartphones into real-time translation tools, combining computer vision, NLP and AR. To fix the "jumping text" issue, we built a smart text-clustering algorithm based on IoU and gyroscope anchoring, keeping translated text perfectly stable.

A hybrid translation approach — on-device translation for privacy and offline use, combined with cloud-based AI for high accuracy and contextual understanding. The result is a smooth AR experience with low latency at 30 FPS.