AboutWorkBlog
Start a project ↗
← All work
AR / Immersive · Birmingham City University

AR navigation and real-time translation for stress-free travel

View full case study ↗

Role

Lead UX Designer

Institution

Birmingham City University

Module

Advanced & Immersive Technologies

Team

Group 3A · 5 members

Surfaces

AR glasses · Mobile · Smartwatch

Prototyping

Figma · Google Cardboard · Draft XR

Guidance and translation, in your field of view.

NAVLINGO is an AR navigation and real-time translation system for airports, transit hubs and cities. It overlays directional guidance, translated signage, live speech captions and contextual point-of-interest info directly into the traveller’s view, so they never have to look down at a phone in a crowded, unfamiliar space. It spans three surfaces: AR glasses as the primary interface, a companion mobile app, and a smartwatch for discreet alerts.

Problem

Travellers get lost in complex terminals and blocked by language barriers, while phone navigation forces heads-down walking.

What we built

An AR system overlaying wayfinding, live sign & speech translation and airport info directly in the field of view.

Result

~90% of testers rated the AR navigation intuitive and effective across three connected surfaces.

3
connected surfaces, AR glasses, mobile, smartwatch
10
users tested via Google Cardboard + Draft XR
~90%
rated the AR navigation intuitive and effective

A walkthrough of the AR navigation and real-time translation experience.

The problem

Modern travel is stressful, disorienting and full of language barriers.

Why it matters

Travellers routinely struggle inside large terminals, with inaccessible signage and confusing airport systems. Existing phone navigation forces users to look down, disorienting and unsafe in crowded spaces.

Five pain points

01

Terminal navigation

Multi-level, complex airport hubs are hard to navigate.

02

Language barriers

Foreign signs, menus and spoken announcements are unreadable.

03

Accessibility deficits

Little audio / visual support for low vision or low tech literacy.

04

Visibility & glare

Outdoor and indoor glare make phone screens hard to read.

05

Travel stress

Last-minute gate changes and lost luggage cause anxiety.

How might we

…use AR and real-time translation to create a seamless, accessible travel experience for all travellers, regardless of language, tech literacy or physical impairment?

Technical research and benchmarking

No headset was built for accessible travel.

The gap in the market

We benchmarked the leading AR/VR platforms. Each nails part of the spatial experience, but none combines real-time travel navigation, live translation and full accessibility, the gap NAVLINGO targets.

Capability01Apple Vision Pro02Meta Quest Pro03HoloLens 204NAVLINGO
Real-time indoor / outdoor navigationLimitedLimitedLimited
Live sign translation (eye-gaze)
Airport flow, boarding pass & gate sync
Full WCAG 2.1 AA accessibilityPartialPartialPartial
Eye-gaze interaction
IoT baggage tracking (RFID / beacon)
Consumer travel focus
Full supportPartialNot supported

Size of circle = level of support

Key technical challenges

01

Field of view, tunnel vision

Consumer AR glasses offer only 40-50° FOV. Mitigated with waveguide-optics research and gaze-adaptive UI scaling.

02

Outdoor brightness

Targeted 10,000+ nits (Lumus / DIGILENS modules) so overlays stay legible in daylight.

03

Vergence-accommodation conflict

Depth-focused, multifocal optical design to reduce eye strain over long sessions.

Personas and scenarios

Three travellers, three very different needs.

Personas

Persona sheet for Tim Warren
Tim Warren
Persona sheet for Emily
Emily
Persona sheet for David
David

Built from research into who struggles most with travel, an older low-vision traveller, a tech-savvy solo explorer, and a parent managing a family.

Between them they cover the full span of tech literacy, which is what forced the hands-free controls and the accessibility work. Tim cannot read the signage, Emily has both hands on her luggage, and David is tracking three people at once.

Scenarios

Tim, limited eyesight

Tim Warren scenario, step 1
01Tim is struggling to navigate Fukuoka airport due to a lack of English signs and his poor eyesight. He’s hesitant to ask for help from staff due to potential language barriers or their busy schedules.
Tim Warren scenario, step 2
02Tim can’t find accessible maps or audio announcements to help him. He tries to call his daughter, but she’s in a meeting. He gets more frustrated trying to find his way to the Shinkansen.
Tim Warren scenario, step 3
03Tim used his AR glasses to scan and translate airport signs into English, boosting his confidence and understanding of his surroundings.
Tim Warren scenario, step 4
04Using the AR app on his glasses, Tim easily found his way to the Shinkansen platform. He was grateful for the help provided by his glasses, which made traveling to his daughter’s nearby town a breeze.

Emily, solo explorer

Emily scenario, step 1
01Emily looks lost and overwhelmed in the bustling streets of Paris.
Emily scenario, step 2
02Determined to navigate the city streets, Emily puts on her AR glasses, her expression shifting to determination as she seeks assistance from the technology.
Emily scenario, step 3
03Emily’s demeanor transforms after putting on the AR glasses. She walks with assurance, aided by the navigation arrows and comprehends the translated street signs and menus with ease.
Emily scenario, step 4
04Emily arrives at Louvre Museum. AR glasses help her explore Paris solo, transforming frustration into contentment.

David, family vacation planner

David scenario, step 1
01David and his family are at the airport entrance with their luggage. They put on AR glasses to start their vacation as the terminal is busy with travellers rushing to their gates.
David scenario, step 2
02David and his family use AR glasses to find their way to the gate. The glasses highlight landmarks and points of interest, making navigation easier in the busy airport terminal.
David scenario, step 3
03David’s family arrived at the check-in counter and put on AR glasses to navigate the process. Friendly staff helped with their luggage before they headed to the gate.
David scenario, step 4
04With AR glasses, the family easily understands airport announcements and signs in their native language. They feel relaxed and ready to board their flight for their annual vacation adventure.

Each persona was storyboarded through a real journey, four frames from the moment the trip starts to the moment it is done.

Storyboarding before any interface design is what surfaced the gate-change alert, the baggage hand-off and the moment a traveller needs translation while both hands are full.

Proposed solution

From a broad concept to a mapped system.

Mapping the space

Mind map, AR/VR interface for translation and navigation
Translation and navigation
Mind map, IoT data for the AR/VR interface
IoT data, the interface
Mind map, IoT data for the AR/VR project
IoT data, the project

We began by mapping the whole opportunity space, AR/VR for translation and navigation, and the IoT data that would feed it, before narrowing to the features worth building.

Three maps took the idea apart in turn: what the interface itself needs, the IoT data behind that interface, and the IoT data behind the project as a whole.

Information architecture and flows

NAVLINGO information architecture, IoT data feeding navigation, translation, baggage, parking and notifications

We mapped how IoT, navigation, translation and airport services connect across the AR, mobile and watch surfaces, then defined the core journeys.

Six domains hang off the one hub, and each carries its own capabilities and the software and hardware behind them. Everything the interface shows traces back to a source on this sheet.

Five core flows

Five journeys came out of that map, each one drawn end to end before any interface design started.

User flow, Live translation

01

Live translation

Choose language

From is auto-detected, To is selected

Display live translation

User flow, Sign translation, outdoor

02

Sign translation, outdoor

Choose preference

From: auto detect

Display live translation

User flow, Airport navigation, indoor

03

Airport navigation, indoor

Scan your boarding pass

Retrieved information: gate, luggage, flight timings, drop-off location

Navigation, with notifications pushed alongside

Destination

User flow, Airport translation, indoor

04

Airport translation, indoor

Turn on translation

Sign in, or go straight to live

From is auto-detected, To is selected

Display live translation

User flow, Outdoor navigation

05

Outdoor navigation

Enter destination

Follow directions, with notifications pushed alongside

Destination

From hand-drawn sketches to spatial concepts

Hand-drawn navigation ideation sketches
Navigation
Hand-drawn translation ideation sketches
Translation
Hand-drawn sketches for additional features
Additional features

Navigation, translation and supporting features were sketched by hand before any pixels. Each sheet runs the same scenario twice, once on a phone and once through AR glasses.

That comparison settled the concept. On a phone every one of these tasks means looking down in a crowded terminal, while through the glasses the same information sits in the field of view. The third sheet is where baggage tracking, parking and ticket scanning first appeared, and all three made it into the build.

Spatial design system

A calm, accessible system built for the eye.

Four decisions shaped the whole interface, then five spatial screens put them to work.

Electric Purple

Brand & active path

Success Green

On-time · confirmed

Warning Amber

Closing soon · delay

Error Red

Gate change · overweight

Void Dark

Spatial UI backdrop

01

Colour and type

One accent, the rest reserved for status. A dark, low-vividness scheme minimises glare and keeps AR objects legible.

Every colour passes WCAG AA and was checked for colour-blindness.

Inter, for legibility and multi-weight hierarchy across 13-28px spatial sizes.

Eye-gaze comfort zone diagram, gaze angles -6 and -27 degrees, distances 2.25-2.5m
AR comfort-zone overlay mapped onto an airport corridor
AR comfort-zone overlay, a second corridor view
02

Comfort zone

Horizon at +6°, gaze angles −6° and −27°, reading distance 2.25-2.5m. Mapped onto real corridors so key UI stays within a relaxed gaze range.

2.5.1 · AHands-free voice & eye-gaze alternative controls
1.4.3 · AAContrast ratio > 4.5:1 across all text overlays
2.4.1 · ASkip repetitive airport navigation blocks
1.2.2 · AReal-time captions for all audio announcements
3.3.2 · AClear, unambiguous spatial labels
2.5.5 · AATarget size ≥ 44×44px (60px spatial target)
03

Accessibility, WCAG 2.1 AA

Six success criteria were designed against from the start, not retrofitted, from hands-free control through to a minimum spatial target size.

Hover dwell (300ms)
Rounded target shapes
Spatial target sizing
04

Eye-gaze principles

Hover dwell (300ms). Elements highlight once the gaze rests on them for 300ms, confirming intent before activation.

Rounded target shapes. Rounded hit shapes reduce eye-tracking jitter and prevent accidental activations (per Apple visionOS guidelines).

Spatial target sizing. A 44px visual target with a 60px invisible hit region (8 + 44 + 8) accommodates natural gaze wobble.

Dynamic scale. Targets grow as the user moves away and shrink up close, so everything stays comfortably tappable at any distance.

High-fidelity interfaces

Five spatial interfaces, navigation & translation, live sign translation, baggage drop-off, smart parking and outdoor directions.

Hi-fi feature, indoor and outdoor AR navigation with real-time directions
Indoor / outdoor navigation
Hi-fi feature, eye-gaze navigation and live translation
Navigation & translation
Hi-fi feature, real-time speech and announcement translation
Live translation
Hi-fi feature, multi-layer smart parking availability
Smart parking
Hi-fi feature, smart baggage drop-off, alerts and tracking
Baggage drop-off & pickup
Usability testing and validation

Validated with Google Cardboard + Draft XR.

How we tested

We prototyped in Figma with Draft XR and tested on Google Cardboard with 10 users (aged 18-45, 50% with prior AR familiarity), running heuristic evaluation, scenario testing and a post-test survey and interview.

Participant testing NAVLINGO on a Google Cardboard headset
Testing on Google Cardboard.
Usability testing setup, participant wearing the headset
The session setup.
AR prototype screen 1 shown to participants during testing
AR prototype screen 2 shown to participants during testing
AR prototype screen 3 shown to participants during testing
AR prototype screen 4 shown to participants during testing

Which features impressed testers most

Post-test survey, features participants found most impressive (multiple selection).

Survey results

The full post-test survey, overall satisfaction, navigation, translation accuracy, feature preference and travel frequency.

Post-test survey chart 1
Post-test survey chart 2
Post-test survey chart 3
Post-test survey chart 4
Post-test survey chart 5
Post-test survey chart 6
Post-test survey chart 7

Key findings

01

Navigation satisfaction

90% of participants rated the AR navigation flow intuitive and effective, the strongest-performing feature.

02

Overlay contrast

In bright sunlight, translated text needed darker backing panels to stay legible.

03

Eye-gaze calibration

Two participants needed manual re-calibration; gaze alignment must be more forgiving out of the box.

04

Visual clutter

Dense signage caused overlapping text, solved by filtering translation targets by gaze dwell.

05

Dynamic font scale

Text under 14px was hard to read at distance; a 16px minimum spatial-text rule was established.

Reflections

What worked, and what we’d change.

A concept taken as far as Google Cardboard and Draft XR would carry it.

What worked

Accessibility-first design improved spatial UI clarity for everyone, not just low-vision users

Hands-free eye-gaze control proved ideal for travellers carrying luggage

Google Cardboard + Draft XR enabled rapid validation without multi-thousand-pound hardware

What we’d change

Test with native speakers across 10+ languages

Deploy on HoloLens 2 / Apple Vision Pro for true optical pass-through testing

Add adaptive contrast backing driven by ambient-light sensors

Sources and standards

  • Apple (2024). Apple Vision Pro. apple.com/apple-vision-pro.
  • Apple. Designing for visionOS, Human Interface Guidelines. developer.apple.com.
  • Meta. Meta Quest Pro. meta.com/quest/quest-pro.
  • Microsoft (2019). Microsoft HoloLens, Mixed Reality Technology for Business.
  • Behnam, S. & Budiu, R. (2022). The Usability of Augmented Reality. Nielsen Norman Group.
  • Riegler, A., Riener, A. & Holzmann, C. (2021). Augmented Reality for Future Mobility: Insights from a Literature Review and HCI Workshop. i-com, 20(3), 295-318.
  • Medeiros, D., McGill, M., Ng, A., et al. (2022). From Shielding to Avoidance: Passenger AR and the Layout of Virtual Displays. IEEE TVCG, 28(11), 3640-3650.
  • Abu Doush, I., Alshatnawi, S., Al-Tamimi, A.-K., et al. (2016). ISAB: Integrated Indoor Navigation System for the Blind. Interacting with Computers.
  • Samha, A. K., Alghamdi, N., Albader, H., et al. (2020). Applied Internet of Things in Saudi Arabia Airports. ICENCO 2020.
  • Chung, J., Pagnini, F. & Langer, E. (2016). Mindful navigation for pedestrians: Improving engagement with augmented reality. Technology in Society, 45, 29-33.
About→Work→Blog→Resources→Contact→
(Studio Details)
Working remotely, worldwide.
Booking select projects for Q3 ’26.
(Socials)
Local time -Back to top ↑©2026 Tamkeen Kiani
TAMKEEN°『 Research. Design. Build. 』
Cookies

I use Google Analytics to see which pages are useful, so I can improve the site. Nothing is used for advertising or sold. See the privacy policy.