Synonyms: AR, mixed reality (related), spatial computing, immersive overlay, mobile AR
Do not index
Definition
Augmented reality (AR) overlays digital content, like images, info, and 3D objects, onto the real world through a phone camera or headset. Unlike virtual reality, it keeps you in your actual surroundings and adds to them. Think previewing furniture in your living room, face filters, or navigation arrows painted onto the street.
For UX, it means designing in 3D space with the physical world as part of the canvas, which stretches normal interaction design and sits next to virtual reality.
Use cases
Ignore the real world's messiness and your AR feature works in the demo and nowhere else.
Guided instructions: Overlaying steps onto real equipment is powerful for repair or assembly, until floating panels clutter the view and hide the very thing you're working on.
Wayfinding gone wrong: AR directions that don't account for context can send someone staring at their phone into traffic. The experience has to respect the body, not just the screen.
How it's used in practice
Design for the environment: Plan for variable lighting, surfaces, space, and movement, not a fixed rectangle.
Keep UI minimal and world-anchored: Tie elements to real objects and surfaces instead of burying the scene under floating menus.
Onboard the physical action: Teach the gesture (move the phone, scan a flat surface). Users don't arrive knowing it.
Plan for failure: Handle poor tracking, low light, and no detectable surface with clear fallbacks instead of a frozen screen.
🪄
Pro-tip: AR's hardest problem is comfort and context. Arm fatigue from holding a phone up, neck strain in headsets, real-world safety, and stable tracking matter more than fidelity. Design short sessions and world-anchored UI, and answer "what do I do with my body?" before "what does it look like?"
Challenges & limitations
Hardware still caps it: Tracking drift, battery drain, field of view, and processing limits constrain what you can actually build.
The world is uncontrollable: Lighting, space, and movement vary wildly from one user to the next, so you can't assume a clean environment.
No settled patterns: AR conventions are young, so users have few learned gestures and discoverability is genuinely hard.
Commonly Used Platforms & Tools:
Apple ARKit — Apple's AR framework. Best for iPhone and iPad experiences.
Google ARCore — Google's AR platform. Best for Android.
Unity AR Foundation — a cross-platform layer over ARKit and ARCore. Best for building once for both.
