Point your phone at the street. An arrow appears on the pavement and shows you which way to walk. Point it at a broken pump on a factory floor and the repair steps sit on top of the metal, numbered in order. That is augmented reality (AR) at work, and it has been quietly doing this for years while most people still cannot explain the trick.
Here is the core of it. AR keeps the world in front of you and hangs a layer of digital information on top of it. Virtual reality (VR) throws that world away and hands you one built by a computer. That single design choice decides which technology fits your job, which one belongs in a simulator, and why one lives in your pocket while the other needs a headset.
Picture a field engineer halfway up a wind turbine. She raises a tablet and the service manual paints itself onto the gearbox: the torque values, the order of the bolts, a warning where the last inspection found wear. She does not climb down, does not open a binder, does not guess. The device looked at the machine, worked out where she was standing and placed every label in the right spot. There is a lot of engineering behind one smooth overlay.
The border between AR and VR is softer than the marketing suggests. Picture a line. Paul Milgram and Fumio Kishino mapped it in their 1994 taxonomy, the reality–virtuality continuum, and it is still the reference for ordering ideas such as mixed reality. This guide walks you through what augmented reality is, how it works under the hood, how it differs from virtual and mixed reality, which devices you can buy today, what it is used for and which limits remain. For the full head-to-head with virtual reality, the companion piece on the differences between augmented and virtual reality goes deeper.
What is augmented reality?
Augmented reality is the technology that combines the physical world with virtual elements generated by a device. It adds a layer of information to the real scene. The device captures what sits in front of it with a camera or another sensor and then places digital content that appears to occupy the same space: an arrow on the pavement, repair steps over a faulty machine, a virtual sofa in your living room.
The reference definition is Ronald Azuma’s. In his 1997 paper A Survey of Augmented Reality he set three conditions that separate AR from every other system. It combines real and virtual elements, it is interactive in real time and it is registered in three dimensions, so the virtual objects hold their position relative to the real world. Miss one of the three and you no longer have augmented reality in the strict sense. A graphic pasted on a camera feed with no spatial anchor is a plain overlay. A 3D object that ignores what you do is not interactive.
The term is attributed to Boeing researcher Tom Caudell, who is said to have coined it around 1992 in work on helper displays for manufacturing. It is no accident that AR was born in industry, because its first serious uses were operational and tied to real machines. Place it too on the reality–virtuality continuum that Paul Milgram and Fumio Kishino described in their 1994 taxonomy, where augmented and mixed reality share the ground between the fully real and the fully virtual. The whole line of work goes back to the first head-mounted displays of the 1960s, inside the wider history of computing.
How augmented reality works
Underneath an AR app there are three chained jobs: seeing the environment, knowing where you are inside it and placing the digital content in the right spot. All three run dozens of times every second, often on a phone with a tight power budget.
Cameras and sensors: the eyes of the system
The first job is to capture the world. Devices stack several sensors together: RGB cameras, an inertial measurement unit (accelerometer and gyroscope) that measures how you move and, on the most capable machines, depth sensors or LiDAR that calculate the distance to objects. From that set the system rebuilds an idea of the space around it, where the walls, floor and furniture sit and how far away they are. The richer the sensor mix, the more reliable that mental map becomes.
Tracking and SLAM: locating yourself without GPS
The heart of augmented reality is tracking, which means calculating the position and orientation of the device across six degrees of freedom, three of position and three of rotation. That is what keeps virtual content nailed in place when you move your head. The system solves it with SLAM (Simultaneous Localization and Mapping): it builds a map of the environment and, at the same time, works out where it sits inside that map, leaning on the camera and the motion sensors. The maths runs on computer-vision algorithms and probabilistic filters. Get the precision wrong and the virtual object dances, peels off the surface and gives the whole illusion away.
Anchoring, occlusion and lighting
On top of that base sit the details that make the blend believable. Anchoring fixes each virtual object to a point in the real world. Occlusion lets a physical object hide a virtual one, and the other way round. Light estimation adjusts brightness and shadows so the content does not look stuck on with tape. The better these three are solved, the less you notice the border between the real and the digital. Let one of them fail and the illusion collapses at once. An object floating above the table or glowing in a dimmed room reads as a fake from across the room.
The engines: ARKit, ARCore and open standards
Almost nobody programs SLAM from scratch, because platforms do it for you. Apple offers ARKit for iOS and visionOS. Google offers ARCore for Android and XR devices. Both handle tracking, scene understanding and anchoring. To run one experience on different headsets you have standards such as OpenXR from Khronos and WebXR from the W3C, which also lets AR run in a browser with nothing to install.
Augmented, virtual and mixed reality: the differences
People lump the three terms together, and that is where most of the confusion starts. The key difference is what happens to the real world. In augmented reality the world stays and grows. In virtual reality it is replaced completely. Mixed reality aims for the real and the virtual to live together and interact as one thing.
| Augmented reality | Mixed reality | Virtual reality | |
|---|---|---|---|
| What you see | The real world with digital layers on top | The real and the virtual combined and interacting | Only a digital environment, with the real left out |
| Role of the real world | It is the base and the camera captures it | It is the base, merged with the virtual | It is replaced completely |
| Typical hardware | Phone, tablet, glasses, passthrough headsets | Colour passthrough headsets and HoloLens | Opaque headsets, with no view of the outside |
| Tracking | 6 degrees of freedom, SLAM, anchors | 6DoF plus spatial mapping and environment meshes | 6DoF, often limited to one room |
| Examples | Pokémon Go, Google Lens, virtual try-ons | HoloLens 2 in industry, Quest MR apps | Simulators and immersive video games |
Mixed reality is the part of the continuum where the digital merges with real geometry instead of just sitting on top of it. Objects hide behind one another and rest on surfaces. In practice the border with augmented reality is fuzzy and many companies use both terms as synonyms, but mixed reality implies finer mapping of the environment. Virtual reality does the opposite: it cuts you off from everything around you.
Augmented reality devices
Three families of device matter today, and each one solves the problem its own way.
Phones and tablets
They are the widest gateway into AR. Any phone compatible with ARKit or ARCore shows augmented reality with no extra hardware, because the camera and the screen are enough. That route has taken the technology to hundreds of millions of people, though it forces you to hold the device up and look through it. Google’s own ARCore device list collects the supported models and grows with every generation.
Glasses and headsets
Here two approaches split apart. Displayless smart glasses, such as the Ray-Ban Meta, carry a camera, microphones and speakers but show no image on the lens. Glasses with a display do project information into your field of view, as in the Meta Ray-Ban Display, announced in September 2025 with a wristband that reads muscle signals to control the interface. Headsets with passthrough show video of the outside on internal screens and put AR and virtual reality in one unit, which is where HoloLens, Apple Vision Pro and Meta Quest fit. Those machines juggle a lot of data in real time and depend on efficient processors, memory and batteries, plus charging over USB-C.
Real-world examples and applications
Augmented reality is no longer a laboratory promise. It has commercial uses across several sectors, and some of them you can try this afternoon.
- Mobile and consumer. Pokémon Go (Niantic, 2016) was the big trigger, sending millions of people to hunt virtual creatures in real streets. In the same territory sit apps such as Google Lens, which identifies objects and translates text with the camera, and the virtual try-ons that lay glasses or makeup over your face.
- Industry and maintenance. Glasses let a technician see assembly instructions over the machine and share the view with a remote expert. Microsoft documents those workflows in Dynamics 365 Guides, and HoloLens 2 was the reference device in the field for years.
- Education. 3D models of anatomy, molecules or engine parts that students rotate and take apart on the desk help them grasp ideas that are hard to picture in a book.
- Retail. Seeing a sofa at full scale in your living room before you buy it cuts returns. IKEA was one of the pioneers with IKEA Place.
- Healthcare. Overlaying medical images such as scans or ultrasounds on the patient helps with surgical planning and training.
Limitations of augmented reality
The enthusiasm is real, and so are the technical obstacles that explain why you still do not wear this stuff all day.
- Field of view and ergonomics. Headsets still offer a limited viewing angle and add weight and heat to your head. Light glasses solve the weight and show almost nothing.
- Battery life. Processing video, sensor data and graphics drains the battery fast, which limits long sessions.
- Accuracy and lighting. Tracking fails on surfaces with no texture, in low light or during fast movement, and the virtual content wobbles.
- Privacy. A device with a permanent camera raises questions about what gets recorded and who can see it, a debate that already surrounded Google Glass.
- Fragmentation and cost. Each platform has its own tools and its own limits, and professional hardware is still expensive, which holds back mass deployment.
The state of augmented reality today
The sector lives with a paradox. The technology works, but the mass-market device that was meant to popularise it has not arrived. These are the pieces that matter.
In the enterprise world Microsoft has put a date on the end of an era. It stopped manufacturing HoloLens in December 2024 and will keep security updates until the end of 2027, as the official HoloLens release notes record. In the consumer market Meta has bet on glasses. Ray-Ban Meta carry a camera and audio, the Meta Ray-Ban Display adds a screen in the lens and the Orion prototype shows where the company wants to go. Apple entered in 2024 with Vision Pro, a passthrough headset that mixes AR and virtual reality and that the brand calls “spatial computing”. Google keeps ARCore as the base of the Android ecosystem and is extending it towards Android XR.
Beneath the brands the standardisation moves forward. OpenXR and WebXR let you write an experience once and run it on several devices and in the browser. That groundwork will decide whether augmented reality becomes as ordinary as a phone.
Conclusion
Augmented reality does not replace the reality in front of you. It expands it, and that nuance separates two industries. It also explains why its strongest ground today sits at work, in industry, training, healthcare and retail, more than in leisure. With cameras, sensors and SLAM finely tuned, the challenge left is a product problem: build light glasses with good battery life and a decent field of view that make it worth wearing data in front of your eyes all day.
Try it this week. Point your camera at a piece of furniture and walk around it. Watch how long the object stays put when you move. That small test tells you more about the real state of AR than any keynote.
Frequently asked questions
What is the difference between augmented reality and virtual reality?
Augmented reality keeps the real world in front of you and adds digital information on top. Virtual reality replaces your entire field of view with a computer-generated environment. In the first, the physical world is still the base and the device interprets it. In the second, everything you see is virtual.
What is SLAM and why is it important in augmented reality?
SLAM stands for Simultaneous Localization and Mapping, the technique by which the device builds a map of the environment and, at the same time, calculates where it is inside it. It is what lets a virtual object stay anchored to a point in the real world and not drift when you move your head or change position.
Do I need special glasses to use augmented reality?
No. A phone or tablet compatible with ARKit or ARCore can already deliver augmented reality using just the camera and the screen. Glasses and headsets add comfort and a more natural field of view, but they are not essential for most applications.
What is mixed reality and how does it differ from augmented reality?
Mixed reality is the point on the reality–virtuality continuum where the digital integrates with the geometry of the environment. Virtual objects hide behind real ones, rest on surfaces and respond to the space. The border with augmented reality is fuzzy and many companies use both terms as synonyms.
Does augmented reality work without an internet connection?
Many applications do, because tracking and anchoring are calculated on the device itself. Others, however, depend on the cloud to download models, sync content or use geolocation features, so without a connection they lose part of their usefulness.