- Published on
Smart Glasses & AR 2026 — Meta Orion / Ray-Ban Meta / Vision Pro 2 / Snap Spectacles / Halliday / Xreal Deep Dive
- Authors

- Name
- Youngju Kim
- @fjvbn20031
Prologue — The September 2024 Inflection Point
The history of smart glasses is long. Google Glass (2013), Magic Leap One (2018), HoloLens 1/2 (2016/2019), Snap Spectacles 1-4 (2016-2021). Each was once a sensation, and each eventually faded. Too heavy, too expensive, too socially awkward, or too early.
September 2024 was the inflection point in that arc. At the Meta Connect 2024 stage, Mark Zuckerberg held up the Orion prototype — the first glasses that "actually looked like glasses, with a full-color AR display." At the same event, Ray-Ban Meta 2nd gen brought Meta AI in earnest: ask "Hey Meta, what is this?" and the camera-mounted assistant tells you. A week later at the Snap Partner Summit 2024, Spectacles 5 launched as a developer-only kit, and the AR Lens ecosystem opened up in earnest. That fall, Apple updated to visionOS 2 and dropped hints about a next-generation Vision Pro (commonly called Vision Pro 2): lighter, cheaper, more refined.
By spring 2026, "smart glasses" covers at least seven distinct product families: displayless AI glasses (Ray-Ban Meta, Halliday, Solos AirGo Vision, Even Realities G1), monocular HUDs (INMO Air 3, Even Realities G1 text display), binocular video see-through (Xreal One Pro, RayNeo X3 Pro), true AR waveguides (Orion prototype, Snap Spectacles 5), passthrough video headsets (Apple Vision Pro 2, Meta Quest 3S), and variants between them (Brilliant Labs Frame, ImmersedVR virtual monitors).
This post is the spring 2026 map of those seven branches, from end to end.
Chapter 1 · The 2026 AR Glasses Map — Display first / AI first / Lens first
If you draw the 2026 AR glasses market on a single map, three camps emerge.
1. Display first camp — putting pixels in your field of view IS the product. Apple Vision Pro 2 (passthrough but full-resolution 4K-class micro OLED), Meta Orion (still prototype, silicon carbide waveguides), Snap Spectacles 5 (developer dual waveguides), RayNeo X3 Pro, Xreal One Pro. The user's first expectation: "I see pixels."
2. AI first camp — display is absent or minimal; cameras, microphones, speakers, and AI carry the product. Ray-Ban Meta 2nd gen (no display, camera + Meta AI), Halliday Glasses (display exists but secondary; AI response is the lead), Solos AirGo Vision (AI + voice), some hearing-aid-style devices. The user's first expectation: "I ask about what I'm looking at and hear an answer."
3. Lens first camp — AR content (lenses, effects, games, collaboration) is the lead; display and AI sit on top. Snap Spectacles 5 Lenses, Meta Quest Horizon Worlds / Asgard's Wrath, Apple Vision Pro visionOS spatial apps, Niantic Lightship location-based AR. The user's first expectation: "we do something together in a shared space."
The boundaries blur. Ray-Ban Meta plans a HUD in the next version (rumored), Vision Pro 2 will strengthen AI, and Orion will eventually target all three at once. But when a buyer picks one product the first question — "Do I want to see pixels? Do I want to ask and hear? Do I want to play together?" — still divides these three camps.
Chapters 2-3 cover Meta (Orion, Ray-Ban), 4 Apple, 5 Snap, 6 Halliday, 7-9 the rest, 10-12 hardware/software/LLM integration, 13-14 recommendations and regional cases.
Chapter 2 · Meta Orion (2024.9 reveal) — The Prototype of True AR Glasses
September 25, 2024, the end of the Meta Connect 2024 keynote. Mark Zuckerberg held up a pair of glasses on stage. Thick black plastic frames, slightly large lenses, but clearly the shape of glasses. He wore them and manipulated menus with hand gestures while interacting with full-color virtual objects floating in his field of view. "Holy Grail," he called them. The first physical realization of what AR has been promising.
Five technical features of Orion:
First, silicon carbide (SiC) waveguides. Instead of regular glass, Meta used silicon carbide as the waveguide substrate. With an extremely high refractive index (2.6+), waveguides can be thinner while still delivering a wide field of view. Reported FoV is about 70 degrees, comparable to HoloLens 2 (~52 degrees) and Magic Leap 2 (~70 degrees). The downside is manufacturing cost: SiC wafers are expensive and hard to pattern optically.
Second, micro LED projectors. Orion uses micro LEDs rather than OLED as light sources. Micro LEDs are self-emissive per pixel and reach very high luminance (tens of thousands of nits), making them visible outdoors. Color reproduction (especially blue) is still difficult; demo attendees reported a somewhat limited palette.
Third, the wireless compute puck. To separate weight and heat from the glasses, Orion connects wirelessly to a small compute module that sits in your pocket. The glasses handle display, cameras, and input; the puck handles heavy SLAM and rendering, and connects again wirelessly to the cloud.
Fourth, the EMG wristband. The most talked-about element. Not a keyboard, controller, or voice command — an EMG band that reads the tiny electrical signals of your forearm muscles. A slight finger movement or pinch operates the menu. Five years after Meta acquired CTRL-Labs in 2019, the technology shipped.
Fifth, the glasses-like form factor. Weight reported at about 100 g (regular glasses are 25-35 g, so still heavy — but compared to HoloLens 2 at 566 g or Vision Pro at 600 g+, revolutionary). The first plausible socially wearable form factor.
Orion will not be mass-produced. Meta said so from day one: "This is an internal developer kit, not for sale." Per-unit build cost is estimated at roughly $10,000. A productized successor (Orion 2 or another codename) is most often forecast to ship around 2027 at $1,500 ~ $2,500.
But Orion's significance is bigger than its production status. The whole industry now shares one picture of what true AR glasses look like. Waveguides + micro LEDs + wireless puck + EMG band + glasses form factor. That five-element combination becomes the standard blueprint for the next five years.
Chapter 3 · Ray-Ban Meta (2nd gen) — The Mass-Produced AI Glasses
If Orion is vision, Ray-Ban Meta is reality. The fruit of the EssilorLuxottica (parent of Ray-Ban) and Meta partnership running since 2021. The 1st gen Ray-Ban Stories shipped in 2021 — a simple device with just camera, microphone, and speakers. Fall 2023 brought 2nd gen (official name Ray-Ban Meta Smart Glasses), and software updates through 2024 brought Meta AI in earnest.
As of spring 2026, the Ray-Ban Meta 2nd gen feature set:
- Camera — 12 MP front-facing. 1080p 60fps video, 3024x4032 stills. A larger sensor than 1st gen improves low-light.
- Speakers & mics — Open-ear speakers (your ears stay open) and a 5-mic beamforming array. Calls, music, and AI replies all happen on the glasses.
- Meta AI — Triggered by "Hey Meta". Answers questions about what the glasses' camera sees: "What plant is this?" "Translate this sign into English." "Recommend a vegetarian option from this menu."
- Live Translation — A formal feature since late 2024. Bidirectional real-time translation across English, Spanish, French, Italian. The speaker's words come out as translated audio through the glasses' speakers.
- Instagram / WhatsApp integration — Start a livestream by voice, reply to DMs by voice.
- Weight — About 49 g. Roughly 15 g heavier than standard Ray-Ban Wayfarers.
- Battery — About 4 hours of use; about 36 hours with the charging case.
- Price — From
$299in the US (varies with lens options).
The sales numbers are striking. EssilorLuxottica's official reporting says 2nd gen passed 1 million units in its first year, and by 2025 it was selling hundreds of thousands per quarter. For the first time, "smart glasses are a mass-produced category" — a real signal.
Three reasons for the success. First, no display. It removed the biggest social awkwardness of every prior smart glasses (visible camera through the lens, glowing LEDs). Second, the Ray-Ban brand. People wear "Ray-Ban Wayfarers" rather than "tech glasses." Third, Meta AI is actually useful. Buyers who wouldn't pay for camera + speakers alone open their wallet for "live translation."
As of spring 2026, EssilorLuxottica and Meta are working on a 3rd gen. Rumors suggest the next version adds a monocular HUD (text notifications, navigation arrows). It won't match Orion's full-color AR, but it opens a new in-between category: "AI glasses with a little display."
Chapter 4 · Apple Vision Pro 2 — The visionOS Evolution
Apple Vision Pro 1st gen shipped in the US in February 2024 at $3499. Reactions split. Praise for "a new paradigm of spatial computing" and criticism that it was "too heavy, too expensive, too short on apps" poured in at the same time. A year later in 2025, Apple announced visionOS 2 alongside the silhouette of the next-generation hardware (commonly Vision Pro 2 or the Vision family).
As of spring 2026, known/rumored features of Vision Pro 2 (or Apple Vision):
- Lighter weight — Down from about 600-650 g (strap excluded) on 1st gen to around 450 g. Heavier use of magnesium and carbon-fiber structures, with an external battery pack again.
- M5 (or M5 Pro) chipset — Main compute. R2, the successor to R1, handles camera/sensor fusion.
- Micro OLED displays — Same SONY micro OLED 4K panels per eye as 1st gen, but improved luminance and color reproduction. Around 4,000 nits peak.
- Better eye tracking — Less jitter, more natural calibration.
- visionOS 2 — More natural hand gestures, improved spatial video capture, Mac Virtual Display at 4K 60fps, more lifelike Personas.
- Price — Estimated
$2,499~$2,999, about$500~$1,000cheaper than 1st gen. Rumors of a cheaper non-Pro "Apple Vision" also persist.
visionOS's strength is consistency. The design language is familiar from iPhone, iPad, and Mac; 500,000+ App Store apps; FaceTime, Messages, Safari, and Mail run natively as spatial apps. The weakness comes from the same consistency: a high entry bar for developers outside Apple (Mac and Xcode required), and slow adoption of WebXR / OpenXR standards.
Three killer-app candidates for Vision Pro:
First, Mac Virtual Display. Wirelessly connect a Mac and project it as a huge 4K virtual monitor. Conceptually similar to ImmersedVR but Apple's own implementation, with image quality and latency optimized inside their ecosystem. For developers who travel, "one laptop + headset = three 27-inch external monitors."
Second, spatial video and photos. iPhone 15 Pro and later can capture spatial video; Vision Pro plays it back. The emotional value of watching your child's early years in 3D is real.
Third, Apple Immersive Video. Apple original content shot in 8K 180-degree stereo. NBA games, concerts, documentaries. The content pool is small but the quality is best-in-class.
As of spring 2026, Vision Pro 2 is either not yet officially launched or just launched (depending on rumors, fall 2025 or spring 2026). Following Apple's pattern, more refined, lighter, and cheaper than 1st gen — almost certain.
Chapter 5 · Snap Spectacles 5 (2024.9, dev-only) — Lens First
Snap's Spectacles have a long history. 1st gen in 2016 (yellow circle camera glasses), 2nd in 2017-2018, 3rd in 2019 (stereo cameras), 4th in 2021 (first AR, dual waveguides, for developers). Each generation evolved; each remained a small category. But Snap never quit.
On September 17, 2024, at the Snap Partner Summit, Spectacles 5 launched. Two big changes. First, fully transparent dual waveguide displays. Full-color AR at 1024x1024 per eye. FoV about 46 degrees. Display brightness about 1100 nits. Second, a developer-only subscription model. Not sold to consumers; rented to Snap AR Lens developers at $99 per month on a 12-month commitment.
Spectacles 5 specs:
- SoC — Dual Snapdragon chips (compute + display on separate processors).
- Cameras — Four cameras (two front RGB, two side mono) for SLAM and hand tracking.
- Weight — About 226 g. Closer to "chunky sunglasses" than glasses.
- Battery — About 45 minutes continuous use. AR glasses thermal and power limits show through plainly.
- OS — Snap OS. Content is built and deployed with Lens Studio 5.x.
Spectacles 5's significance is the migration of the Lens ecosystem to AR glasses in earnest. Snap's mobile camera effects (Lenses) are already a daily content category for hundreds of millions. Running them on glasses rather than phones is the Spectacles 5 vision.
// A simplified Spectacles 5 component in Lens Studio
// @input SceneObject targetObject
// @input float rotationSpeed = 90.0
function onUpdate(eventData) {
var deltaTime = eventData.getDeltaTime();
var rotation = script.targetObject.getTransform().getLocalRotation();
var deltaRotation = quat.angleAxis(
script.rotationSpeed * deltaTime * Math.PI / 180.0,
vec3.up()
);
var newRotation = rotation.multiply(deltaRotation);
script.targetObject.getTransform().setLocalRotation(newRotation);
}
var updateEvent = script.createEvent("UpdateEvent");
updateEvent.bind(onUpdate);
Lens Studio 5.x supports both JavaScript-based scripting and visual node graph editing. The biggest advantage: a workflow nearly identical to mobile-phone Lens production for Spectacles content.
Spectacles 5's limitations are clear: 45-minute battery, 226 g weight, and price-effectiveness (the developer-only subscription model means nothing to consumers). Yet within those limits, Snap is the first — and most serious — experimenter on "what content should flow on AR glasses with displays."
Chapter 6 · Halliday Glasses (CES 2025 sensation) — AI-First Minimal
The most-talked-about smart glasses at CES 2025 weren't from Meta, Apple, or Samsung. They were from a company most people had never heard of: Halliday.
Halliday Glasses' characteristics are simple.
First, weight is about 35 g. Nearly indistinguishable from regular glasses. Compared to Ray-Ban Meta at 49 g and Spectacles 5 at 226 g, this is a single-digit-class category.
Second, the concept of "Proactive AI." The AI suggests help based on context, even without the user asking. It alerts you when a scheduled meeting time approaches, automatically displays captions when you're hearing a foreign language, or shows a definition when a speaker uses an unfamiliar word.
Third, "DigiWindow," a micro display. A small display sits in the upper-right corner of the lens; glance up slightly and information appears. The concept is "look only when needed" rather than always in your central field of view. Resolution and color are limited, but heat and power draw are very low.
Fourth, price: $489. About 1/7 the cost of Vision Pro. A price ordinary people can afford.
Halliday's technical bet is "slightly-AR succeeds faster than full-AR." Putting pixels across your whole field of view is hard on waveguides, micro LEDs, heat, and power all at once. Putting a small display in the corner shrinks all those difficulties at once, and that lets you deliver the "AI assistant in your glasses" value to more people, faster.
Right after CES 2025, Halliday took pre-orders from its own site (not crowdfunding), and the first batch sold out quickly. As of spring 2026, mass-production shipments have begun, and follow-on models (larger field, longer battery) are reportedly in development.
Halliday's significance: "If Ray-Ban Meta became the standard for displayless AI glasses, Halliday is a leading candidate for the standard of minimal HUD." The two categories are adjacent but distinct. Displayless AI glasses always require an audible answer; minimal HUDs deliver short text visually. In settings where you can't listen to a voice reply (e.g., during a meeting that's already being interpreted), the difference is obvious.
Chapter 7 · RayNeo X3 Pro / Xreal One Pro — The Chinese AR Camp
The Chinese AR glasses camp has matured at a frightening pace. As of spring 2026, two companies stand out.
RayNeo (a TCL subsidiary) X3 Pro. Announced in spring 2025, it delivers full-color AR with dual micro LED displays. Weight about 76 g, FoV about 45 degrees, display luminance about 2,500 nits. Snapdragon AR1 Gen 1 chipset. Priced around $1,500. Targets both the Chinese domestic market and global developers. RayNeo's bet is "full-color AR similar to Spectacles 5, lighter and cheaper."
Xreal (formerly Nreal) One Pro. Xreal started as video glasses. The concept: two micro OLED displays in glasses, connected via USB-C to a phone, laptop, or game console as a giant virtual monitor. The 2024-2025 One Pro adds SLAM and 6DoF tracking, evolving from "virtual monitor" to "spatially anchored AR display." Weight about 87 g, 1080p+ per eye, price about $649. For about 1/5 the price of Apple Vision Pro, it delivers part of a similar "spatial display" experience.
Xreal's core value is "the cheapest doorway to spatial computing." Connect Xreal One Pro to a laptop and a huge virtual monitor floats in front of you — you can close the laptop and roam. Airplane, café, park: you carry two 27-inch monitors with you. The optional "Beam Pro" accessory serves as an Android-based compute unit, so you can use it standalone without a phone or laptop.
# Typical flow to connect Xreal One Pro on macOS
# 1) Connect the glasses to a Mac via USB-C
# 2) Launch the Xreal Nebula app
# 3) Choose "Body Anchor" or "Side View" mode
# 4) Fix virtual monitor positions via hand gestures
# 5) macOS recognizes the glasses as an external display
# Troubleshooting (when DisplayPort over USB-C is not detected)
ioreg -lw0 | grep -i "DisplayPort"
system_profiler SPDisplaysDataType
The Chinese camp's strengths are speed of mass production and price. The weaknesses are compatibility with the global software ecosystem (WebXR, OpenXR, Android XR and beyond), and security/privacy concerns in some markets.
Chapter 8 · Brilliant Labs Frame — Open-Source AR
Brilliant Labs walks a different path. Open-source hardware and software, with a hackable form factor.
Brilliant Labs Frame (2024) is a monocular AR pair: a small full-color micro OLED display on one side, a regular lens on the other. Weight about 39 g, price $349. Two core differentiators.
First, MicroPython. You can run MicroPython on the glasses themselves. Developers upload code over Bluetooth (no USB-C needed) and run small apps directly on the glasses. ESP32 SoC inside.
# Brilliant Labs Frame MicroPython example (simplified)
import display
import camera
import microphone
# Show text in the field of view
display.text("Hello, AR!", 100, 100, color=(255, 255, 255))
display.show()
# Capture a photo
photo = camera.capture()
# Record audio
audio = microphone.record(seconds=3)
Second, swappable AI backends. By default it connects to Brilliant's cloud (an assistant called Noa), but users can freely switch to OpenAI, Anthropic Claude, Perplexity, or others. The microphone captures voice on the glasses; the audio goes to your chosen LLM API; the answer appears as text on the display or comes out of the speaker.
Brilliant Labs' bet is "hackable platforms win in the end." The assumption: more innovation comes from the Raspberry Pi model than from the iPhone's closed model. Production scale is small, but the developer community is intensely loyal. The frameOS GitHub repo is active, and user-built apps (live translation, navigation, ChatGPT client, meeting summary) grow weekly.
In fall 2025, Brilliant Labs also revealed the next-gen Halo (official launch planned for mid-2026): binocular display, longer battery, and the same Frame-style open spirit.
Chapter 9 · Even Realities G1 / Solos AirGo Vision / INMO Air 3
Even Realities G1. A China/Hong Kong-based brand, announced fall 2024. The core is "a minimal design that actually looks like glasses" plus a monocular text HUD. Weight about 44 g, price $599. The display isn't full-color — only monochrome micro LED text. Navigation arrows, notifications, short conversation captions. By not attempting full AR, it earned a socially natural design. A category close to Halliday's, but Even Realities leans harder on fashion (many colors, varied frame shapes).
Solos AirGo Vision. Solos began as cycling-focused smart glasses. In 2024 it announced AirGo Vision with AI built in, and full sales began in 2025. Weight about 35 g. No display (fully displayless). Connects to ChatGPT or other LLMs to answer questions about what the camera sees. Price about $249. Ray-Ban Meta's direct competitor, with a price advantage.
INMO Air 3. A monocular AR pair from China's INMO. A small full-color display sits above the right lens (similar position to Halliday's DigiWindow). Custom Android-based OS, custom app store. Mainly targets the Chinese domestic market. Price about $300. Low recognition outside China, but feature-rich for the price.
These three models are variants of the "mass-produced AI / simple HUD" category. They split along display shape (fully absent vs. corner HUD vs. monocular full-color), price range ($249 ~ $599), and design philosophy (fitness vs. minimalist vs. value-for-money).
Chapter 10 · Hardware — Micro OLED / Waveguides / GaAs Lasers / Neural Displays
AR glasses hardware is the sum of five building blocks.
1. Display panels.
- Micro OLED — Sony is the lead supplier. Apple Vision Pro, Xreal, some RayNeo. Resolution and color are good; outdoor luminance and power efficiency are weak.
- Micro LED — Meta Orion adopted these. Very high luminance and good power efficiency. Color reproduction (especially blue) and manufacturing cost are the weaknesses.
- LCoS (Liquid Crystal on Silicon) — Used by HoloLens 1/2. Resolution and color lag OLED; luminance is good.
2. Optical systems.
- Diffractive waveguides — HoloLens, Magic Leap, Snap Spectacles 5, RayNeo. Thin and light but inefficient (most light is lost).
- Reflective waveguides — Lumus is the main vendor. Efficient but hard to manufacture.
- Birdbath — Used by Xreal. Cheap with a good FoV, but makes the glasses thick.
- Freeform combiners — Used by Magic Leap 1.
3. SoC and compute.
- Qualcomm Snapdragon AR/XR series — The de facto standard for nearly all Android-based AR glasses. AR1 Gen 1, XR2 Gen 2.
- Apple M series — Vision Pro only.
- Meta custom SoC + Qualcomm — Orion runs a custom SoC paired with a wireless puck.
4. Sensors.
- Cameras — RGB (external vision), mono (SLAM), infrared (eye tracking), depth (ToF or structured light).
- IMU — Orientation and acceleration.
- Mic arrays — Beamforming and noise reduction.
- Eye tracking — Gaze position, pupil size, blink detection.
5. Input.
- Voice — The baseline on nearly every pair.
- Hand tracking — Camera-based (Vision Pro, Spectacles 5).
- EMG wristband — Meta Orion's differentiator.
- Touch surface — A small touchpad on the temple (Ray-Ban Meta).
- Gaze + pinch — Apple Vision Pro's main input.
6. Emerging display tech.
- GaAs laser beam-scanning displays — Small gallium arsenide (GaAs) lasers scanned by MEMS mirrors to draw images directly on the retina. Big wins in weight and power, but not yet in volume production.
- Neural displays — Meta research stage. The concept of sending signals directly into the user's visual system (still lab-stage).
Chapter 11 · Software — visionOS / Lens Studio / Meta XR SDK / WebXR / OpenXR
The AR glasses software stack is easiest to grasp as five layers.
1. OS and runtime.
- visionOS (Apple) — Vision Pro only. Swift + Xcode. RealityKit is the main 3D framework.
- Snap OS — Spectacles 5 only. Runs Lenses built in Lens Studio.
- Horizon OS (Meta) — The Quest line. Likely to also host an Orion successor down the road.
- Android XR — Google revealed it in December 2024. Samsung Galaxy Glasses (codename Moohan) and others are slated to adopt it.
2. 3D/spatial SDKs.
- RealityKit / ARKit — The Apple camp.
- Unity + AR Foundation — The cross-platform standard.
- Unreal Engine 5.x — When you need high-quality rendering.
- Meta XR SDK — Quest and Horizon OS.
- Snap Lens Studio — Spectacles and mobile Lens unified.
3. Standard APIs.
- OpenXR — Khronos's cross-vendor XR API. Quest, HoloLens, SteamVR, Vive support it. Apple only partially.
- WebXR — W3C standard. AR/VR in the browser. Chrome, Edge, Samsung Internet support it; Safari supports it partially on visionOS.
- OpenUSD (Universal Scene Description) — Pixar's 3D scene standard. Apple has adopted it as visionOS's core asset format.
// Basic WebXR — start an AR session in the browser
async function startAR() {
if (!navigator.xr) {
alert("WebXR not supported");
return;
}
const supported = await navigator.xr.isSessionSupported("immersive-ar");
if (!supported) {
alert("Immersive AR not supported");
return;
}
const session = await navigator.xr.requestSession("immersive-ar", {
requiredFeatures: ["hit-test", "local-floor"],
optionalFeatures: ["dom-overlay"]
});
const canvas = document.createElement("canvas");
const gl = canvas.getContext("webgl2", { xrCompatible: true });
await gl.makeXRCompatible();
const layer = new XRWebGLLayer(session, gl);
session.updateRenderState({ baseLayer: layer });
const refSpace = await session.requestReferenceSpace("local-floor");
session.requestAnimationFrame(function onFrame(t, frame) {
// Rendering logic
session.requestAnimationFrame(onFrame);
});
}
4. Location-based AR / cloud anchors.
- Niantic Lightship — The Pokemon GO company. Location-based AR and visual positioning (VPS).
- Google ARCore Geospatial — A global coordinate system built on Google Maps data.
- Meta Spatial Anchors — Spatial anchoring inside Quest.
- Apple Object Capture / Room Plan — Spatial scanning on Vision Pro.
5. Web / no-code AR.
- 8thWall (acquired by Niantic) — AR in a web browser. Open a URL to launch AR.
- Lens Studio web preview — Simulate Spectacles content in a phone browser.
The big picture of standardization is OpenXR + WebXR + OpenUSD. Apple has firmly adopted OpenUSD — one foot in the standards camp — but it still sits inside its own silo on OpenXR and WebXR.
Chapter 12 · LLM + AR — Live Translation / Q&A / Navigation
Between 2024 and 2026, the fastest-evolving thing in AR glasses wasn't displays or waveguides. It was LLM integration.
Live translation. Ray-Ban Meta brought it to mass-produced glasses first. The other person speaks in English; you hear it in Spanish inside the glasses immediately. The model stack: Meta's speech recognition (Wav2Vec successor) + translation (NLLB family) + speech synthesis (Voicebox or successor). Latency about 1-3 seconds.
# Live translation pipeline (conceptual)
class LiveTranslationPipeline:
def __init__(self, source_lang, target_lang):
self.asr = SpeechRecognizer(source_lang)
self.translator = NMTModel(source_lang, target_lang)
self.tts = TextToSpeech(target_lang)
def process_audio_chunk(self, audio_chunk):
text = self.asr.transcribe(audio_chunk)
if not text:
return None
translated = self.translator.translate(text)
audio_out = self.tts.synthesize(translated)
return audio_out
Visual Q&A. The "Hey Meta, what is this?" flow. The user triggers a wake word; the glasses' camera snaps one photo and sends it to the cloud; a multimodal LLM in the cloud (GPT-4o, Claude, Gemini, Meta's Llama 4 vision) sees the photo and produces an answer. The answer comes back as text, gets converted via TTS, and plays through the speaker. Latency about 2-5 seconds.
Proactive AI. Halliday's headline concept. The AI suggests help based on context, even without the user asking. It pops up a definition when the speaker uses an unfamiliar word, displays captions when a foreign language is heard, alerts you when a scheduled meeting time is approaching. Technically it is a combination of always-on microphone + always-on camera + a light local model + a cloud LLM when needed.
AR navigation. Google Maps Live View and Apple Maps Look Around already do this on mobile. On AR glasses, arrows float in your field of view and rotate with your facing direction. The downsides are GPS accuracy and visual positioning limits — in urban canyons (between buildings) where GPS errors are large, VPS (Visual Positioning Service) is needed.
Memory / summarization. A concept where the glasses see and hear your whole day, and summarize it in the evening. Privacy concerns are the biggest issue, and it isn't yet aggressively adopted in shipping products. Brilliant Labs' community apps are experimenting with parts of it.
The biggest bottleneck in LLM + AR integration is latency. From glasses to cloud round-trip plus inference, an answer needs to arrive within 3 seconds to feel natural. To get there, (1) the share of small models running locally is growing (Llama 3.2 1B, Phi-3 mini), and (2) low-latency transport over 5G / Wi-Fi 6E matters more. Typical latency as of spring 2026 is about 2-3 seconds. By around 2028, sub-1-second is the target.
Chapter 13 · Who Should Choose What — Developers / Consumers / Designers / Enterprise
| User | Recommendation | Why |
|---|---|---|
| Developer building AR apps | Snap Spectacles 5 (dev sub) + Brilliant Labs Frame | Full AR waveguides + open-source hackable |
| Apple developer building on Vision Pro | Apple Vision Pro 1 or 2 | visionOS, RealityKit, OpenUSD |
| Meta ecosystem developer | Meta Quest 3 + wait for Orion successor | Horizon OS, Meta XR SDK |
| Consumer (happy without a display) | Ray-Ban Meta 2nd gen or Solos AirGo Vision | Mass-production maturity, price, social naturalness |
| Consumer (needs a small HUD) | Halliday Glasses or Even Realities G1 | Minimal display, light weight |
| Fashion-first | Even Realities G1 or Ray-Ban Meta | Looks like glasses |
| Big monitor on planes / in cafés | Xreal One Pro | Connects to laptop, reasonable price |
| Spatial video / concerts / movies first | Apple Vision Pro 2 | 8K 180-degree immersive content |
| Enterprise training / remote support | HoloLens (still), Vision Pro, Magic Leap 2 | Mass production, ISV ecosystem, security certifications |
| Location-based AR games | Phone + Niantic Lightship (for now) | Mass-produced AR glasses still weak on location |
The principles:
First, "the first AR glasses purchase always brings disappointment." The AR you've seen in movies — full-color information across the whole field of view, controlled naturally by hand — isn't delivered fully by any mass-produced product in spring 2026. The closest is Apple Vision Pro 2, but it's passthrough. True see-through AR begins only after an Orion successor ships in 2027-2028.
Second, "the first AR glasses purchase is decided by form factor." Above 100 g it's hard to wear for more than an hour. If the design is awkward you can't wear it to a café. So "can I wear this for over an hour every day?" is the most important question.
Third, "the ROI of AR glasses comes from LLM integration." As a device that just shows video, the price-performance is poor. The moment LLM-based features like live translation, visual Q&A, navigation, and meeting summary enter daily life, the price-performance changes.
Chapter 14 · Korea / Japan AR Cases
Korea's AR glasses.
- Samsung Galaxy Glasses (codename Moohan). When Google revealed Android XR in December 2024, Samsung was named the headset partner. Seen as a direct Vision Pro competitor; release targeted between 2025 and 2026. The official name may differ at launch (candidates include Galaxy XR, Galaxy Glasses).
- LG's XR collaboration. Meta and LG announced a headset partnership in 2024 — LG's display/manufacturing strengths plus Meta's OS/SDK. Expected to bear fruit after 2025.
- Korean AR app cases. Kakao's location-based AR events, Naver's AR shopping experiments, KT and SKT's AR content packages from the telecoms. As device penetration grows, content can grow with it.
Japan's AR glasses.
- Sony SmartEyeglass (2014-2017). An early start that never reached mass production. But Sony's micro OLED remains the panel supplier behind nearly every pair today. Bigger impact as a components supplier than as a device maker.
- EPSON Moverio series. A long-standing brand of industrial/enterprise AR glasses. Work instructions on production lines; diagnostic assistance in medical sites. More B2B-focused than mass consumer.
- Niantic's Japan market. Pokemon GO's home (Nintendo IP + Japanese users). Japan is very active in location-based AR.
- Magic Leap in Japan. Industrial AR partnerships growing with Japanese automotive and heavy industry.
Two common features between Korea and Japan. First, few firms make whole devices themselves, but in the supply chain (Sony displays, Samsung's next-gen micro OLED, LG panels) they are central. Second, on content they have strong assets — games (Nintendo, Sony), comics and animation (IP licensing), K-pop concert AR. When mass-produced AR glasses scale through 2027-2028, Korea and Japan will hold large shares on both components and content.
Epilogue — The Next Two Years
The simplest map of the AR glasses industry's next two years, as of spring 2026:
- Late 2026 — Apple Vision Pro 2 (or a cheaper Apple Vision) ships. Possible Ray-Ban Meta 3rd gen (adding a minimal HUD). Samsung Galaxy XR/Glasses launches.
- 2027 — Snap Spectacles 6 or a consumer variant, Halliday successors, Xreal Two announcements. The last prototype before Orion's productized form.
- 2028 — Mass-produced Meta Orion (codename TBD) ships. Binocular full-color AR glasses arrive at
$1,500~$2,500. Apple also announces a see-through AR headset or glasses form factor.
Across those three years we watch two things together. First, the productization of AI glasses (displayless or minimal + LLM). What Ray-Ban Meta started moves from 1 million to 10 million to 100 million units. Second, the start of true AR glasses (full-color see-through). The Orion successor's arrival in 2027-2028 is the real inflection.
In between, one question keeps hanging. "Will display-bearing glasses be socially accepted?" Google Glass couldn't answer it in 2013. Ray-Ban Meta sidestepped it by removing the display. Orion will hit the question head-on with full AR. The answer arrives around 2028.
References
- Meta — Orion AR Glasses Reveal — https://about.fb.com/news/2024/09/introducing-orion-our-first-true-augmented-reality-glasses/
- Meta — Ray-Ban Meta Smart Glasses — https://www.meta.com/smart-glasses/
- Apple — Vision Pro — https://www.apple.com/apple-vision-pro/
- Apple — visionOS Developer — https://developer.apple.com/visionos/
- Snap — Spectacles 5 — https://www.spectacles.com/
- Snap — Lens Studio — https://ar.snap.com/lens-studio
- Halliday — Halliday Glasses — https://www.halliday.xyz/
- RayNeo — X3 Pro — https://www.rayneo.com/
- Xreal — One Pro — https://www.xreal.com/
- Brilliant Labs — Frame — https://brilliant.xyz/
- Even Realities — G1 — https://www.evenrealities.com/
- Solos — AirGo Vision — https://solosglasses.com/
- Khronos — OpenXR — https://www.khronos.org/openxr/
- W3C — WebXR Device API — https://www.w3.org/TR/webxr/
- Niantic — Lightship — https://lightship.dev/
- 8thWall — https://www.8thwall.com/
- Google — Android XR — https://developers.google.com/xr
- Pixar — OpenUSD — https://openusd.org/