Skip to content
Published on

XR / VR / AR Dev Engines 2026 — Unity XR Toolkit / Unreal 5.5 VR / A-Frame / Three.js XR / Meta XR SDK / visionOS / ARKit / ARCore / Niantic Lightship Deep Dive

Authors

The XR market in 2026 has died and come back twice. Meta Quest 3 / Quest 3S keep selling steadily, and Apple Vision Pro's second generation cut the price almost in half — so the "VR is dead" sentiment of 2023-2024 has fully dissipated. For developers, however, it is the opposite. Engines and SDKs are branching too fast, and "where do I even start" has become the hardest question.

This article maps the full XR engine landscape as of May 2026. We slice it along four axes — Unity, Unreal, Web-based, mobile AR, native SDKs, and metaverse platforms — and cover the local ecosystems in Korea and Japan.

1. The 2026 XR Engine Map — Native / Web / SDK / Platform

XR engines are hard to lump together because they live at different layers. "I want to make AR" can mean a Quest 3 build with Unity, or an Instagram filter with 8thWall. As of 2026, the cleanest split is along four axes.

  • Native game engines — Unity XR Toolkit, Unreal Engine 5.5 VR Template
  • Web-based XR — A-Frame, Three.js XR + WebXR API, Babylon.js XR, 8thWall
  • Platform SDKs — Meta XR SDK, visionOS / Reality Composer Pro, ARKit, ARCore, MRTK, Pico Neo Link, HTC Vive Wave, Niantic Lightship, Snap Lens Studio
  • Metaverse / content platforms — VRChat, Spatial.io, Microsoft Mesh, Horizon Worlds, NVIDIA Omniverse, ZEPETO, Cluster
AxisRepresentative toolsMain devicesStrengthWeakness
Native engineUnity, Unreal 5.5Quest 3, PSVR2, Vision ProPerformance / ecosystemHeavy build / CI
Web XRThree.js, Babylon.js, A-Frame, 8thWallBrowsersInstant sharingPerformance / feature limits
Platform SDKMeta XR, visionOS, ARKit, ARCoreEach deviceFull native featuresLock-in
MetaverseVRChat, Spatial.io, MeshQuest, PC, mobileUser poolContent policy lock

The rest of this article walks through each axis with its flagship engine.

2. Unity XR Toolkit — Still the Biggest Slice

More than half of XR developers in 2026 still ship Unity. More precisely, Unity 6.x with XR Interaction Toolkit (XRI) 3.x. Some studios left after the 2022-2023 Unity runtime-fee fiasco, but 35+ of the top 50 Quest Store titles are still Unity builds.

XRI is a component library that abstracts controllers, hand tracking, locomotion, and socket interactions. Without touching OpenXR directly, you can add grip interactions with a single component.

using UnityEngine;
using UnityEngine.XR.Interaction.Toolkit;

public class GrabbableCube : MonoBehaviour
{
    void Awake()
    {
        var grab = gameObject.AddComponent<XRGrabInteractable>();
        grab.movementType = XRBaseInteractable.MovementType.VelocityTracking;
        grab.throwOnDetach = true;
    }
}

Visual Scripting (formerly Bolt), bundled since Unity 2023, has also found a foothold in XR. It is useful for non-programmer designers prototyping interactions, and the Quest build performance penalty is near zero.

The downsides are clear. It is smooth on OpenXR-standard devices like Quest 3, but visionOS builds require Unity's PolySpatial package and a separate license. URP-based XR shaders also clashed with Vision Pro's Foveated Rendering throughout 2025.

3. Unreal Engine 5.5 VR Template — The AAA Standard

Unreal Engine 5.5 shipped in late 2024 with a fully rewritten VR Template. The headline is that Lumen (real-time GI) and Nanite (virtual geometry) run reasonably well in VR. Lumen is too heavy on Quest 3, but on the PCVR and PSVR2 line (Q2 2026 PC mode officially supported), Unreal keeps a clear graphical edge.

The MetaHuman pipeline becoming usable inside VR is the bigger deal. Unreal 5.5's MetaHuman Creator does not interop directly with Vision Pro's Persona, but you can polish FACS-based facial rigs in Unreal and export through USD to plug into Omniverse and Spatial.

// VRPawn.cpp — Hand-tracking entry point in the Unreal 5.5 VR Template
#include "MotionControllerComponent.h"
#include "XRMotionControllerBase.h"

void AVRPawn::SetupPlayerInputComponent(UInputComponent* PIC)
{
    Super::SetupPlayerInputComponent(PIC);
    MotionControllerLeft->SetTrackingMotionSource(IMotionController::LeftHandSourceId);
    MotionControllerRight->SetTrackingMotionSource(IMotionController::RightHandSourceId);
}

Unreal's weaknesses are build times and the licensing model. Quest 3 builds frequently take 30+ minutes the first time, and live code reload is not as smooth as Unity's. Games crossing $1M in revenue also pay a 5% royalty, so mobile indies still pick Unity.

4. A-Frame (Mozilla) — HTML-Simple

A-Frame is a WebXR framework Mozilla created in 2015, now maintained by the Supermedium team and the community. It puts a thin entity-component layer on top of Three.js so you can build VR scenes with HTML tags only.

<a-scene>
  <a-box position="-1 0.5 -3" rotation="0 45 0" color="#4CC3D9"></a-box>
  <a-sphere position="0 1.25 -5" radius="1.25" color="#EF2D5E"></a-sphere>
  <a-cylinder position="1 0.75 -3" radius="0.5" height="1.5" color="#FFC65D"></a-cylinder>
  <a-plane position="0 0 -4" rotation="-90 0 0" width="4" height="4" color="#7BC8A4"></a-plane>
  <a-sky color="#ECECEC"></a-sky>
</a-scene>

In 2026 A-Frame is still strong in education and prototyping. It auto-detects WebXR + OpenXR devices and lets you jump straight into VR mode from a browser, and Quest 3's built-in browser comfortably hits 60fps. Shader-level customization and physics remain limited, so it is unsuitable for full game development.

5. Three.js XR + WebXR API — The Most Flexible Web XR Base

If A-Frame sits at the high abstraction layer, Three.js + WebXR API is one layer below. The WebXR Device API is the W3C-standardized browser XR API from 2021, and Three.js's WebXRManager provides a higher-level API on top.

import * as THREE from 'three';
import { VRButton } from 'three/examples/jsm/webxr/VRButton.js';

const renderer = new THREE.WebGLRenderer({ antialias: true });
renderer.xr.enabled = true;
document.body.appendChild(renderer.domElement);
document.body.appendChild(VRButton.createButton(renderer));

const scene = new THREE.Scene();
const camera = new THREE.PerspectiveCamera(70, window.innerWidth / window.innerHeight, 0.1, 100);

renderer.setAnimationLoop(() => {
  renderer.render(scene, camera);
});

Three.js XR's biggest advantage is inheriting the gigantic Three.js ecosystem — GLTF loaders, OrbitControls, postprocessing, physics libs like cannon-es and rapier all just work. The downside is that you write XR-specific input, interaction, and UI patterns yourself. More than half of Three.js XR projects end up building their own abstraction layer.

6. Babylon.js XR — Microsoft-Friendly Web XR

Babylon.js is an open-source engine built by ex-Microsoft engineers and officially sponsored by Microsoft. WebXR support has been very stable since 6.x, and it follows an interaction model close to the Mixed Reality Toolkit (MRTK). The 7.x series adds partial visionOS Safari WebXR support.

import { Engine, Scene, FreeCamera, HemisphericLight, MeshBuilder, Vector3 } from '@babylonjs/core';
import { WebXRDefaultExperience } from '@babylonjs/core/XR';

const canvas = document.getElementById('renderCanvas');
const engine = new Engine(canvas, true);
const scene = new Scene(engine);

new HemisphericLight('light', new Vector3(0, 1, 0), scene);
MeshBuilder.CreateGround('ground', { width: 6, height: 6 }, scene);

const xr = await WebXRDefaultExperience.CreateAsync(scene, {
  floorMeshes: [scene.getMeshByName('ground')],
});

engine.runRenderLoop(() => scene.render());

Babylon integrates directly with Microsoft Mesh, and Babylon Playground is a powerful live coding environment. For XR widgets that run inside Microsoft Teams, it is effectively the first pick.

7. Niantic Lightship — The Pokemon GO Lineage of Geo-AR

Niantic accumulated 900M+ users with Pokemon GO, and the mobile camera, GPS, and Visual Positioning System (VPS) know-how from that journey crystallized as Lightship ARDK. Niantic also acquired 8thWall in 2022, making it the de facto standard for location-based AR.

Lightship's core features:

  • VPS — city-scale cm-level localization. Tokyo Shibuya and Seoul Gangnam are already fully covered.
  • Meshing — real-time environment mesh from just a mobile camera
  • Occlusion — hide AR characters behind real-world objects
  • Multiplayer — multiple users sharing one coordinate frame
  • Lightship Maps — map SDK on the same coordinate frame
using Niantic.Lightship.AR.VPSCoverage;
using UnityEngine;

public class LightshipVpsScanner : MonoBehaviour
{
    void Start()
    {
        var coverage = FindObjectOfType<ARLocationManager>();
        coverage.locationTrackingStateChanged += state =>
        {
            Debug.Log($"VPS tracking state: {state.TrackingState}");
        };
    }
}

As of 2026, Niantic still runs its own AR games (Peridot, Monster Hunter Now) while selling Lightship as a SaaS. If you are serious about city-scale AR, there is essentially no alternative.

8. 8thWall (Niantic Subsidiary) — The WebAR Standard

8thWall was acquired by Niantic in 2022 and now sits as the web-side counterpart to Lightship. Its pitch is "AR that runs in a browser without any app install." The same code runs on iOS Safari, Android Chrome, Quest Browser, and even Vision Pro Safari.

<script src="//cdn.8thwall.com/web/aframe/8frame-1.4.2.min.js"></script>
<script async src="//apps.8thwall.com/xrweb?appKey=YOUR_APP_KEY"></script>

<a-scene xrextras-loading xrextras-runtime-error xrweb>
  <a-entity xrextras-tap-place="objectName: cactus" position="0 0 -3"></a-entity>
  <a-entity id="cactus" gltf-model="#cactusModel" scale="0.5 0.5 0.5"></a-entity>
</a-scene>

Almost every "scan this QR code to see a character pop out of your camera" campaign from Coca-Cola, Nike, or Disney is 8thWall under the hood. The license is expensive, but for the advertising and campaign market, it is effectively the standard.

9. Snap Lens Studio — The TikTok-Style Casual AR

Snap's Lens Studio targets both Snapchat and Spectacles 5 (Snap's own AR glasses). Spectacles 5 launched as a limited-edition device in 2024, but the node-based visual scripting in Lens Studio (SnapML, SnapGraph) made huge strides in 2025-2026.

// Snap Lens Studio — Tracked Object script example
// @input SceneObject targetObject
// @input float scaleFactor = 1.0

const transform = script.targetObject.getTransform();
const baseScale = transform.getLocalScale();

script.api.update = () => {
  const t = getDeltaTime();
  const s = baseScale.uniformScale(script.scaleFactor + Math.sin(t) * 0.1);
  transform.setLocalScale(s);
};

Lens Studio's ML-powered face, body, and segmentation features are unmatched. The downside is that the output is locked inside the Snap ecosystem — though TikTok Effect Studio chases a similar model, so cross-platform campaigns targeting both are increasingly common.

10. Meta XR SDK — The Successor to Oculus SDK

What was called Oculus SDK / Oculus Integration until 2023 was rebranded to Meta XR SDK in 2024. On the Unity Asset Store it has actually been split into 7-8 packages — Meta XR Core SDK, Meta XR Interaction SDK, Meta XR Audio SDK, Meta XR Voice SDK, and so on.

Highlights include Meta XR Simulator (emulate Quest on PC), Building Blocks (drag-and-drop grip / teleport / hand tracking inside the Unity Editor), and Passthrough Camera API (access to external camera feed, beta in 2025).

using Oculus.Interaction;
using Oculus.Interaction.HandGrab;
using UnityEngine;

public class HandGrabSetup : MonoBehaviour
{
    [SerializeField] HandGrabInteractor leftHand;
    [SerializeField] HandGrabInteractor rightHand;

    void Start()
    {
        Debug.Log($"Hands ready: {leftHand.HasInteractable}, {rightHand.HasInteractable}");
    }
}

Meta XR SDK builds on top of OpenXR, so in theory it is portable to other OpenXR devices, but in practice full features only land on Quest. Paired with Unity's XRI, it produces optimal Quest builds.

11. visionOS (Apple Vision Pro)

Apple Vision Pro launched in the US in February 2024 and went global (including Korea and Japan) in July 2024. As of May 2026, Vision Pro 2 has launched as the affordable tier (around $2,000). visionOS is a macOS / iOS-derived OS, and you develop with Xcode + SwiftUI + RealityKit + ARKit.

visionOS's defining feature is the two container concepts: Bounded Volume and Immersive Space. Bounded Volume is a small 3D widget inside a window, while Immersive Space is a fully immersive VR experience taking over the entire field of view.

import SwiftUI
import RealityKit

@main
struct MyApp: App {
    var body: some Scene {
        ImmersiveSpace(id: "Galaxy") {
            RealityView { content in
                let entity = ModelEntity(mesh: .generateSphere(radius: 0.1))
                content.add(entity)
            }
        }
    }
}

To build visionOS from Unity, you need the Unity PolySpatial package separately. PolySpatial is a bridge that converts Unity components into RealityKit entities, and some shaders and particles are not compatible.

12. ARKit + ARCore — The Two Mobile AR Giants

iOS uses ARKit 7 and Android uses ARCore 1.45 (as of May 2026). Both SDKs ship similar features (plane detection, environmental lighting, face tracking, body tracking, motion capture, collaborative sessions) but the details differ.

ARKit is dominant on LiDAR-equipped iPhone Pro / iPad Pro. Scene Reconstruction immediately produces cm-level meshes via LiDAR. ARCore has bulked up its ML-based Depth API to approximate similar results on Android devices without LiDAR.

// ARKit — place a box on a plane with RealityKit
import RealityKit
import ARKit

let arView = ARView(frame: .zero)
let config = ARWorldTrackingConfiguration()
config.planeDetection = [.horizontal, .vertical]
arView.session.run(config)

let anchor = AnchorEntity(plane: .horizontal)
let box = ModelEntity(mesh: .generateBox(size: 0.1))
anchor.addChild(box)
arView.scene.addAnchor(anchor)
// ARCore — Kotlin / Jetpack Compose
import com.google.ar.core.Config
import com.google.ar.core.Session

val session = Session(context)
val config = Config(session).apply {
    planeFindingMode = Config.PlaneFindingMode.HORIZONTAL_AND_VERTICAL
    depthMode = Config.DepthMode.AUTOMATIC
}
session.configure(config)

The 2026 trend is that both SDKs grow tighter integration with OpenXR / WebXR. Google has strengthened the Geospatial API (cm-level global localization), and Apple keeps extending Object Capture (build a 3D model from 50 photos) and Room Plan API.

13. MRTK (Microsoft) / Reality Composer Pro (Apple)

MRTK (Mixed Reality Toolkit) is Microsoft's Unity-based XR interaction library originally built for Hololens 2. MRTK3 shipped as the official release in 2023 and sits on top of OpenXR, so it runs on Quest and PCVR — not just Hololens 2.

using MixedReality.Toolkit.UX;
using UnityEngine;

public class PressableExample : MonoBehaviour
{
    void Start()
    {
        var button = GetComponent<PressableButton>();
        button.OnClicked.AddListener(() => Debug.Log("MRTK3 button pressed"));
    }
}

Apple's Reality Composer Pro is the visual editor for AR content on visionOS / iOS / iPadOS. It handles SwiftUI code and USD scenes side-by-side, with a built-in Shader Graph. The Behaviors feature added in 2025 lets you wire up trigger-action flows without code, making designer collaboration smooth.

14. Hololens 2 Discontinued (October 2024) — Meaning and Fallout

Microsoft announced the official end-of-life of Hololens 2 in October 2024, and the planned Hololens 3 has been suspended indefinitely. But MRTK itself survived. Microsoft's position is that "MRTK lives on top of OpenXR, so you can keep using it on Quest and Vision Pro without Hololens." MRTK3 maintenance has continued through 2025-2026.

The reasons Hololens died are simple. Price (3,500),fieldofview(52degrees),andweight(566g)werealluncompetitiveagainstQuest3(3,500), field of view (52 degrees), and weight (566g) were all uncompetitive against Quest 3 (500, 110 degrees, 515g). Industrial use (frontline workers, military, medical) still relies on Hololens derivatives like BAE Systems' IVAS.

Pico is the VR brand under ByteDance (TikTok's parent). Pico 4 Ultra (2024) and Pico 4S (2025) compete directly with Quest 3 and hold meaningful share in mainland China, Japan, and parts of Europe. The SDK ships as Pico Unity Integration / Pico Neo Link SDK and is OpenXR-compatible.

HTC Vive's lineup includes Vive XR Elite (2023) and Vive Focus Vision (2024), with the Vive Wave SDK. Wave SDK sits on top of OpenXR with extra features (eye tracking, lip tracking), making it strong for visual novel / character interaction use cases.

NVIDIA Omniverse, strictly speaking, is not an XR device SDK but a USD-based collaboration platform. Through Omniverse Connector, it lets you live-sync USD assets between Unity, Unreal, Maya, and Blender, so it has become essential in XR content pipelines. The Omniverse XR Mode added in 2025 lets you review USD scenes directly in VR.

16. Metaverse Platforms — VRChat / Spatial.io / Microsoft Mesh / Horizon Worlds

The content platforms riding on top of engines and SDKs also stabilized by 2026.

  • VRChat — Unity SDK 3.x. 200M+ cumulative users, MAU back to 5M+. Japanese users punch above their weight.
  • Spatial.io — Originally a Unity AR collaboration tool, now ships Unity + Web builds. Has settled into a gamified workspace.
  • Microsoft Mesh — Penetrated enterprise meetings via Teams integration. Supports both Babylon.js and Unity Mesh Toolkit.
  • Horizon Worlds — Meta's metaverse. After a major UX overhaul in 2024, users have recovered. Horizon Worlds Creator SDK (formerly Presence Platform) lets you build directly.
  • NFT-free VR worlds — Mona, Resolution Games's Demeo, Within (VR video curation) — content-curation services that survived the NFT bubble and stuck around.

17. Korea — Kakao Enterprise Kakao Work, Naver ZEPETO, KAIST + ETRI XR Research

Korea has a small share of global VR / AR device sales, but it punches well above its weight in metaverse content and industrial XR.

  • Naver ZEPETO — Avatar-based metaverse. 400M+ cumulative users in 2024, strong in Southeast Asia and Latin America. External devs build worlds and split revenue via ZEPETO Studio (Unity-based).
  • Kakao Enterprise Kakao Work / Metarine — Enterprise collaboration + virtual office. More Korean-UX-friendly than Microsoft Mesh.
  • KAIST CT Graduate School + ETRI XR Lab — Strong in VR haptics, telepresence, and medical XR research. ETRI proposed a Korean-style haptics extension to OpenXR in 2024.
  • LG U+ U+VR — Korean telco-led VR content platform. Started 5G MEC-based cloud VR beta in 2025.

18. Japan — Sony PSVR2 / Bandai Namco Gundam VR / Cluster

Japan is strong in console VR (PSVR2) and IP-driven VR.

  • Sony PSVR2 — Launched in 2023, and after official PC support (DisplayPort mode) shipped in 2025 the library exploded. As of May 2026 the PSVR2 PC library has 1,500+ compatible SteamVR titles.
  • Bandai Namco Gundam VR — Runs both as a VRChat world and as a standalone VR attraction. The XR experiences linked to GUNDAM Factory in Daiba, Tokyo are essentially symbolic of Japanese VR.
  • Cluster — A homegrown Japanese metaverse platform. Unity SDK-based, and 90%+ of Japanese V-Tuber concerts are held on Cluster. Mobile-first, so the barrier to entry is low.
  • Nintendo Switch 2 (launched June 2025) does not natively support VR, but rumors of a Labo VR successor keep circulating.

19. Who Should Pick What — Scenarios

ScenarioRecommended engineWhy
Mobile AR campaign8thWall + A-FrameReach via QR code without app install
Quest 3 gameUnity + Meta XR SDK + XRIEcosystem and store access
Vision Pro appSwiftUI + RealityKit + Reality Composer ProNative performance and visionOS design
PCVR AAA gameUnreal 5.5 VR TemplateLumen/Nanite, MetaHuman
Location-based city ARNiantic Lightship + 8thWallVPS and meshing
Enterprise collaboration VRMicrosoft Mesh + Babylon.jsTeams integration
Metaverse concertVRChat or ClusterJapanese / international user pool
Fast WebXR prototypeA-FramePure HTML, ready in 30 minutes
High-performance custom WebXRThree.js + WebXR APIMaximum flexibility
Casual TikTok / Snap ARSnap Lens Studio + TikTok Effect StudioDistribution channels

Two macro rules: (1) Once the device is fixed, the engine is almost auto-decided. (2) For casual / campaign content, pick Web; for games / simulation, pick native.

20. References