A Unity package that enables real-time computer vision operations on Meta Quest headsets using the Passthrough Camera API (PCA) with WebRTC streaming to external servers for AI inference.

3D reconstruction from Meta Quest passthrough and depth via Reality Capture app, with Open3D/TSDF, COLMAP/Nerfstudio export, and Gaussian Splatting prep.

A Unity package to use the new Meta Quest Passthrough Camera API.

The world's first passthrough API for Vision Pro

Demonstrates how to use Unity Inference Engine and YOLO11 to perform image segmentation using the Meta Quest Passthrough Camera

Real-time 3D room reconstruction on Meta Quest 3. GPU TSDF integration, GPU Surface Nets meshing, passthrough camera texturing, on-device texture refinement (xatlas UV unwrap + compute shader atlas baking), Gaussian Splat training & rendering, and package-based multi-scan persistence with OVRSpatialAnchor relocation. Unity 6 URP package.

This project uses XR interaction and modern segmentation models to generate real-time “stickers” and object descriptions from controller-defined regions on the Meta Quest 3.

Record Passthrough camera frames from Meta Quest 3 devices and save as video (.mp4) on the device.