Device Interface#
Supported Devices#
Isaac Teleop supports multiple XR headsets and tracking peripherals. Each device provides different input modes, which determine which retargeters and control schemes are available.
Device |
Input Modes |
Client / Connection |
Notes |
|---|---|---|---|
Apple Vision Pro |
Hand tracking (26 joints), spatial controllers |
Isaac XR Teleop Sample Client (visionOS app) |
Build from source; see Build from Source |
Meta Quest 3 |
Motion controllers (triggers, thumbsticks, squeeze), hand tracking |
Isaac Teleop Web Client (browser) |
|
Pico 4 Ultra |
Motion controllers, hand tracking |
Isaac Teleop Web Client (browser) |
Requires Pico OS 15.4.4U+; must use HTTPS mode |
Manus Gloves |
High-fidelity finger tracking (Manus SDK) |
Manus Gloves Plugin (CLI tool) |
See Build from Source for installation instructions. |
Logitech Rudder Pedals |
3-axis foot pedal |
Generic 3-axis Pedal Plugin (CLI tool) |
See Build from Source for installation instructions. |
Add a New Device#
- Isaac Teleop plugin (C++ level)
For new hardware that requires a custom driver or SDK. Plugins push data via OpenXR tensor collections. Existing plugins include Manus gloves, OAK-D camera, controller synthetic hands, and foot pedals. After creating the plugin, update the retargeting pipeline config to consume data from the new plugin’s source node.
See the Plugins directory for examples.