Repository navigation
examples(teleop): package under isaaccapture_examples #1374
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
4 commits
Select commit
Hold shift + click to select a range
fe49f6b
examples(teleop): package under isaaccapture_examples
jiwenc-nv d7d0523
examples(teleop): fix what the package move left behind
ivany-nv 995f014
examples(teleop): name both install paths; fail fast without ui
ivany-nv 342b756
Merge remote-tracking branch 'origin/main' into ivany-nv/examples-teleop
ivany-nv File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file was deleted.
Oops, something went wrong.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,55 @@ | ||
| <!-- | ||
| SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | ||
| SPDX-License-Identifier: Apache-2.0 | ||
| --> | ||
|
|
||
| # Teleop Examples | ||
|
|
||
| Each example reads hands, controllers or a device through `TeleopSession` and | ||
| prints the result; most retarget it first. Each connects through CloudXR and | ||
| starts the runtime itself if none is serving. | ||
|
|
||
| Install `isaaccapture` into the active environment first: from your source | ||
| build as in [Running an example](../README.md#running-an-example), or from the | ||
| package index as in the | ||
| [Quick Start](https://nvidia.github.io/IsaacCapture/main/teleop/quick_start.html). | ||
| Then install this example from the repository root: | ||
|
|
||
| ```bash | ||
| uv pip install -e ./examples/teleop | ||
| python -m isaaccapture_examples.teleop.gripper_retargeting_example_simple | ||
| ``` | ||
|
|
||
| Every module runs the same way, as | ||
| `python -m isaaccapture_examples.teleop.<module>`; `--help` lists its options. | ||
|
|
||
| | Module | What it shows | | ||
| | --- | --- | | ||
| | `gripper_retargeting_example_simple` | Controller trigger to gripper command, with the minimal `TeleopSession` setup. | | ||
| | `gripper_retargeting_example` | A hand-built gripper and end-effector graph combined into one action. | | ||
| | `isaac_lab_gripper_example` | Thumb-index pinch to gripper command (hand tracking). | | ||
| | `se3_retargeting_example` | Hand or controller pose to an absolute or relative end-effector pose. | | ||
| | `dex_bimanual_example` | Both hands to robot hand joints, with one `DexHandRetargeter` per hand. | | ||
| | `full_bimanual_reordering_example` | Arms and hands flattened into one Isaac Lab action tensor. | | ||
| | `g1_trihand_retargeting_example` | Motion controllers to G1 three-finger hand joints. | | ||
| | `locomotion_retargeting_example` | Controller sticks to robot base commands. | | ||
| | `foot_pedal_locomotion_example` | A 3-axis foot pedal to robot base commands. | | ||
| | `joint_space_device_example` | An SO-101 leader arm to an Isaac Lab action. | | ||
| | `gamepad_printer_example` | Gamepad axes and buttons, and what the gamepad retargeters make of them. | | ||
| | `spacemouse_printer_example` | SpaceMouse axes and buttons. | | ||
| | `keyboard_printer_example` | Keys from a small GLFW window. | | ||
| | `keyboard_terminal_example` | Keys from the terminal, with no window. | | ||
|
|
||
| The bimanual examples default to the dex-retargeting YAML and URDF files in | ||
| [`config/dex_retargeting/`](python/isaaccapture_examples/teleop/config/dex_retargeting/), | ||
| which install with the package. Their `--enable-tuning` window needs ImGui from | ||
| the `ui` extra. Of the supported Pythons, `imgui` 2.0.0 has wheels only for | ||
| 3.11: on 3.12 it builds from source and needs a C++ toolchain, and on 3.13 it | ||
| does not build at all: | ||
|
|
||
| ```bash | ||
| uv pip install -e './examples/teleop[ui]' | ||
| ``` | ||
|
|
||
| The retargeters these examples use are documented in | ||
| [Retargeting](https://nvidia.github.io/IsaacCapture/main/references/retargeting/index.html). |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,32 @@ | ||
| # SPDX-FileCopyrightText: Copyright (c) 2025-2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | ||
| # SPDX-License-Identifier: Apache-2.0 | ||
|
|
||
| [build-system] | ||
| requires = ["hatchling"] | ||
| build-backend = "hatchling.build" | ||
|
|
||
| [project] | ||
| # The dist name mirrors the import path, so an installed example claims no bare | ||
| # top-level name in site-packages. | ||
| name = "isaaccapture-examples-teleop" | ||
| version = "0.1.0" | ||
| description = "Isaac Teleop Retargeting Examples" | ||
| requires-python = ">=3.11,<3.14" | ||
| dependencies = [ | ||
| "isaaccapture[cloudxr,retargeters]", | ||
| "glfw>=2.7", # keyboard_printer_example: the window and its platform constants | ||
| ] | ||
|
|
||
| [project.optional-dependencies] | ||
| # The bimanual examples' --enable-tuning window. Optional because imgui does not | ||
| # install on every supported Python; see README.md. | ||
| ui = ["isaaccapture[ui]"] | ||
|
|
||
| # `only-include` + `sources`, not `packages`, and no __init__.py above | ||
| # teleop -- see the packaging rules in examples/README.md. | ||
| # | ||
| # config/ lives inside the package because the bimanual examples resolve it | ||
| # from __file__, so the YAML and URDF must travel with them. | ||
| [tool.hatch.build.targets.wheel] | ||
| only-include = ["python/isaaccapture_examples/teleop"] | ||
| sources = ["python"] |
2 changes: 2 additions & 0 deletions
2
examples/teleop/python/isaaccapture_examples/teleop/__init__.py
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,2 @@ | ||
| # SPDX-FileCopyrightText: Copyright (c) 2026 NVIDIA CORPORATION & AFFILIATES. All rights reserved. | ||
| # SPDX-License-Identifier: Apache-2.0 |
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
File renamed without changes.
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.