Skip to content

Integrate native SuperMimic G1 motion and velocity training - #8826

Draft
ooctipus wants to merge 18 commits into
isaac-sim:mainfrom
ooctipus:feat/native-supermimic-g1
Draft

ooctipus wants to merge 18 commits into
isaac-sim:mainfrom
ooctipus:feat/native-supermimic-g1

Conversation

@ooctipus

@ooctipus ooctipus commented Oct 26, 2026 •

Copy link
Copy Markdown
Collaborator

Adds native G1 SuperMimic training through Isaac Lab's standard RL scripts, with MLP or optional one-frame NeRD dynamics, differentiable policy learning, evaluation and video. The task owns observations, objectives and transition capture; the learner owns replay and optimization. Checkpoints include optimizer state and support W&B uploads.

Joint motion and velocity control: set env.commands.motion.velocity.fraction=0.5. The interfaces share a world model and action decoder, with separate encoders and critics. Motion tracking updates the decoder; velocity return updates only its encoder through the frozen decoder. Reference-command rollouts add latent alignment. Captured command provenance preserves real/imagined command timing. Motion-only training remains the default.

Dependencies: #8822 supplies shared capture/storage; this branch includes its unmerged implementation. #8825 is independent. The optional NeRD network requires PhysicsNeMo Robotics; the separate normalization integration remains in #8835.

Usage guide covers data preparation, both training interfaces, logging, resume, motion evaluation and held-velocity-command playback.

Validation:

  • 94 focused learner, G1 task and entrypoint tests passed. Removing decoder freezing makes the gradient-routing regression fail.
  • Native joint MLP and NeRD smoke training passed with CUDA graphs enabled; MLP checkpoint resume, motion-only training, prior checkpoint-schema resume and both playback modes passed.
  • Full formatting/changelog checks and warnings-as-errors Sphinx HTML build passed.

These are integration checks using short training runs. They do not establish velocity-policy convergence, an exact paper reproduction, or the paper's zero-failure result. Robot and motion data remain separately prepared inputs.

@ooctipus ooctipus changed the title Integrate native SuperMimic training and G1 tracking Integrate native SuperMimic G1 motion and velocity training Oct 30, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

infrastructure isaac-mimic Related to Isaac Mimic team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant