Repository navigation
Add Policy Ghosts, recording and replay, an RTX toggle, and a Tracking Camera to the Newton GL visualizer - #8786
Draft
matthewtrepte wants to merge 53 commits into
Draft
matthewtrepte wants to merge 53 commits into
matthewtrepte wants to merge 53 commits into
Conversation
…ots, and a HUD docs link
…policy-ghosting # Conflicts: # source/isaaclab_rl/isaaclab_rl/entrypoints/backends/play_rsl_rl.py
…icy-ghosting # Conflicts: # source/isaaclab/isaaclab/visualizers/__init__.pyi # source/isaaclab_visualizers/isaaclab_visualizers/newton/newton_visualizer.py # source/isaaclab_visualizers/isaaclab_visualizers/viser/viser_visualizer.py
…L recording section
…nd save policy checkpoints
… Markers section, and label the camera combo Camera Source
…d default recordings to the recording folder
…n header tooltips
…e bottom, hide the RTX camera from Camera Source, and anchor the recording folder in the repo
…th a per-environment switch for sensors
…lights with a sky texture
… the section out in RTX
…ng Camera, and hide environments in RTX without corrupting bodies
…ive Plots, and drop the video FPS and length fields
…y and replay only, and relaunch Policy Ghosts through the CLI entry point
…o render without a browser
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Reworks the Newton GL visualizer window and adds several features to it. All of it is in the Newton GL window and the code it launches; Kit, Viser, and Rerun are unchanged apart from ignoring the new task views.
--policy_ghosts; a run without it offers an "Enable (restarts)" button..viseranimation recording; and a policy checkpoint Save wired into the RSL-RL play and train entrypoints. Output goes torecording/in the repository..viserfile in the running window. The simulation is hidden and paused, with play, step, loop, scrub, and speed, and a choice of Replay only, Overlay on live, or Side by side. The animation is drawn as separate shapes and never touches the Newton model.UsdFileCfgno longer skips itsvisual_materialwithout Kit, which left OVRTX markers red instead of green and blue.Relationship to #8620
The Tracking Camera brings over the follower, the
PerspectiveCameraCfgfields (env_index,track_path,follow_heading, smoothing), and the task declarations from #8620, adapted to the current visualizer settings layout. It does not bring the Kit and Viser follow support, theviz:newton_gl:trackingvideo source, or the docs, because that PR conflicts withmainin code I cannot test here. Expect overlapping hunks when it lands.Type of change
Verification
Known limits
ProxyArraypassed to a Warp kernel inisaaclab_physx, which this PR does not touch.Checklist
pre-commitchecks withuv run isaaclab --formatsource/<pkg>/changelog.d/for every touched package (do not editCHANGELOG.rstor bump package versions — CI handles that)CONTRIBUTORS.mdor my name already exists there