SkillAgentSearch skills...

isaac-sim

NVIDIA Isaac Sim and Isaac Lab for robot learning: install (uv, pip, binary, Docker, cloud), RTX GPU and driver requirements, headless runs and livestreaming, OpenUSD assets, URDF/MJCF import, ArticulationCfg and actuators, manager-based and direct envs, configclass, gymnasium task registration, tra…

Install / Use

npx skills add arpitg1304/robotics-agent-skills --skill isaac-sim

Installs into whichever agent you are using.

About this skill
📄

SKILL.md

Installable skill definition

Quality Score

91/100

Supported Platforms

Universal

Our assessment of isaac-sim

isaac-sim scores 91/100 on our quality scale, 321st of 950 AI & Machine Learning skills we index (top 34%).

Its SKILL.md is 21 KB long, well organised into 23 sections with 8 code examples: a thorough specification that gives an agent plenty to work with.

It has 405 GitHub stars, a meaningful sign that others use it.

Substance
30/30
Structure
20/20
Description
15/15
Adoption
11/20
Freshness
15/15

Maintenance, license and trust

  • The repository was last updated 3 days ago, so isaac-sim is actively maintained.
  • It is released under the Apache-2.0 license, a permissive license that allows use, modification and commercial use with attribution.
  • Its trust signals score 100/100, with no cautions. These come from repository metadata, not a code audit — read the skill file before letting an agent act on it.

Safety scan

No issues found

Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands (1 minor note below).

  • noteInstalls by piping a downloaded script into a shellline 130
    curl -LsSf https://astral.sh/uv/install.sh | sh

Automated pattern scan on 2026-11-22. It catches known dangerous patterns, not every risk — read a skill before letting an agent act on it.

isaac-sim compared with similar skills

All 4 of these similar skills score higher than isaac-sim; compare them before choosing.

SkillScoreStarsUpdatedFormat
isaac-sim (this skill)by arpitg1304914053d agoSKILL.md
claude-memby thedotmack100119.0ktodayCLAUDE.md
Understand-Anythingby Egonex-AI10093.7ktodayCLAUDE.md
headroomby headroomlabs-ai10080.5ktodayCLAUDE.md
CowAgentby zhayujie10048.0ktodayCLAUDE.md

Frequently asked questions

How do I install isaac-sim?
Run npx skills add arpitg1304/robotics-agent-skills --skill isaac-sim. The install tabs above show the steps for each supported agent.
Which AI agents does isaac-sim work with?
It is written for Universal, as a SKILL.md file. Other agents that read the same format can often use it too.
Is isaac-sim safe to use?
Our scan of the whole file found no instruction hijacking, hidden characters, credential access, data exfiltration or destructive commands (1 minor note below). It is Apache-2.0-licensed and scores 100/100 on trust signals. Skills are instructions an agent will follow, so read the file before installing it and do not approve commands you do not understand.
Is isaac-sim still maintained?
The repository was last updated 3 days ago, so isaac-sim is actively maintained.

name: isaac-sim description: > NVIDIA Isaac Sim and Isaac Lab for robot learning: install (uv, pip, binary, Docker, cloud), RTX GPU and driver requirements, headless runs and livestreaming, OpenUSD assets, URDF/MJCF import, ArticulationCfg and actuators, manager-based and direct envs, configclass, gymnasium task registration, training and playing with rsl_rl, rl_games, skrl or sb3, parallel envs, tiled cameras, contact sensors, ray casters, IMU, frame transformers, domain randomisation via events, teleoperation, Isaac Lab Mimic, the ROS 2 bridge, PhysX/Newton presets, solver tuning and exploding articulations. Use when the user mentions Isaac Sim, Isaac Lab, Omniverse, Kit, isaacsim or isaaclab imports, omni.isaac modules, USD robots, URDF import, num_envs, Mimic, isaaclab train or play, ManagerBasedRLEnv, DirectRLEnv, PresetCfg, Newton or OvPhysX in Isaac Lab, or migrating from Isaac Gym or Isaac Lab 2.x.

Isaac Sim and Isaac Lab

Verified against Isaac Lab 3.0.0 (tag v3.0.0) / Isaac Sim 6.2.0, 2026-11-18. Not executed: examples are checked against source, not run.

The 3.0 release is a break. Isaac Lab is now multi-backend: it installs Newton (Warp) physics by default and treats Isaac Sim as an optional extra. Quaternions are XYZW, asset data is a ProxyArray, and one isaaclab train command replaces the per-library scripts. Most Isaac Lab code that agents learned before 2026 is wrong for 3.0. When a detail matters, trust the installed checkout over memory, in this order: --help output, then source under source/, then the docs under docs/source/.

An Isaac Lab checkout also ships NVIDIA-maintained agent skills in .agents/skills/isaaclab-* (installing, migrating 2.x to 3.x, presets, sensors and actuators, events, multi-GPU). When you work inside that repo, read the matching one. This skill is the portable overview.

When to Use This Skill

  • Installing Isaac Sim or Isaac Lab, or choosing between pip, binary, Docker and cloud
  • Importing a URDF or MJCF robot, or writing an ArticulationCfg with actuators
  • Writing a manager-based or direct RL environment and registering it with gymnasium
  • Training or playing a policy with isaaclab train / isaaclab play
  • Adding cameras, contact sensors, ray casters, IMUs or frame transformers to a task
  • Domain randomisation, actuator models, observation noise and latency for sim-to-real
  • Teleoperating, recording demonstrations and multiplying them with Isaac Lab Mimic
  • Connecting Isaac Sim to ROS 2
  • Fixing exploding articulations, slow training, black camera images or a broken upgrade

Out of scope: RL algorithm choice, reward design and sim-to-real theory (robot-reinforcement-learning); policy architectures and BC/diffusion training (imitation-learning); dataset format and QA (lerobot, robot-data-quality); MuJoCo and MJX outside Isaac Lab (mujoco).

Reference Files

Load these only when the task needs the detail:

  • references/install-and-setup.md: non-uv installs, Docker gotchas, version pairing, first launch, visualizers and livestream.
  • references/assets-and-import.md: USD, schema fragments, robot configs, importer gotchas. Load before converting or debugging an asset.
  • references/environment-examples.md: full manager-based task with registration, direct skeleton. Load when writing an environment.
  • references/sensors-and-rendering.md: sensor table, camera example, image memory. Load when adding a sensor or camera.
  • references/randomisation-and-actuators.md: events example, PhysX vs Newton differences, actuator models, sim-to-real hooks.
  • references/debugging.md: physics settings and the full symptom table. Load when a symptom is not in the short table below.
  • references/migration-2x-to-3x.md: porting Isaac Lab 1.x/2.x, Isaac Gym or omni.isaac.* code; old-name to new-name tables; also when an error names a removed API.
  • references/config-reference.md: config field tables, event functions, all train/play flags, training notes (logging, outputs, custom scripts, num_envs).
  • references/demonstrations-and-ros2.md: teleop → Mimic → robomimic, HDF5 layout, GR00T/RLinf, ROS 2 bridge.

Ecosystem Map and Requirements

| Component | Current (2026-11-18) | Notes | |-----------|----------------------|-------| | Isaac Sim | 6.2.0 (tag v6.2.0; v7.0.0a1 alpha exists) | Omniverse Kit + OpenUSD app. Source on GitHub isaac-sim/IsaacSim, Apache-2.0; the build downloads the Kit SDK and extensions | | Isaac Lab | 3.0.0 (tag v3.0.0, 2026-10-19) | BSD-3-Clause (Mimic is Apache-2.0). main targets Isaac Sim 6.2 and has already removed some 3.0 deprecated aliases | | Newton | 1.6.1, on Warp 1.17 | Default Isaac Lab physics. Solvers: MJWarp, Kamino, VBD, MPM. Needs no Isaac Sim | | OvPhysX / OVRTX | 0.6.4 / 0.5.1 | PhysX and RTX rendering without Kit. Cannot share a process with Isaac Sim | | Python / PyTorch | 3.12 / torch 2.11.0 + CUDA 13.0 | CUDA 13 requires Turing or newer (compute 7.5+) |

Isaac Lab 3.0 rejects Isaac Sim 5.1 and older. Full version pairing: references/install-and-setup.md.

Requirements:

  • OS: Ubuntu 22.04+ x86_64, Linux aarch64 (DGX Spark), Windows 11 x86_64. macOS is not supported by Isaac Sim or Isaac Lab; a Mac can only edit code or drive a remote or cloud machine. Isaac Sim marks Ubuntu 22.04 as deprecated, and its pip wheels need GLIBC 2.35+. Below that (for example Ubuntu 20.04), use the downloaded binary package.
  • Driver: Isaac Lab needs 580.65.06+ on Linux and 580.88+ on Windows, set by PyTorch CUDA 13. Isaac Sim 6.2 was tested with 595.58.03 (Linux) and 595.97 (Windows).
  • GPU for Isaac Sim: RTX with RT cores. The minimum is an RTX 4080 with 16 GB VRAM and 32 GB RAM. A100/H100 are not supported for Isaac Sim (no RT cores). Headless Newton simulation without cameras needs no RTX hardware.
  • Disk/network (first-launch downloads, EULA env var): references/install-and-setup.md.

Check what is actually installed before giving version-specific advice:

uv run python -c "import isaaclab; print(isaaclab.__version__)"
uv run --extra isaacsim python -c "from isaaclab.utils.version import get_isaac_sim_version; print(get_isaac_sim_version())"
uv pip show isaacsim isaaclab newton warp-lang torch | grep -E '^(Name|Version)'
nvidia-smi --query-gpu=name,memory.total,driver_version --format=csv,noheader

Three choices you make separately

physics=   isaacsim_physx | physx (auto) | ovphysx | newton_mjwarp | newton_kamino ...
renderer=  newton_renderer | ovrtx | isaacsim_rtx | rtx (auto)        (camera tasks only)
--viz      none | newton_gl | newton_rtx | kit | rerun | viser       (what you look at)

Kit (Isaac Sim) is loaded only when something needs it: physics=isaacsim_physx, renderer=isaacsim_rtx, --viz kit, livestreaming, or a direct isaacsim.* import. Defaults are per task. Cartpole defaults to newton_mjwarp, and other tasks may default to PhysX. Always list what a task supports:

uv run isaaclab list_envs --show_presets --keyword Cartpole
uv run isaaclab train --task Isaac-Cartpole --help   # groups physics= / renderer= / presets=

Setup

Recommended: uv from a checkout

curl -LsSf https://astral.sh/uv/install.sh | sh
git clone https://github.com/isaac-sim/IsaacLab.git && cd IsaacLab
git checkout v3.0.0                                  # pin; main moves daily

uv run isaaclab train --task Isaac-Cartpole --num_envs 16 --viz newton_gl physics=newton_mjwarp
uv run --extra isaacsim isaaclab train --task Isaac-Cartpole-Direct physics=isaacsim_physx
uv run --extra ovphysx  isaaclab train --task Isaac-Cartpole-Direct physics=ovphysx

uv run syncs the environment on every call. Put --extra <name> before isaaclab. The extras are isaacsim, ov/ovphysx/ovrtx, rsl-rl, rl-games, skrl, skrl-jax, sb3, rlinf, torchrl, rerun, viser, mimic, teleop, video, importers, tetrahedralization and leapp. --extra all adds the curated ov, RL libraries, rerun and viser, but not isaacsim, mimic or teleop.

Other install paths and Docker gotchas: references/install-and-setup.md.

Verify, smallest layer first

uv run python -c "import isaaclab; print('ok')"                          # import
uv run isaaclab zero_agent --task Isaac-Cartpole --num_envs 4             # task builds and steps
uv run isaaclab train --task Isaac-Cartpole --max_iterations 1            # runner plumbing
uv run --extra isaacsim isaaclab -p scripts/tutorials/00_sim/create_empty.py --viz kit   # Kit opens

Headless, visualizers, livestream

  • In 3.0, no --viz means headless. --headless and --enable_cameras were removed: the 3.0 parser rejects them (see test_kit_launcher.py), and cameras enable themselves. A few 3.0 doc pages still show these flags, so trust --help.

Visualizers and livestream: references/install-and-setup.md.

Assets and Import

USD, schema fragments and SI units/scale: references/assets-and-import.md.

Robot config

rigid_props and articulation_props are the schema-fragment lists from references/assets-and-import.md.

import isaaclab.sim as sim_utils
from isaaclab.actuators import ImplicitActuatorCfg
from isaaclab.assets import ArticulationCfg

MY_ARM_CFG = ArticulationCfg(
    spawn=sim_utils.UsdFileCfg(
        usd_path="/assets/my_arm/my_arm.usda",
        activate_contact_sensors=True,          # required for any ContactSensor on this robot
        rigid_props=rigid_props,
        articulation_props=articulation_props,
    ),
    init_state=ArticulationCfg.InitialStateCfg(
        pos=(0.0, 0.0, 0.0),
        rot=(0.0, 0.0, 0.0, 1.0),               # XYZW in 3.0 (was WXYZ in 2.x)
        joint_pos={"joint[1-6]": 0.0, "finger_.*": 0.04},   # regex keys, radians/meters
    ),
    actuators={
        "arm": ImplicitActuatorCfg(
            joint_names_expr=["joint[1-6]"],
            stiffness=400.0, damping=40.0, armature=0.01,
            joint_effort_limit=87.0,             # solver clamp (was effort_limit_sim)
            joint_velocity_limit=2.6,            # (was velocity_limit_sim)
        ),
        "gripper": ImplicitActuatorCfg(joint_names_expr=["finger_.*"], stiffness=2e3, damping=1e2),
    },
    soft_joint_pos_limit_factor=0.95,
)
# in a scene: robot = MY_ARM_CFG.replace(prim_path="{ENV_REGEX_NS}/Robot")

URDF and MJCF import

Convert once, commit the USD, and spawn with UsdFileCfg. UrdfFileCfg and MjcfFileCfg can convert at spawn time, but that hides conversion errors and costs startup time.

uv run --extra importers python scripts/tools/convert_urdf.py robot.urdf /out/dir \
    --fix-base --merge-joints --joint-stiffness 100.0 --joint-damping 1.0 --joint-target-type position \
    --ros_package_path my_pkg /path/to/my_pkg --viz newton_gl      # NAME PATH; repeatable
uv run --extra importers python scripts/tools/convert_mjcf.py robot.xml /out/robot.usd \
    --merge-mesh --self-collision --collision-type "Convex Hull"

Ready-made robot configs, importer gotchas and mesh conversion: load references/assets-and-import.md before converting.

Environment Design

| | Manager-based (ManagerBasedRLEnv) | Direct (DirectRLEnv) | |---|---|---| | Define | Config classes of terms: observations, actions, rewards, terminations, events, commands, curriculum | One class with _pre_physics_step, _apply_action, _get_observations, _get_rewards, _get_dones, _reset_idx | | Best for | Most new tasks, ablations, Hydra overrides of single terms, sharing MDP terms | Custom step logic, fused reward kernels, MARL (DirectMARLEnv), Isaac Gym ports | | Randomisation | events | events config also works in direct envs |

Both are driven by a @configclass config (a dataclass with mutable defaults handled for you; use cfg.replace(...) or isaaclab.utils.replace(cfg, ...)

Truncated for display — read the full file on GitHub.

Related Skills

View on GitHub
GitHub Stars405
CategoryAI
Updated3d ago
Forks51

Languages

Python

Trust signals

100/100

From repository metadata: license, adoption, age and documentation. Not a code audit — see the Safety scan above for what the skill file itself contains.

No cautions