Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
48 commits
Select commit Hold shift + click to select a range
75d3c9a
feat(sim): default Newton rigid simulation to MJVBD V2
Sep 17, 2026
731a20d
fix(sim): tune MJVBD V2 manipulation examples and record limitations
Sep 18, 2026
51af322
fix(tutorial): align drawer damping across physics backends
Sep 20, 2026
bc5369b
docs(sim): clarify MJVBD V2 coupling and control limitations
Sep 20, 2026
5f19889
fix(sim): adapt examples to DexUni solver config
yuecideng Sep 29, 2026
1e9d5f9
Merge remote-tracking branch 'origin/main' into codex/dexuni-interfac…
yuecideng Sep 29, 2026
347ce76
fix(sim): unify Newton solver adaptation on DexUni
yuecideng Sep 29, 2026
aa9f0b6
feat(sim): expose DexUni contact sensor data
yuecideng Sep 29, 2026
1832e56
test(sim): cross-check DexUni contact impulses
yuecideng Sep 29, 2026
c763aad
test(sim): assert DexUni contact invariants
yuecideng Sep 29, 2026
32e08fc
Merge remote-tracking branch 'origin/main' into codex/dexuni-interfac…
yuecideng Oct 3, 2026
7049fcf
fix(sim): update DexUni migration validation
yuecideng Oct 3, 2026
a09bd7e
docs(sim): use DexUni terminology consistently
yuecideng Oct 3, 2026
ad9ba87
wip
yuecideng Oct 4, 2026
b589354
Merge latest main into DexUni interface adaptation
yuecideng Oct 10, 2026
9428020
feat(physics): support current DexUni two-way coupling contracts
yuecideng Oct 10, 2026
6e60b8e
fix(dexsim): adapt latest 0.5.1 runtime contracts
yuecideng Oct 20, 2026
794bbb9
feat(dexsim): consolidate two-way coupling adaptation from PR #720
yuecideng Oct 21, 2026
e8a6419
fix(dexsim): reconcile current particle material and task contracts
yuecideng Oct 21, 2026
b8922a0
Merge latest main into DexSim adaptation
yuecideng Oct 27, 2026
57d0262
fix(dexsim): follow current DexUni dispatch and device defaults
yuecideng Oct 27, 2026
1eef398
feat(sim): expose DexSim controls and deformable initialization
Oct 27, 2026
9a2d016
fix(sim): preserve continuous URDF joint limits for DexUni
yuecideng Oct 27, 2026
a48f07c
fix(examples): complete DexUni workflows and physical placement checks
yuecideng Oct 27, 2026
f9f128d
Merge main be57e1b97 into DexUni adaptation
yuecideng Oct 27, 2026
4d72509
fix(examples): preserve placement asset frames across renderers
yuecideng Oct 27, 2026
da67a3e
Merge main into codex/adapt-latest-dexsim
yuecideng Nov 2, 2026
37085da
Merge main and adapt DexSim 0.6 contact reports
yuecideng Nov 7, 2026
731427f
refactor(sim): narrow Newton articulation root options
yuecideng Nov 7, 2026
834f88d
refactor(sim): remove legacy AutoSolver compatibility
yuecideng Nov 7, 2026
a6c3693
docs(sim): standardize native DexUni automatic dispatch
yuecideng Nov 7, 2026
f249fbe
update dexsim version
yuecideng Nov 7, 2026
8f792d0
Merge branch 'main' into codex/adapt-latest-dexsim
yuecideng Nov 7, 2026
28f8b6a
fix(sensors): honor native contact sampling boundaries
yuecideng Nov 7, 2026
3aafa0c
Merge latest main into codex/adapt-latest-dexsim
yuecideng Nov 9, 2026
afe3e06
fix: validate placement frames, mesh indices and deployment fixtures
yuecideng Nov 9, 2026
c1af874
fix(docker): align rc1 runtime guidance and pinned installer fallback
yuecideng Nov 9, 2026
e14fc4e
Add basic fluid simulation and standalone tutorial (#777)
yuecideng Nov 9, 2026
722189a
docs: record rc1 wheel and container dependency qualification
yuecideng Nov 9, 2026
c6e991c
Merge concurrent fluid update and retain rc1 qualification
yuecideng Nov 9, 2026
17d096e
test(gym): initialize fluid registry in reset fixture
yuecideng Nov 9, 2026
df92813
Merge main into DexSim adaptation and resolve Atomic Skill migration
yuecideng Nov 10, 2026
feeea3b
fix(ci): report native test failures before subsequent hangs
yuecideng Nov 10, 2026
91ae175
feat(cable): adapt foundation and episode defaults to DexSim 0.6
KeqiYe Nov 9, 2026
2e1437a
fix(cable): sync main and repair CI regressions
KeqiYe Nov 11, 2026
2b33689
fix(cable): preserve mounted resources on current main
KeqiYe Nov 11, 2026
b125040
fix(cable): preflight USD particles and materials before scene mutation
KeqiYe Nov 11, 2026
9da9f00
feat(cable): add creation tutorial and generate USD test fixture
yuecideng Nov 11, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 4 additions & 1 deletion agent_context/MAP.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,9 @@ topics:
UsdSourceSnapshot, read_usd_source, LinkMesh,
PhysicalCollisionGeometry, capture_physical_collision_geometry,
ArticulationJointKinematics, get_parent_joint_chain, asset_physics_mode, joint_drive_props, enable_gravity,
fixed-cadence playback, FluidObjectCfg, FluidSpawnCfg, FluidObject, SPHSolverCfg, revolved_volume, fill_level, 粒子采样, fluid, 流体, quaternion, xyzw]
fixed-cadence playback, FluidObjectCfg, FluidSpawnCfg, FluidObject, SPHSolverCfg, revolved_volume, fill_level,
粒子采样, fluid, 流体, quaternion, xyzw, cable, CableObject, CableObjectCfg,
CableObjectData, 线缆对象]
paths: [topics/simulation-system/simulation-system.md]
source_of_truth:
- embodichain/lab/sim/motion/__init__.py
Expand All @@ -38,6 +40,7 @@ topics:
- embodichain/lab/sim/objects/visual_object.py
- embodichain/lab/sim/objects/backends/
- embodichain/lab/sim/objects/deformable/
- embodichain/lab/sim/objects/cable/
- embodichain/lab/sim/objects/gizmo.py
- embodichain/lab/gym/envs/base_env.py
watch_paths: [embodichain/lab/sim/sim_manager.py, embodichain/lab/sim/cfg/, embodichain/lab/sim/physics/,
Expand Down
64 changes: 64 additions & 0 deletions agent_context/topics/simulation-system/deformables.md
Original file line number Diff line number Diff line change
Expand Up @@ -102,3 +102,67 @@ Focused coverage: `tests/sim/test_deformable_cfg.py`,
`tests/sim/objects/test_deformable_object.py`, `test_soft_object.py`,
`test_cloth_object.py`, `tests/sim/spawn/test_descriptors.py`, and
`tests/sim/test_runtime_controls.py`.

## Cable objects

`CableObjectCfg` and `CableObject(BatchEntity)` are independent of particle-set
deformables. `SimulationManager.add_cable_object()` lowers through
`spawn/descriptors.py` into `CableDesc`, declares in the existing `SpawnScene`,
and binds the same facade in place during `prepare()`. Backend capabilities
reject Default, CPU, other Newton solvers and gradient mode; use DexUni on CUDA.
With this backend, an arena containing a cable cannot also contain fluid,
cloth or soft-body particles: cable episode reset does not support those
particles. Spawn checks the native cable and particle descriptors for direct
declarations and USD imports, including mixtures within a single USD source.
It checks topology and UIDs before publishing declaration materials.

`CableObjectData` uses `Scene.create_cable_batch()` and exposes independent
world snapshots for equal-topology replicated segments. Public poses are
`xyz + xyzw`; the adapter permutes DexSim's quaternion-first batch output
without adding Arena offsets again. Authoring material quaternions are likewise
xyzw and convert once to CableDesc's wxyz. Defaults come from the engine's
immutable creation state, not a live observation at binding.

External force/torque and pending-load clearing use public `SpawnedCable`
methods. `write_segment_state_to_sim()` accepts world states in the same public
layout and uses `CableBatch.apply_state()` for both engine buffers. This teleport
clears history for each owning world, including other cables, while preserving
controls and loads. Object reset restores that cable's defaults and clears its
loads. It is not a complete episode reset or a solver-history checkpoint.

`EmbodiedEnvCfg.cable_object` declares Gym cables before preparation and belongs
to the physical environment component. Cable recordings and replay restrictions
are owned by [Gym execution](../env-framework/execution.md).

Newton's pre-build backend hook preflights cable attachment compatibility and
registers nonempty `init_qpos` through public model-initialization and batch-target
hooks before engine creation defaults are frozen. Input vectors are copied to
finite host float32 values, including CUDA tensors. The initializer does not
overwrite runtime commands; episode reset restores nonzero poses and targets.
When preparation is retried with a changed declaration, the initializer uses
the current articulation targets and joint values.
Mimic followers use the same state-order mapping and projection as articulation
reset. The opt-in MuJoCo mimic stabilizer retains authored positions; unsupported
solver paths project them before creation defaults are captured.
Permanent attachment to an articulation with nonzero `init_qpos` is rejected
before commit: the current engine resolves attachments before model-initialization
hooks. Supporting that combination requires an engine authoring API that applies
initial joint poses before attachment construction.
Zero authoring vectors whose mimic offsets produce a nonzero pose are rejected
when the initialization hook resolves source mimic metadata, before writing that pose.

Newton's scene-reset backend hook uses one public `Scene.reset_arenas()` call for all physical assets,
targets, loads and supported controls in selected environments. The manager then
resets selected visual objects, lights and sensors once, honoring their exclusions. Resolve Arena
indices by name: the Scene's default Arena means environment IDs are not Arena
indices. Physical exclusions are rejected before mutation. Runtime property edits
are outside this reset contract. Engine preflight rejects unsupported controls,
selected particles and unsupported solver modes. Global time remains monotonic;
contact queries need another update. For seeded initialization, reset the manager
then write caller-owned perturbed default segment states, preserving attachment
anchors. Finalized physical topology and individual removal remain unsupported.
Do not access backend arrays to implement missing engine operations.

Focused coverage: `tests/sim/test_cable_cfg.py`,
`tests/sim/objects/test_cable_object.py`, and
`tests/sim/objects/test_cable_object_cuda.py` (explicit serial CUDA run).
18 changes: 15 additions & 3 deletions agent_context/topics/simulation-system/lifecycle.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,8 @@ Return to the [simulation overview](simulation-system.md) for ownership.
readiness; `spawn/scene.py` owns declaration coordination. The ordering is:

1. If unfinalized or dirty, detach parented cameras before rebuilding their
native parents. Resolve/configure sources and commit Spawn topology.
native parents. Run the backend pre-build validation/initialization hook,
then resolve/configure sources and commit Spawn topology.
2. Apply Default articulation root properties before Direct GPU buffers capture
them. Delegate runtime setup to `PhysicsBackend.prepare_spawn_runtime()`.
3. Replay the current per-segment [material assignments](materials.md) captured
Expand Down Expand Up @@ -42,6 +43,11 @@ baselines while other assets retain runtime state. Native preparation failure
propagates without rollback. Randomization requiring the replacements runs
after this boundary.

Spawn-owned asset removal checks pending-removal and topology restrictions
before detaching mounted cameras or marker groups. A rejected removal leaves
the asset, sensors and marker attachments usable. NoRender declaration-only
visual objects remain removable without rebuilding physical topology.

Pending Newton topology/descriptor changes requiring a new immutable model
become usable only after preparation. Keep model rebuilding in Spawn; object
facades must not create a second runtime ownership path.
Expand All @@ -62,6 +68,12 @@ solver state with only some of its articulations; excluding a subset is rejected
before any facade state changes.
Other resource exclusions and environment selections remain honored.

The backend may handle physical reset atomically before the per-object path.
Newton scenes containing cables use a complete `Scene.reset_arenas()` boundary;
the manager retains visual-object, light and sensor reset ownership, including
their environment selections and exclusions. Physical exclusions and runtime property restoration are
unsupported in this path; see [cable state and reset](deformables.md#cable-objects).

`destroy(exit_process=False)` queues native cleanup. Flush with
`SimulationManager.flush_cleanup_queue()` after caller scene/object locals
unwind. Constructor failure before World allocation removes only the failed
Expand Down Expand Up @@ -100,10 +112,10 @@ indexing rules are in [deformables](deformables.md).

Use `sim_manager.py` for lifecycle sequencing, `spawn/scene.py` for commit/bind
coordination, `physics/base.py` and backend implementations for runtime hooks,
and `_runtime_controls.py` for nodal controls. `BaseEnv` owns Gym ordering.
and `_runtime_controls.py` for nodal controls and creation joint-state seeding. `BaseEnv` owns Gym ordering.

`tests/sim/test_sim_manager.py` covers retry without recommit, render sync,
camera attachment, replacement, control registration, reset and teardown.
`tests/sim/spawn/test_scene.py` covers declaration/source/binding state;
`tests/sim/test_runtime_controls.py` covers nodal runtime behavior. Physical
`tests/sim/test_runtime_controls.py` covers nodal behavior and one-shot joint seeding. Physical
baseline tests live with the corresponding objects under `tests/sim/objects/`.
4 changes: 4 additions & 0 deletions agent_context/topics/simulation-system/simulation-system.md
Original file line number Diff line number Diff line change
Expand Up @@ -169,6 +169,9 @@ tests need non-symmetric rotations to expose component-order mistakes.
reset only selected environments and honor supported exclusions.
- Declare deformables and Newton controls before finalization. Deformables
require Newton, CUDA and a supported particle solver without gradient mode.
- Cables require DexUni on CUDA without gradient mode. Declare them
before preparation. Cable episodes reset through the owning Scene; finalized
physical topology remains fixed. See [cable objects](deformables.md#cable-objects).
- Flush deferred cleanup after caller-owned scene locals unwind when using
`destroy(exit_process=False)`; release child views before native parents.

Expand All @@ -181,6 +184,7 @@ tests need non-symmetric rotations to expose component-order mistakes.
| Joint state order, drive lowering, mimic coupling, native adaptation | [Articulation and batch adapters](articulation-adapters.md); `objects/backends/`, `objects/articulation.py` |
| Initial-fill fluid configuration, state and rendering | [Fluids](fluids.md); `cfg/fluid.py`, `objects/fluid.py` |
| Volume/surface state, topology and kinematic nodes | [Deformables](deformables.md); `cfg/deformable.py`, `objects/deformable/` |
| Cable declaration, segment state and external loads | [Cable objects](deformables.md#cable-objects); `cfg/cable.py`, `objects/cable/` |
| Camera synchronization, native window/offscreen denoising, startup readiness | [Rendering and diagnostics](rendering.md); manager, `cfg/simulation.py`, `_startup_summary.py` |
| Robot definition, control parts, robot presets | [Robot system](../robot-system/robot-system.md) |
| Camera attachment resolution or contact sensors | [Sensor system](../sensor-system/sensor-system.md) |
Expand Down
31 changes: 31 additions & 0 deletions docs/source/api_reference/embodichain/embodichain.lab.sim.cfg.rst
Original file line number Diff line number Diff line change
Expand Up @@ -74,6 +74,9 @@ UV seams and render detail.
LightCfg
VisualObjectCfg
RigidObjectCfg
CableObjectCfg
CablePhysicsCfg
CableAttachmentCfg
RigidObjectGroupCfg
RigidConstraintCfg
URDFCfg
Expand Down Expand Up @@ -175,6 +178,34 @@ properties are grouped under ``attrs.surface_props``. Volume elasticity uses
``youngs`` and ``poissons``. Configuration dictionaries serialize this same
schema; no legacy aliases or field migration are provided.

Cable authoring
---------------

``CableObjectCfg`` authors an ordered centreline, radius and optional material
frames in EmbodiChain's ``xyzw`` convention. ``CablePhysicsCfg`` preserves
unspecified four-mode coefficients as ``None`` and reuses existing collision
and contact-material schemas. ``CableAttachmentCfg`` describes permanent
creation-time endpoint welds. Declare cables before ``prepare()`` with explicit
DexUni on CUDA. Segment writes and complete environment reset require a DexSim
build exposing ``CableBatch.apply_state`` and ``Scene.reset_arenas``.

.. currentmodule:: embodichain.lab.sim.cfg.cable

.. autosummary::

CablePhysicsCfg
CableAttachmentCfg
CableObjectCfg

.. autoclass:: CablePhysicsCfg
:members:

.. autoclass:: CableAttachmentCfg
:members:

.. autoclass:: CableObjectCfg
:members:

Rendering configuration module
------------------------------

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -575,3 +575,61 @@ Deformable implementation import paths
.. autosummary::

VolumeDeformableObject

Cable objects
-------------

``CableObject`` derives from ``BatchEntity`` and retains one public
``SpawnedCable`` handle per environment. Declare it through
``SimulationManager.add_cable_object()`` and call ``prepare()`` before accessing
``data`` or external loads. ``CableObjectData.segment_state_w`` returns one
coherent ``(environments, segments, 13)`` snapshot in
``[xyz, xyzw, world COM linear velocity, world angular velocity]`` order.
Positions already include environment origins. Returned tensors are independent
snapshots; ``default_segment_state_w`` is immutable engine creation state, not a
solver-history checkpoint.

Current operations include ``set_force()``, ``set_torque()`` and
``clear_wrenches()`` for selected environments. Loads follow DexSim's one-outer-step
lifetime. ``write_segment_state_to_sim()`` accepts selected environment rows in
the same state layout. This teleport writes both engine buffers and clears
history for each owning world, including other cables, while preserving targets
and pending loads. ``CableObject.reset()`` restores its creation state and clears
its loads; it preserves other bodies and targets.

Use ``SimulationManager.reset_objects_state()`` for complete cable episodes.
It restores all physical assets, targets, loads and supported runtime controls in
selected Arenas through one ``Scene.reset_arenas()`` call. Physical asset
exclusions are rejected before mutation. Global time is preserved. Reset covers
state, not runtime property or topology edits. Existing contact queries require
another update after reset or teleport. A cable has no single rigid root pose;
individual removal and finalized-scene physical topology changes remain unsupported.

.. currentmodule:: embodichain.lab.sim.objects.cable

.. autosummary::

CableObject
CableObjectData

.. autoclass:: CableObject
:members:
:show-inheritance:

.. autoclass:: CableObjectData
:members:

Cable implementation import paths
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

.. currentmodule:: embodichain.lab.sim.objects.cable.cable

.. autosummary::

CableObject

.. currentmodule:: embodichain.lab.sim.objects.cable.data

.. autosummary::

CableObjectData
1 change: 1 addition & 0 deletions docs/source/api_reference/public_api.rst
Original file line number Diff line number Diff line change
Expand Up @@ -3722,6 +3722,7 @@ embodichain.lab.sim.spawn.descriptors
configure_articulation_desc
rigid_desc_from_cfg
visual_desc_from_cfg
cable_desc_from_cfg
surface_deformable_desc_from_cfg
volume_deformable_desc_from_cfg

Expand Down
13 changes: 11 additions & 2 deletions docs/source/quick_start/install.md
Original file line number Diff line number Diff line change
Expand Up @@ -67,8 +67,10 @@ python -m pip install torch==2.11.0 torchvision==0.26.0 torchcodec==0.11.1 \

The SDK matrix CI checks a clean CPU installation, recording/loading, video
decoding, and an official ACT update/checkpoint/reset. GPU simulation and full policy learning acceptance
are separate checks. Python versions above 3.12 select the newer SDK but are not
part of this validation matrix.
are separate checks. This release requires Python >=3.11 and pins DexSim
0.6.0rc1. The DexForce index provides Linux x86_64 wheels for CPython 3.11 and
3.12; use one of those versions for this release. Python 3.10 is unsupported,
and versions above 3.12 are outside the current wheel/validation matrix.

Recordings retain the existing task/subtask table and depth-sidecar schema on
both routes. LeRobot 0.6.1 exposes `subtask_index` but does not automatically
Expand Down Expand Up @@ -114,6 +116,11 @@ select `py311` or `py312` with `EMBODICHAIN_ENV`. See the
for internal registry access, environment selection, source development, and
dependency locks.

The published image digests in the container guide's validation record belong
to the earlier DexSim 0.5.1rc1 runtime. For this checkout's DexSim 0.6.0rc1
requirements, build a candidate from the current source or follow the guide's
source-development instructions to update the selected environment.

### Prerequisites

- [Docker](https://docs.docker.com/engine/install/) with [NVIDIA Container Toolkit](https://docs.nvidia.com/datacenter/cloud-native/container-toolkit/install-guide.html)
Expand Down Expand Up @@ -342,6 +349,8 @@ for the current compatibility requirements, and see
[cuRobo V2 Planner](../overview/sim/motion/planners/curobo_planner.md) for EmbodiChain
configuration and usage. cuRobo planning always runs on CUDA, but the
SimulationManager physics device may be either CPU or CUDA.
cuRobo's upstream Python range does not expand this release's EmbodiChain
runtime matrix; use Python 3.11 or 3.12 when installing them together.

## Optional: generative simulation (`gensim`)

Expand Down
Loading
Loading