Sampling-based control for contact-rich robotics

Signal-MPC Entropy-Constrained Sampling MPC via Natural Gradients

Let the rollouts shape the search. Signal-MPC adapts both the mean and covariance of the MPPI sampling distribution online, while an explicit entropy floor keeps exploration alive.

Paper coming soon Watch comparisons

Manuscript preview · author and release links forthcoming

Signal-MPC rollout Go2 · hurdle
μ + Σ Online adaptation
H(q) ≥ H̄ Explicit entropy floor
Up to 2× Higher success rate
Real time Go2 hardware

01 · Overview

A sampling distribution that learns from every rollout.

Sampling-based MPC is effective when contact makes costs nonsmooth and derivatives unreliable. But standard MPPI fixes its sampling covariance, forcing the same exploration–exploitation trade-off throughout control.

Signal-MPC interprets MPPI as natural-gradient optimization over a Gaussian search distribution. Cost-weighted rollouts update both its center and shape; a minimum-entropy constraint prevents the proposal from collapsing around an early, suboptimal mode. Full, block-diagonal, and diagonal covariance variants make the accuracy–compute trade-off explicit.

The search distribution

qθ(U) = 𝒩(U | μ, Σ)

Roll out Reweight Adapt
01

Follow useful structure

The weighted samples reveal not only where low-cost controls lie, but how that region is shaped.

02

Keep support alive

Dual ascent enforces a meaningful exploration budget instead of relying on a hand-designed noise schedule.

02 · Method

Concentrate without collapsing.

The wall-trap example isolates the central failure mode: useful search must become focused without losing the alternative mode that clears the obstacle.

Wall-trap comparison between fixed covariance MPPI, unconstrained covariance adaptation, and Signal-MPC
Wall-trap task from Figure 1. Only Signal-MPC keeps support over the wall-clearing mode while concentrating away from the trap.
1

Estimate a natural-gradient update

Reuse MPPI’s sample–rollout–reweight interface to extract a zeroth-order update for both μ and Σ.

2

Enforce minimum entropy

A primal–dual update adjusts the entropy multiplier online, preserving a minimum sampling volume.

3

Retract to positive-definite covariance

A stable structured update keeps Σ positive definite under noisy finite-sample estimates.

Full Block-diagonal Diagonal

03 · Results

The advantage grows when rollouts are scarce.

Across quadruped and humanoid control, adaptive covariance makes the search more sample efficient and preserves performance under tighter real-time compute budgets.

Go2 · 64 rollouts 83%

success with diagonal Σ

Compared with 0% for MPPI and 17% for DIAL-MPC under the same rollout budget.

H1 · 64 rollouts 100%

success with full Σ

Compared with 50% for MPPI and 33% for DIAL-MPC on the humanoid walk task.

From simulation to hardware

Real-time control with onboard state estimation.

Signal-MPC runs on a Unitree Go2 using an onboard EKF, without motion capture or an offline-trained policy.

Success rates are reported in Table I of the current manuscript.

04 · Rollout gallery

See the sampling signal.

Select a task to compare DIAL-MPC, Signal-MPC, and fixed-covariance MPPI under the same contact-rich objective.

DIAL-MPC Signal-MPC MPPI

Go2 · emergent gait discovery

Exploration sprint

With no gait prior, the controller must discover useful contact sequences online, then concentrate its sampling distribution around a repeatable pattern.

DIAL-MPCPreset diffusion-style annealing
Signal-MPCRollout-adaptive covariance + entropy floor
MPPIFixed sampling covariance

Curves visualize sampled rollout trajectories; the robot motion follows the optimized mean control sequence.

Paper release

Signal-MPC: Entropy-Constrained Sampling MPC via Natural Gradients

The arXiv link and citation metadata will be added here when the paper is released.

arXiv coming soon