Particle-based Conformal Prediction for Contact-Aware Uncertainty Calibration in Stratified Configuration Spaces

* denotes equal contribution.

ArXiv PDF

15th Symposium on Conformal and Probabilistic Prediction with Applications (COPA) 2026

(Left) PCP calibrates particle uncertainty globally, making it optimistic in free-space and too conservative near contact. (Right) CaPTURe calibrates motion uncertainty conditioned on state, action, and the contact manifold, providing informative, adaptive uncertainty estimates for motion planners.

Blue particles show predicted future configurations, the translucent region shows the resulting uncertainty set, and the green flag marks the goal.

Abstract Reliable uncertainty representation is essential for deploying autonomous systems that interact with their environment, as robots must reason about how uncertainty arising from both stochasticity and model mismatch is impacted by contacts with obstacles (e.g., when navigating through a cluttered environment or inserting a part into an assembly). We propose Calibrated Particle-sets for Trans-dimensional Uncertainty Representation (CaPTURe), a geometry-aware, conformal prediction-based algorithm that generates probabilistically valid prediction regions of the unknown future system configuration using particle-based models of arbitrary fidelity. While calibrated uncertainty predictions are essential for safe and efficient planning, analytical or learned motion models are often inaccurate—due to limited data, simplifying assumptions, unmodeled effects, etc.—which can lead to unsafe executions or task failure. Additionally, when a robot contacts an obstacle, the distribution of its future configurations can become multimodal or disjoint, or lie along manifolds of lower intrinsic dimension than the space of possible robot configurations. Our method uses a calibration dataset of system transitions to locally calibrate motion uncertainty estimates, constructing regions guaranteed to contain the future robot configuration at a user-set probability. Our calibration procedure captures how motion uncertainty varies between contact-rich and contactless motions, leading to sufficient coverage in both cases. We evaluate our method on two simulated planning tasks: controlling a marble around a labyrinth and performing tight-tolerance peg-in-hole insertion with a manipulator. Compared to relevant baselines, CaPTURe achieves the user-specified coverage requirement both in and out of contact and achieves up to a 30% absolute improvement in task success rate over the best baseline.

Problem Setup

Consider a discrete-time stochastic system with full configuration ctC\mathfrak c_t \in \mathfrak C, state st:=(ct,c˙t)s_t := (\mathfrak c_t,\dot{\mathfrak c}_t), action atAa_t \in \mathcal A, and unknown dynamics st+1f(st,at)s_{t+1} \sim f(s_t,a_t). We plan from s0s_0 to a goal region using an approximate particle dynamics model f^\hat f. The prediction input is X:=(st,at)X := (s_t,a_t), and its target Y:=ct+1CY := c_{t+1} \in C is the task-relevant projection of the next full configuration.

Given an exchangeable calibration set Dcal:={(Xi,Yi)}i=1nD_{\mathrm{cal}} := \{(X_i,Y_i)\}_{i=1}^{n}, we seek an informative input-dependent region C^(X)Cfeas\hat{\mathcal C}(X) \subseteq C_{\mathrm{feas}} with user-specified coverage. We model the feasible C-space as Cfeas:=mMSmC_{\mathrm{feas}} := \bigsqcup_{m\in M} S_m with known stratum indexer T:CfeasM\mathcal T:C_{\mathrm{feas}}\to M, so regions may span full-dimensional free space and lower-dimensional contact manifolds without containing infeasible configurations.

Method: CaPTURe

CaPTURe calibrates the kNNk_{\mathrm{NN}}-th-nearest-particle score within groups defined by state, action, and candidate future stratum. At inference, it queries every candidate stratum and unions the resulting feasible per-stratum regions. For a user-specified failure rate α(0,1)\alpha \in (0,1), the union satisfies

P ⁣(ct+1C^)1α. \mathbb P\!\left(c_{t+1} \in \hat{\mathcal C}\right) \ge 1 - \alpha.

Offline calibration diagram
Offline calibration of CaPTURe. For each transition in DcalD_{\mathrm{cal}}, f^\hat f receives the current state st:=(ct,c˙t)s_t := (\mathfrak c_t,\dot{\mathfrak c}_t) and action ata_t to sample LL predictive particles (black) of the future configuration ct+1c_{t+1}, which we use to compute the nonconformity score RiR_i (pink). The augmented subset Dˉcalpart\bar D_{\mathrm{cal}}^{part} fits a regression decision tree that partitions state, action, and future stratum index T(ct+1)\mathcal T(c_{t+1}) into groups with approximately group-constant prediction scores. The holdout subset Dˉcalcp\bar D_{\mathrm{cal}}^{cp} is passed through the DTree, with each example landing in a corresponding group jj. SplitCP is performed independently in each group, producing threshold q^j\hat q_j.
Prediction region construction diagram
Construction of stratified prediction region C^\hat{\mathcal C}. Given action ata_t and state st:=(ct,c˙t)s_t := (\mathfrak c_t,\dot{\mathfrak c}_t), f^\hat f returns predictive particles (black). For each stratum index mMm\in M, the pre-fit DTree maps (st,at,m)(s_t,a_t,m) to a contact-aware threshold q^j\hat q_j. Configurations in SmS_m whose kNNk_{\mathrm{NN}}-th-particle distance is at most q^j\hat q_j form that stratum’s region. Their union is C^\hat{\mathcal C}.

Experiments

Marble Labyrinth Control

We simulate a planar marble control environment inspired by the BRIO labyrinth toy, where the task is to navigate a tight-clearance maze while avoiding known pit locations under aleatoric disturbances and significant model mismatch. The state is st=[xb,x˙b,yb,y˙b,α,β]s_t=[x^b,\dot x^b,y^b,\dot y^b,\alpha,\beta]^\top, with board-fixed marble coordinates and plate inclination angles, and controls are motor velocities that tilt the board. We construct prediction regions over the 2D marble position ct=[xb,yb]c_t = [x^b, y^b]^\top. This task is challenging since the controls only indirectly influence marble location through plate tilt, causing delayed responses, momentum accumulation, and wall-shaped uncertainty when the dynamics are inaccurately modeled. The videos below compare rollouts produced by CaPTURe and the baselines across maze sections.

Map
Episode
Method
Map

Aggregate planning results across six marble maze sections (180 trials per method).

MapMetricParticleNoCPPCPLUCCaAblation w/o stratum label
(kNN=8)
Ablation
(kNN=1)
CaPTURe
(kNN=8)
All six
maps
Success (%) ↑72.870.651.776.177.291.1
Steps to goal
(mean) ↓
13.213.928.514.816.315.6

Success means reaching the goal without falling into a pit. Aggregate percentages use all 180 executions per method; mean steps use successful trials only. An episode times out at step 100.

Manipulator Peg Insertion

We further evaluate CaPTURe on a tight-tolerance peg insertion task adapted from the Factory simulation suite in Isaac Sim. We control a Franka Panda (7 DoF manipulator) to insert a cylindrical peg into a low-clearance hole under both stochastic disturbances and significant model mismatch. To facilitate contact-aware planning, we restrict end-effector motion to lie along the hole's plane, reducing possible peg poses from SE(3)SE(3) to SE(2)SE(2) and making the configuration of interest ct=[x,z,θ]c_t = [x,z,\theta].

The videos below show CaPTURe peg-insertion rollouts across several initial peg poses.

Initial peg pose
Method

The synchronized comparison below shows the physical execution for all six methods from the same initial peg pose.

Initial peg pose

Peg-insertion planning over 50 feasible Halton initial configurations.

MetricParticleNoCPPCPLUCCaAblation w/o stratum label
(kNN=4)
Ablation
(kNN=1)
CaPTURe
(kNN=4)
Success (%) ↑144848482078
Steps to insertion
(mean ± std) ↓
39.9 ± 13.338.4 ± 13.941.5 ± 16.643.1 ± 15.936.2 ± 16.428.7 ± 8.9

Success denotes full insertion within 75 controller steps (5.0 simulated seconds). Steps are reported over successful episodes only.

This work was supported in part by the Office of Naval Research Grant N00014-24-1-2036 and NSF grants IIS-2113401 and IIS-2220876.

BibTeX (cite this!)

@misc{marques2026particlebasedconformalpredictioncontactaware,
      title={Particle-Based Conformal Prediction for Contact-Aware Uncertainty Calibration in Stratified Configuration Spaces},
      author={Luís Marques and Kristian Popov and Dmitry Berenson},
      year={2026},
      eprint={2608.09166},
      archivePrefix={arXiv},
      primaryClass={cs.RO},
      url={https://arxiv.org/abs/2608.09166},
}