A Risk-Adaptive Motion Planning Framework for
Safe and Resilient Non-Prehensile Object Transportation

sss

Upon detecting a suddenly appearing obstacle obstructing the current trajectory (blue), the proposed reactive planner rapidly generates a new, safe trajectory (yellow) in 250 ms to avoid the imminent collision and reach the goal.

Abstract

Non-prehensile transportation by robotic arms is a promising approach for the service industry. Such applications require robotic arms to be reactive, safe, and flexible enough to navigate dynamically changing and complex environments while maintaining the transported objects' stability. However, existing limited-horizon motion control methods are often ineffective in these scenarios. This letter presents a risk-adaptive motion planning framework for safe and resilient non-prehensile object transportation. To adapt to disturbances in quasi-static environments, the framework integrates a three-level safety mechanism that responds to predicted time-to-collision with replanning, a planned graceful safety stop, or a hardware-level emergency stop. The former two maneuvers rely on an efficient trajectory generator that integrates constrained path planning, trajectory parameterization, and refinement. Specifically, the constrained path planner is employed to provide global guidance in complex environments, yielding a high-quality initialization for the subsequent coarse-to-fine trajectory generation strategy. Additionally, the framework incorporates a periodic replanning strategy to proactively adapt to dynamic goal switching and environmental changes. Finally, the framework is comprehensively evaluated through extensive experiments.

1. System Overview

System architecture diagram of the replanning framework

Risk-adaptive motion planning framework, featuring a dual-triggering mechanism (periodic and safety-driven) and a complete trajectory generation pipeline, which integrates constrained path planning, trajectory parameterization, and trajectory refinement.

Note: All videos are shown at real-time speed (1x) unless otherwise stated.

2. Benchmark Comparisons

We compare our method (left) with a strong reactive baseline (right) adapted from an MPC approach [1] in four scenarios.

Ours (An open space)

Baseline (An open space)

Ours (A narrow passage)

Baseline (A narrow passage)

Ours (A table obstacle)

Baseline (A table obstacle)

Ours (A cluttered scene)

Baseline (A cluttered scene)

3. Reactivity Test

The performance of the replanning framework is evaluated in dynamic environments.

The replanning maneuver in response to a sudden obstacle

The safety-stop maneuver in response to a sudden obstacle

Non‑prehensile transportation in a dynamic environment (scene updated every 3s)

4. Robustness Test

We evaluate the robustness of our method against CoM displacement under varying levels of motion aggressiveness.

Overview of the robustness test setup

Robustness evaluation against position deviations, tested at three aggressiveness levels (low, medium, and high). (a-c) Heatmaps show the deviation between the actual and nominal contact force angles, resulting from the applied CoM position deviations. (d) The experimental setup. (e) Corresponding success rates.

GIF description 1

Low aggressiveness,
Deviation: (x = 0.0 m, y = 0.0 m)

GIF description 2

Medium aggressiveness,
Deviation: (x = 0.0 m, y = 0.0 m)

GIF description 3

High aggressiveness,
Deviation: (x = 0.0 m, y = 0.0 m)

GIF description 4

Low aggressiveness,
Deviation: (x = 0.05 m, y = 0.0 m)

GIF description 5

Medium aggressiveness,
Deviation: (x = 0.05 m, y = 0.0 m)

GIF description 6

High aggressiveness,
Deviation: (x = 0.05 m, y = 0.0 m)

GIF description 7

Low aggressiveness,
Deviation: (x = 0.1 m, y = 0.0 m)

GIF description 8

Medium aggressiveness,
Deviation: (x = 0.1 m, y = 0.0 m)

GIF description 9

High aggressiveness,
Deviation: (x = 0.1 m, y = 0.0 m)

GIF description 10

Low aggressiveness,
Deviation: (x = 0.13 m, y = 0.0 m)

GIF description 11

Medium aggressiveness,
Deviation: (x = 0.13 m, y = 0.0 m)

GIF description 12

High aggressiveness,
Deviation: (x = 0.13 m, y = 0.0 m)

5. Failure Cases

For the cuboid (5 × 5 × 20 cm) with a tipping margin angle β ≈ 14.0°, the constraint violation is insufficient to induce tipping. However, for a slender cuboid 2.5 × 2.5 × 30 cm, β ≈ 4.8°, the risk of tipping increases significantly.

6. Real-World Experiments

Finally, the proposed framework is evaluated in a series of challenging real-world scenarios. First, we examine the performance across various tipping margin angles and motion aggressiveness levels. The following video is shown at 4x speed.

Low aggressiveness,
Transported Object (2.5 × 2.5 × 15 cm)

Medium aggressiveness,
Transported Object (2.5 × 2.5 × 15 cm)

High aggressiveness,
Transported Object (2.5 × 2.5 × 15 cm)

Low aggressiveness,
Transported Object (2.5 × 2.5 × 20 cm)

Medium aggressiveness,
Transported Object (2.5 × 2.5 × 20 cm)

High aggressiveness,
Transported Object (2.5 × 2.5 × 20 cm)

Low aggressiveness,
Transported Object (2.5 × 2.5 × 25 cm)

Medium aggressiveness,
Transported Object (2.5 × 2.5 × 25 cm)

High aggressiveness,
Transported Object (2.5 × 2.5 × 25 cm)

Low aggressiveness,
Transported Object (2.5 × 2.5 × 30 cm)

Medium aggressiveness,
Transported Object (2.5 × 2.5 × 30 cm)

High aggressiveness,
Transported Object (2.5 × 2.5 × 30 cm)

Overview of the robustness test setup

Success rates across various tipping margin angles and motion aggressiveness levels.

Subsequently, the reactivity and robustness of our method are evaluated by executing non-prehensile transportation of a slender bottle, milk cartons, and a partially filled water cup in a quasi-static environment. Notably, the implementation remains based on the cuboid model (5 × 5 × 20 cm) without object-specific parameter tuning.

Transport a slender bottle

Transport milk cartons

Transport a partially filled cup of water

Non-prehensile transportation with frequently changing goal points

7. Generalization to a Different Platform

To demonstrate the versatility and hardware-agnostic nature of our framework, we conducted further experiments on a Rokae XMate CR20 robotic arm. The results show that our method can be readily applied to different hardware with minimal adaptation.

Non-prehensile transportation in extremely cluttered environments

Transport two slender water bottles

Transport three slender water bottles

Transport two objects stacked vertically (front view)

Transport two objects stacked vertically (side view)

8. Conclusion

This letter presents a risk-adaptive framework for non-prehensile transportation in quasi-static environments subject to dynamic disturbances. To enhance reactivity and resilience, the framework integrates a three-level safety mechanism with proactive periodic replanning. The underlying planning pipeline employs a hierarchical coarse-to-fine architecture, where a constrained path planner provides global guidance and an unconstrained optimizer refines the trajectory, effectively balancing trajectory quality and planning efficiency. Extensive experiments demonstrate the framework's efficiency and robustness. Future work will aim to address the identified limitations and extend the approach to dynamic environments.

References

  1. A. Heins and A. P. Schoellig, “Keep it upright: Model predictive control for nonprehensile object transportation with obstacle avoidance on a mobile manipulator,” IEEE Robot. Automat. Lett., vol. 8, no. 12, pp. 7986--7993, 2023.