manipulation under uncertainty
Manipulation under uncertainty is grasping and handling objects when the robot does not know things exactly. In the real world, the camera's guess of where an object sits is a little off, its shape is only roughly known, how slippery its surface is can only be estimated, and the sensors themselves are noisy. Manipulation under uncertainty is the art of succeeding anyway — picking the cup up cleanly even though every number the robot has about it is a bit wrong.
It helps to see where the fog comes from. The object's pose (its position and how it is turned) is fuzzy because vision is imperfect. Its shape may be unknown if the robot has never seen this exact item. Friction — how much grip the surface offers — is hard to measure and changes with dust or moisture. And the robot's own touch and position sensors drift and jitter. Any one of these alone might be survivable, but they stack up, and a plan that assumed perfect numbers can miss the object entirely or let it slip.
The cure is not to pretend the numbers are perfect but to plan for being wrong. A robot might choose a grasp that still works even if the object is a centimeter off from where it looked, squeeze a little extra to fight unknown slipperiness, approach slowly and use touch to confirm contact before committing, or grab and then check whether it actually has the object. Designing actions that tolerate error like this — rather than demanding precision the world will never give — is the core skill, and it is what separates a lab demo from a robot that works in a messy kitchen or warehouse.
The camera says a mug's handle is here, but it could be off by a centimeter. So the robot grasps the wide body instead of the thin handle, because a grip on the body still lands even if the estimate is wrong.
Choosing a forgiving grasp: a wide target survives a wrong guess that a narrow one would not.
The trick is not better guesses but more forgiving actions — grasps and moves that still succeed when the object turns out to be a bit off from what the sensors reported.