Global Tech News Technology news from original sources.
AI

Two Test Pushes Expose Object-Blind Robot Predictions

Industrial robot arm working beside factory machinery

A physics-based check helped a robot model choose the right object evidence in 73% of 300 simulated cases, compared with 52% for a standard consistency score. The method, called IMPLY, asks whether several predicted movements can all be explained by the mass and friction of the object the robot has actually observed. Two independent researchers reported the result in an unreviewed preprint posted on September 11.

A world model lets a robot preview what an action might do before it moves. Given a possible push, it generates a short predicted future. Existing safety checks often favour predictions that agree with one another, but a model can be consistently wrong if it ignores whether the current object is heavy, light, rough or slippery.

IMPLY begins with two observed pushes on the object in front of the robot. The model then predicts how that object will move at five new push speeds. A simulator works backwards from each prediction to estimate the mass and friction it implies. If one plausible pair of properties explains both the observed pushes and the generated futures, the prediction receives a better score.

The researchers first used 200 simulated objects and four deliberately different predictors, including one with correct physics and one that always predicted the behaviour of a typical object. They then adapted the V-JEPA 2-AC robot model with 1,500 simulated episodes and tested it on 300 new objects. Each object was evaluated once with its own calibration pushes and once with pushes borrowed from another object.

In the controlled test, IMPLY selected the correct-physics predictor 98% of the time. In the learned-model test, it preferred the evidence from the actual object in 73% of cases; the ordinary self-consistency measure did so in 52%. The gap shows that agreement among generated futures is not enough when the model may have ignored the physical object that produced them.

The next test has to move beyond simulation, one pushing task and a single adapted model. IMPLY also requires two calibration actions and a usable physical simulator. Physical robots must show whether it still distinguishes good predictions when sensors are noisy, contacts vary and several futures are possible from the same action.

Related coverage

Sources