Advancing the Success–Latency Frontier
for Latent World Models

Yao Zhang1,2,8Bin Yu3,2,8Shijie Lian4,2,8Haishan Liu5,2,8Changti Wu6,2,8Yu Wu1,†Kai Chen2,7,8,†

1Wuhan University   2Zhongguancun Academy   3Harbin Institute of Technology
4Huazhong University of Science and Technology   5Nanjing University   6East China Normal University
7Zhongguancun Institute of Artificial Intelligence   8DeepCybo
† Corresponding authors · Work done during internship at DeepCybo

DynaGoal-Shift

Original models, without fine-tuning. Watch the highlighted goal switches, drift reversal, and doorway motion. Event indicators follow the recorded simulation time.

Cube

Goal switch
Goal A active0.00 s

Goal A → B at 1.25 s

The goal switches at control step 25. Success criterion met.

TwoRoom

Moving doorway
Door moving ↓0.00 s

Door shifts down, then returns

The agent adjusts its route before crossing the moving doorway. Success criterion met.

PushT

Drift reversal
Drift ↙0.00 s

External drift reverses at 5.10 s

The orange dashed arrow marks external drift on the gray T; it reverses halfway through. Success criterion met.

Reacher

Goal switch
Goal A active0.00 s

Goal A → B at 3.00 s

The goal switches at control step 75. Success criterion met.

DynaGoal-Delay

An imposed 800 ms response delay makes the observation-to-action gap visible. The environment continues evolving while a new plan is pending. Cube, Reacher, and PushT use the same initial cases as above; TwoRoom uses a separate recorded case.

Cube

800 ms delay
NEW PLAN PENDING
800 ms
ObserveWait 800 msApply plan

Initial action held; environment keeps evolving.

Observed 0.00 sPlan ready 0.80 s
Control toward the switched goal with delayed plans. Success criterion not met.

TwoRoom

800 ms delay
NEW PLAN PENDING
800 ms
ObserveWait 800 msApply plan

Initial action held; environment keeps evolving.

Observed 0.00 sPlan ready 0.80 s
Cross a doorway that moves during the response interval. Success criterion met.

PushT

800 ms delay
NEW PLAN PENDING
800 ms
ObserveWait 800 msApply plan

Initial action held; environment keeps evolving.

Observed 0.00 sPlan ready 0.80 s
Continue control through drift and reversal. Success criterion not met.

Reacher

800 ms delay
NEW PLAN PENDING
800 ms
ObserveWait 800 msApply plan

Initial action held; environment keeps evolving.

Observed 0.00 sPlan ready 0.80 s
Respond to a goal change with delayed plans. Success criterion not met.