World Model VLA Fusion
World model VLA fusion is the route emphasized in 170: 【具身季报 26Q2】世界模型大风不停,和不想被贴标签的人: World Models and Vision Language Action Models should not be treated as a clean either-or. Chen Zhe Peter argues that VLA models are strong at instruction/action generation, while world models improve state prediction, environment modeling, and future-outcome simulation.
The source uses Cosmos 3, Physical Intelligence’s Pi 0.7, and Generalist Gen 1 to show three variants of the convergence. Cosmos 3 represents a productized omni-world-model stack, Pi 0.7 adds lightweight future-image prediction to a VLA route, and Generalist resists labels by emphasizing direct physical-interaction data.
从会跳舞到有感知,触觉是机器人通往智能的门票吗?| S10E19 adds a touch-modality extension to the same convergence. Eric Li Zhiqiang / 李志强 says VLA and world-model builders are reaching a vision/language ceiling in physical tasks, so Tactile Sensing and Tactile Transformer Encoder may be needed for robot models to reason about force, contact, texture, softness, and slip.
Key Claims
- Robot action policies benefit from predicting how the environment will change, not only from mapping vision and language directly to actions.
- The labels “VLA,” “world model,” and “world action model” may be temporary as robot models absorb video generation, action-conditioned prediction, and policy generation into one architecture.
- The fusion view creates a middle path between Aether AI’s stricter Causal World Models thesis and practical VLA deployment work by companies such as Physical Intelligence.
- A tactile extension would make the fusion multimodal in the physical sense: not just seeing and predicting future images, but sensing contact forces while acting.
Connections
- World Models, Vision Language Action Models, and World Action Models — model families being fused.
- Cosmos 3, Physical Intelligence, and Generalist — examples in the source.
- Embodied AI and Physical AI — deployment contexts where the fusion matters.
- Tactile Sensing, Optical Tactile Sensing, TouchNet, and Tactile Transformer Encoder — touch modality, sensor route, dataset, and encoder proposed by the What’s Next source.