BridgeWAM: Bridging Video and Action Experts via Latent Bridge Queries
Abstract
BridgeWAM decouples video and action experts via latent bridge queries to improve action prediction efficiency and generalization in world action models.
World Action Models (WAMs) commonly couple video and action experts through dense, layer-wise Mixture-of-Transformers (MoT) attention, exposing action prediction to irrelevant visual features while enforcing matched expert depths. This coupling hinders selective visual-feature use and introduces redundant computation. We introduce Bridge-of-Experts (BoE), instantiated as BridgeWAM, which aggregates visual, language, and proprioceptive priors through 32 Latent Bridge Queries (LBQs) into a shared, limited latent space. Joint video-action supervision lets action gradients guide the Video Expert toward representations better suited for action prediction, while the Action Expert learns to selectively retrieve task-relevant information through cross-attention. Decoupling expert depths and reusing LBQs during action denoising yield a 5.06B model with a 30-layer Video Expert and a two-layer Action Expert, achieving 98.25% success on LIBERO and 72.24% pooled success on LIBERO-Plus, demonstrating effective task execution and strong generalization with an ultralight action head. Ablations support joint representation adaptation and unified LBQ conditioning. Relative to Fast-WAM, BridgeWAM reduces single-sample inference FLOPs by 28.72% in simulation profiling and real-robot latency to 77.1 ms (a 2.47-fold speedup). Qualitative experimental results further indicate preferential attention to target objects and task destinations across perturbations.
Community
We hope this work offers a new direction for WAM architecture design beyond MoT: a learnable, capacity-limited latent space that guides the Video Expert to produce representations better suited for retrieval by the Action Expert, while enabling a lightweight Action Expert with reduced redundancy to use task-relevant information more effectively.
This is an automated message from the ResearchStudio team.
We created an interactive ResearchStudio Reel for this paper. It includes a visual poster, a video, and a blog, all available for download in editable formats.
Open the ResearchStudio Reel →
Download all files from Hugging Face
Please give this comment a thumbs up if you find the Reel helpful!
Want to explore or create Reels for more papers? Visit the ResearchStudio demo.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- V-JEPA Policy: Building Effective World-Action Models on Predictive Visual Latents (2026)
- Breaking the Vision-Action Shortcut: Latent Interface Training for Generalizable Robotics Foundation Models (2026)
- The Right Future for Action: Learning Action-Relevant Predictive States in World Action Models (2026)
- CSWAM: Better Causal Semantic Representations for Out-of-Distribution Generalization in World Action Models (2026)
- Native Action-Prior Learning from Videos for World Action Models (2026)
- DeltaWAM: Delta World Action Models for Bimanual Manipulation (2026)
- Sparse-WAM: Accelerating World Action Models via Action-Guided Sparse Imagination (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2610.14746 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
