INTERACTIVE WORLD MODELS · PROJECT PAGE

H3-World: Turning Language Understanding
into World Control

H3-World enables character and camera control across diverse visual environments.

Danze Chen^1,2,*Zeqing Wang^1,2,*Ziyue Lin³Xingyi Yang^3,*Yeying Jin^1,2,*

¹ Tencent² National University of Singapore³ The Hong Kong Polytechnic University

♣ Research internship at Tencent　 · 　* Corresponding authors　 · 　◆ Project Leader

▤ Abstract ⌘ Demos ◎ Method

H3-World across four visual environments — **H3-World** turns language instructions into controllable character, camera, and world behavior.

World Control Demos

Language becomes direct, visible control across characters, cameras, and environments.

Neon alley · fast pan right

First-person camera control in a neon-lit city.

Lantern cave · strafe left

First-person lateral movement in a complex cave environment.

Dune oasis · strafe right

Third-person navigation across an open desert scene.

Cathedral paladin · tilt up

Third-person camera motion in a detailed fantasy interior.

From understanding
to control.

A world model should do more than recognize what is happening. It should understand what a person wants to happen next.

H3-World provides one language for character, viewpoint, motion, and environment, keeping directions connected instead of treating them as isolated effects.

CORE IDEALanguage is the control surface for an interactive visual world.

Method

H3-World learns language-aligned actions while preserving the generative prior of the world model.

Temporally specified control

Actions can change over time while the generated sequence remains visually coherent.

Action controllability

Language-aligned action conditioning steers motion without discarding scene content.

CharacterIdentity, action, and purpose.

CameraViewpoint, movement, and composition.

EnvironmentPlace, light, weather, and response.

Compositional generalization

H3-World transfers control to unseen combinations of visual environments and actions.

Citation

If H3-World supports your work, cite the project.

@article{chen2026h3world,
  title={H3-World: Turning Language Understanding into World Control},
  author={Chen, Danze and Wang, Zeqing and Lin, Ziyue and Yang, Xingyi and Jin, Yeying},
  year={2026}
}