AI & Services

Tencent WorldCrafter: An Open-Weight Video World Model That Remembers by Camera Viewpoint.

Tencent's WorldCrafter is a video world model that pulls scene information from memory based on the camera viewpoint to keep space consistent. See the 16fps specs, how to run Base and Fast, and the license terms.

· Huuush

Tencent WorldCrafter: An Open-Weight Video World Model That Remembers by Camera Viewpoint

Key takeaways

  1. 1WorldCrafter is an open-weight video world model that keeps scenes consistent by querying an implicit 3D-aware memory with the camera viewpoint.
  2. 2It starts from an image or text, with default settings of 384×640 at 16fps, 50 steps for Base, and 6 steps for Fast (12 steps for the first T2V chunk).
  3. 3The code and weights may be used only for academic purposes, and commercial or production use is prohibited.
Collection of virtual world scenes generated by WorldCrafter
Source: X @drexubery

Tencent (TencentARC) has released the code and weights of WorldCrafter, an open-weight video world model. So that space and objects stay connected when the camera looks away and then comes back, it pulls the information it needs from memory based on the camera viewpoint to generate video. Starting from a single image or text, the model generates a world you can explore for several minutes by moving the camera.

The weights were released on Hugging Face on September 21, 2026 at 23:30 (KST), and the paper, arXiv:2609.24984, was submitted on September 22 at 02:57 (KST).

Loading X post.

Unable to load the X post. Please try again.

It finds memories by camera viewpoint instead of building a separate 3D scene

If you just chain the previous frame like ordinary video generation, the look of a place you have already seen, or the objects in it, can change when the camera comes back. WorldCrafter maintains an implicit 3D-aware memory that compresses past frames and camera information. Instead of building a separate finished 3D mesh and rendering it every time, it reads the information needed for the current viewpoint from memory, conditioned on the current camera position and orientation, and passes it to the next video generation step.

You can think of it as asking, "What did I remember about where the camera is looking now?" rather than redrawing the whole scene. That is why it is designed to keep space and objects continuous, even with camera moves that shift the viewpoint or return to an earlier position.

Loading X post.

Unable to load the X post. Please try again.

16fps exploration video that starts from an image or text

WorldCrafter supports image-to-video (I2V), which starts from a single image, and text-to-video (T2V), which starts from text. The official settings are 384×640 resolution at 16 frames per second. Output continues in 33-frame chunks, and one chunk is about 2 seconds. If you keep feeding camera motions, you can chain several chunks to explore a space for several minutes.

There are two public weights. WorldCrafter-Base is the base model, and WorldCrafter-Fast is a distilled model for faster generation. Default inference steps are 50 for Base and 6 for Fast, and Fast uses 12 steps for the first T2V chunk. The ratio by which steps shrink does not mean the same multiple in actual generation time.

Install and run WorldCrafter-Fast

The official repo describes a Linux and Python 3.11 environment and lists one or two NVIDIA H200 GPUs as its verified setup. The public guidance gives no separate minimum VRAM figure. Below are the README's uv install and weight download commands.

sudo apt-get update
sudo apt-get install -y ffmpeg
uv sync --project uvenv --frozen --extra demo
source uvenv/.venv/bin/activate

hf download TencentARC/WorldCrafter-Fast --local-dir weights/WorldCrafter-Fast
hf download TencentARC/WorldCrafter-Base --local-dir weights/WorldCrafter-Base

Running Base also needs shared components from the Fast folder, so download both weight folders. The official inference example for making video from an image with Fast is as follows.

python inference.py --model-type fast --mode i2v   --image-path test/I2V/06_waterfall/image.png   --prompt test/I2V/06_waterfall/prompt.txt   --camera-path test/I2V/06_waterfall/camera.npy
python inference.py --model-type fast --mode t2v \
  --prompt test/T2V/02_tokyo_street/prompt.txt \
  --camera-path test/T2V/02_tokyo_street/camera.npy

To start from text, specify --mode t2v and a prompt. You can also pass the camera trajectory as actions instead of a .npy file. For example, --actions "forward1 yaw_left30" specifies a path that moves forward and then turns left. If running models locally is new to you, see also this guide to running models with Unsloth.

Code and weight license is limited to academic use

The LICENSE.txt in the WorldCrafter repo allows the project code and the public parameters and weights to be used for academic purposes only and prohibits commercial or production use. So even though the weights and code are public, this is not a license you can use for a commercial service. Some third-party components are covered by each component's original license. See also what open-weight models and their licenses mean.

Sources

Frequently asked questions

What does WorldCrafter do?
It is a video world model that starts from a single image or text and generates explorable video that follows camera motion. It is designed to keep space and objects consistent by reading information from memory based on the camera viewpoint.
What resolution and frame rate does WorldCrafter support?
The official default settings are 384×640 resolution at 16 frames per second. It generates by chaining 33-frame chunks, and one chunk is about 2 seconds.
How many times faster is WorldCrafter-Fast than Base?
Default inference steps are 50 for Base and 6 for Fast, with 12 steps for the first T2V chunk. The difference in step count does not guarantee the same multiple in actual wall-clock speed.
Can I use WorldCrafter commercially?
No. The public project license limits use of the code and weights to academic purposes and prohibits commercial or production use.
What GPU and VRAM do I need to run it?
The official demo docs say it was verified on one or two NVIDIA H200 GPUs, but they give no minimum VRAM figure.

Related articles