Real-time novel view synthesis using WorldFM for Daydream Scope.
Takes a single reference image and generates an explorable 3D scene. Navigate the scene with WASD keys and mouse, or use the slider controls.
- Panorama generation - Expands the reference image into a 360-degree panorama
- Depth estimation - Generates a 3D point cloud from the panorama using MoGe
- Point cloud rendering - Renders the point cloud at the current camera pose (per-frame)
- Diffusion synthesis - Runs WorldFM to produce a photorealistic output (per-frame)
Steps 1-2 run once at load time (may take several minutes). Steps 3-4 run each frame during streaming.
- NVIDIA GPU with 24GB+ VRAM (RTX 4090 recommended)
- CUDA 12.4+
- git (for auto-cloning the WorldFM repo on first load)
Install the plugin in Scope:
Settings > Plugins > Browse to this folder > Install
On first load, the plugin automatically clones the WorldFM repo (with submodules) to ~/.daydream-scope/repos/worldfm. Model weights are downloaded via Scope's artifact system. No manual setup required.
- Set a Reference Image (path to any image file)
- Start streaming — the scene will build automatically (first load takes several minutes)
- Navigate with WASD/mouse or adjust sliders
| Parameter | Type | Default | Description |
|---|---|---|---|
| WorldFM Repo Path | str | "" | Optional. Leave empty to auto-clone |
| Reference Image | str | "" | Path to the reference image |
| Model Variant | 1-step / 2-step | 2-step | Speed vs quality tradeoff |
| Image Size | 256-1024 | 512 | Output resolution |
| Render Size | 256-1024 | 512 | Point cloud render resolution |
| Parameter | Type | Default | Range | Description |
|---|---|---|---|---|
| CFG Scale | float | 4.5 | 0-15 | Classifier-free guidance |
| Move Speed | float | 0.05 | 0.001-0.5 | WASD translation speed |
| Look Sensitivity | float | 0.003 | 0.0005-0.02 | Mouse rotation speed |
| Vertical Speed | float | 0.05 | 0.001-0.5 | Space/Shift speed |
| Yaw Offset | float | 0.0 | -180 to 180 | Manual yaw (degrees) |
| Pitch Offset | float | 0.0 | -90 to 90 | Manual pitch (degrees) |
| Distance Offset | float | 0.0 | -5 to 5 | Camera distance |
| Multi-step Mode | bool | false | - | Higher quality, slower |
| Multi-step Count | int | 14 | 4-50 | Steps when multi-step on |
- WASD - Move forward/left/back/right
- Mouse - Look around
- Space - Move up
- Shift - Move down
Edit code, then click Reload next to the plugin in Settings > Plugins. No reinstall needed during local development.