Wan 2.1 Fun Control Camera: Multi-Camera Motion with Low VRAM
Introduction
The Wan 2.1 Fun Control Camera (v1.1) is an advanced AI model designed for generating videos with dynamic camera movements from static images. It supports multiple camera motions within a single video, such as panning, tilting, and zooming, all while maintaining low VRAM usage.Key Features
Supports multiple camera motions in a single video
Low VRAM requirements (5–6 GB for 1.3B model)
Compatible with ComfyUI and One Video Wrapper
Enhanced image quality with Tile Control LoRA
Supports both 1.3B and 14B parameter models
Installation Guide
1. Install ComfyUI Desktop
Download and install ComfyUI from the official website:https://comfyui.github.io/:contentReference[oaicite:33]{index=33}
2. Download One Video Wrapper
Obtain the One Video Wrapper, which includes example workflows and necessary scripts.3. Download AI Models
ComfyUI-WanVideoWrapperhttps://github.com/kijai/ComfyUI-WanVideoWrapper
Wan2.1-Fun-V1.1 Control-Camera
14B : https://huggingface.co/alibaba-pai/Wan2.1-Fun-V1.1-14B-Control-Camera
1.3B : https://huggingface.co/alibaba-pai/Wan2.1-Fun-V1.1-1.3B-Control-Camera/
4. Update One Video Wrapper
Ensure your One Video Wrapper is up to date to access the latest features and example workflows.Workflow Setup
1. Load the Model
In ComfyUI, use the Model Loader node to select your downloaded .safetensors file.2. Configure VAE and Text Encoder
Set up the VAE and Text Encoder nodes as per standard ComfyUI configurations.3. Set Up Image-to-Video Node
Utilize the updated Image-to-Video node from the One Video Wrapper. This node now includes options like start image, end image, control embed, temporal mask, and extra latent.4. Add Camera Control Nodes
Incorporate Camera Control nodes from the Anime Diff custom nodes. These nodes allow you to define motion types (e.g., pan, tilt, zoom) and adjust speed settings.5. Configure Frame Settings
For each camera motion, specify the number of frames. For example:Pan left: 40 frames
Zoom out: 41 frames
Total frames: 81
6. Visualize Camera Trajectory
Use the visualization tools to preview the camera movement paths before rendering.7. Enhance Quality with Tile Control LoRA
After initial rendering, apply the Tile Control LoRA to sharpen details, especially when using zoom-out motions.Video Tutorial
For a step-by-step visual guide, watch the following video:Performance Tips
Use the 1.3B model for lower VRAM usage (5–6 GB)
Apply Tile Control LoRA for enhanced detail
Utilize context options (uniform standard, loop, static standard) for longer videos
Experiment with frame settings to achieve desired motion effects
Conclusion
The Wan 2.1 Fun Control Camera offers a powerful yet resource-efficient solution for generating AI-driven videos with dynamic camera movements. By following this guide, you can set up and customize your workflows to create engaging visual content.Feel free to share your experiences, tips, or questions in the forum thread below.