Skip to content

FuouM/ComfyUI-MatAnyone

Repository files navigation

ComfyUI-MatAnyone

MatAnyone in ComfyUI (Remove background)

Stable Video Matting with Consistent Memory Propagation: https://github.com/pq-yang/MatAnyone

Scaling Video Matting via a Learned Quality Evaluator: https://github.com/pq-yang/MatAnyone2

Download matanyone.pth from https://github.com/pq-yang/MatAnyone?tab=readme-ov-file#download-model

Download matanyone2.pth from https://github.com/pq-yang/MatAnyone2?tab=readme-ov-file#-inference

checkpoint/
    matanyone.pth
    matanyone2.pth
Matanyone.Compare.mp4

Workflow

The extension now includes the MatAnyone2Video node, which runs the improved MatAnyoneV2 model for higher-quality and more robust video matting.

Workflow: workflow/workflow_mat_anyone.json

matanyone_example (Not a workflow-embedded image)

Inputs:

  • src_video
  • forground_mask (IMAGE) or foreground_MASK (MASK): The input mask. IMAGE option will automatically convert a black/white image to a mask. At least one option must be given.
  • solid_color (optional): The solid color to create a screen. Defaults to Green Screen.
  • mask_frame: The input mask's index (defaults to 0). Support first (0), last and middle frame.
  • n_warmup: Number of iterations to warm up the model. Defaults to 10.

Memory Management Inputs:

  • max_internal_size (optional): Resizes the internal processing resolution to save memory (e.g., 360, 480). Default is -1 (full resolution).
  • max_mem_frames (optional): The number of key frames kept in high-resolution working memory. Default is 5.
  • use_long_term (optional): Limits active memory scaling by compressing older frames into long-term prototype memories, preventing OOM over time. Default is False. (Useful for long videos)

Your input mask won't actually be in the final matte. Instead, the warmup process generate a new input mask, which is then propagated throughout the video.

Additional Inputs for V2:

  • r_erode (optional): The radius for morphological erosion applied to the foreground_mask before processing (defaults to 0). Useful for refining rough masks.
  • r_dilate (optional): The radius for morphological dilation applied to the foreground_mask before processing (defaults to 0).

Credit

@InProceedings{yang2025matanyone,
    title     = {{MatAnyone}: Stable Video Matting with Consistent Memory Propagation},
    author    = {Yang, Peiqing and Zhou, Shangchen and Zhao, Jixin and Tao, Qingyi and Loy, Chen Change},
    booktitle = {arXiv preprint arXiv:2501.14677},
    year      = {2025}
}

@InProceedings{yang2026matanyone2,
   title     = {{MatAnyone 2}: Scaling Video Matting via a Learned Quality Evaluator},
   author    = {Yang, Peiqing and Zhou, Shangchen and Hao, Kai and Tao, Qingyi},
   booktitle = {CVPR},
   year      = {2026}
}

About

MatAnyone in ComfyUI

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Languages