Points and Negative points

Video masking differs from image masking because it requires tracking the target object across all frames to ensure accurate inpainting. Rather than manually drawing a mask, you simply specify the object you want to track by adding points, and the system handles the rest.

We want to change the Tony's shirt to spider-man suit in the below video.

We’ll mark positive and negative points to mask his shirt. Positive points indicate the areas you want to select, while negative points define regions to exclude. By placing a few points on his shirt, we can generate an mask like this.

After placing a few points on his shirt, the system masks Tony's entire body. However, since we want to preserve his face, we’ll add negative points to exclude it from the mask. We can get an mask like this.

Now, we enter prompt "a man wears spider man suit" and hit a Start button.