Using object detection for mask tracking

You can use object detection to help you apply a mask to a moving object in your video clips. Object detection uses artificial intelligence (AI) to recognize common objects and automatically track them throughout the video clip. If the object is detected, the mask is automatically adjusted from frame to frame. Fine-tuning is required if the object is obscured and tracking is lost at any point. If the object isn’t recognized, then you can edit the shape mask from frame to frame. For more information, see To edit a shape mask from frame-to-frame.

To use object detection for mask tracking

1 In the Timeline, select a clip that you want to mask, and click Mask to display the Mask panel. Click Create Clip Mask to add a mask directly to the clip.

2 In the Mask panel, click the Create Shape button.

3 In the Mask preview area of the Player panel, click the Brush tool

By default, the Smart Edge check box is enabled, so object edges will be auto-detected.

Note: You can use any of the tools in the Brush flyout to select your object, and you can choose to unmark the Smart Edge check box if edge detection isn’t needed.

4 After you object is selected, click the Apply button

5 In the Shape area, if the object is recognized, you can click the Track button

(the button is not available if no object is recognized).

Depending on the size and complexity of the clip and your computer system, it might take a few moments to process.

6 Review the tracked mask to see if any adjustments need to be made. Before making manual adjustments, you can try changing the Sensitivity setting (below the Track button). You can then click the Track button again to regenerate the tracking result. Lower Sensitivity values include more areas in the mask; higher values include less areas in the mask.

For more information about fine-tuning a mask, see To edit a shape mask from frame-to-frame.

7 In the Mask panel, click the Function tab, and choose the Mask Properties that you want.