Skip to content

Point Tracking

If you didn't read the overview section yet, please do so before reading the following. We will walk you though point-tracking the street-car shot as illustrated in the overview section.

Picture

Let's go ahead and add a point tracker on the layer:

Picture

When reviewing the motion of the shot, we can see that the sides of the street car move in a perspective motion. Notice that the windows of the street car show not only reflections but also reveal the background behind them, so trying a track in these regions is highly likely to fail.

Before adding a new marker, we will first set the New Marker Model setting to Perspective since all markers we want to track need to track a perspective motion.

Picture

Note that this can be changed on each marker afterwards by changing the Tracking Model parameter of the marker.

Picture

The Tracking Model of the marker indicates what type of motion it should try to track for this marker only. This is not the same as the Model Transform Type parameter, which we will go through in a section below.

Adding Markers

Adding a marker can be done directly in the Viewer by activating the add mode on the left toolbar and clicking where desired in the image.

Picture

Note that the marker user interfaces allow you to control the following parameters of the marker:

  • The center (or tracked point) of the marker is the small cross in the middle of the marker
  • The inner rectangle with 4 corners represent the pattern window: this is what you want to track. Note that the 4 corners need-not be a rectangle: when tracking a perspective model, the 4 corners will move freely, like a CornerPin..
  • The outter rectangle represents the search region: this is how far it will look to the next/previous frame when tracking. If the motion of the shot is very large between each frame, it may fall outside the search window and fail to track.

The marker also has an Offset parameter, which will go over later, but that can be moved in the viewer by dragging the center point while holding Ctrl.

Whenever you add the marker for the first time, you also set a pattern keyframe, visible on the timeline row of the Marker.

Picture

The pattern keyframe will be the reference used for tracking the next frames (when tracking forward, otherwise previous frames when tracking backward), until the next pattern keyframe is encountered. You can remove as needed the pattern keyframes from the timeline or from the viewer's top toolbar. Note that you need at least one keyframe in order to track correctly.

Pattern keyframes are usually added on clear frames with a lot of details where the tracker is most likely to find similarities with the tracked frames. If the content of the tracked object changes significantly over time, consider adding a new pattern keyframe.

Motion Model

Depending on what kind of model transform type you want to use to match-move other elements (or stabilize the footage), different scenarios are possible to perform the tracking:

  • Tracking a Location model requires only a single point to track.
  • Tracking a Location+Rotation or Location+Scale requires at least 2 points to track
  • Tracking a Location+Rotation+Scale or Affine requires at least 3 points to track
  • Tracking a Perspective model requires at least 4 points to track

The minimum number of markers to track is a minimum: the more markers you track that have a similar motion, the more accurate the resulting motion will be.

In Autograph, you will notice that when tracking a marker with a Tracking Model other than Location, the 4 corners of the pattern of the marker will be deformed. In this case, it is possible to use a single marker to track a model requiring multiple points since it already tracks 4 corners + center. However, tracking multiple markers that follow the same motion may yield stronger results, depending on the shot.

Tracking

To start the tracking, you may need to select the desired markers when the Track Selected Markers mode is selected in the viewer's top toolbar. Let's increase the search window horizontally of our marker, since we see the street car moves faster per frame than the default 20px setting.

Picture

In our case, since we created the first pattern keyframe in the middle of the sequence, we will need to both track forward and backward using the buttons from the viewer's top toolbar.

What to do when the tracker stops

After tracking a few frames, the tracker stopped.

Picture

What we can do here is try to change the following parameters and start tracking again from the failed frame

  • Increase the search window again: since the pattern may have gotten bigger, the search window may get too small
  • Check Normalize Intensities in the tracker settings menu: since our shot contains a few reflections and changes of lighting this may help
  • Increase the maximum number of iterations: sometimes when the reference pattern keyframe is very different from the frame to track, the tracker needs to internally perform a lot of searches, which are bounded by this parameter.
  • Add a new pattern keyframe by clicking on the corresponding in the toolbar: this will help as next frames to track are closer to the new keyframe and are likely to find a match more easily.

If it still continues to fail, consider tracking another point of the shot that follows the same motion. Remember that the tracker needs to have textured elements with edges: a flat surface such as a poorly lit greenscreen without any features will be impossible to track.

In our case, the problem was a search window too small. Let's launch again the tracker.

Reaching the edge of the frame

Picture

The tracker successfully tracked the marker until it reached the edge of the frame, where it began to be out of sight, causing the tracker not to find a corresponding match.

This is where the Offset parameter of the marker is useful: you can drag it using Ctrl when moving the center of the marker.

Picture

What we are going to to do is offset the marker to another feature following the same motion but that is still in the shot. The tracker will apply the offset and apply it to the marker's original center


Picture

Once all points following the same motion are tracked, we can move on to apply the tracked model.