A/B tests

An A/B test shows different versions of one video to different viewers, so you can keep the one that does best. Every plan has them; how many at once depends on the plan.

How many A/B tests can I have?

Your plan sets how many videos can have the A/B test switched on at once:

  • Free: 1
  • Web Only: 1
  • Studio: 5
  • Broadcast: 10
  • Broadcast Network: 20
  • Enterprise: 50

The A/B test card on a video's page also tells you. Paid and self-hosted videos have no A/B test card.

How do I run a test?

  1. Open a video and turn on the switch on the A/B test card.
  2. Choose Add another version and upload each extra file. Each one counts toward your storage.
  3. Wait until each file says Ready. A test can start when each file has finished encoding.
  4. Tick the files to include and set a Weight for each, or leave weights blank for an even split. Weights are percentages that add up to 100.
  5. Pick a Measure and choose Start test.

Each viewer gets one file and keeps it.

What can a test measure?

Plays per viewer
How often a viewer plays the video.
Watch time per play
How long each play lasts.
CTA clicks
Clicks on the call-to-action button.
Leads
Lead forms filled in.

CTA clicks and leads come from the embedded player only. Results are compared as a rate, so a file shown to more people isn't favoured for that.

How do I end a test?

While a test runs, the card shows each file's Plays, Watch time per play, CTA clicks and Leads, and suggests a winner when it can. Choose the file to keep, then End test and keep this file. The choice is yours, and the last test's results stay on the card.

How do I turn the A/B test off?

Turn off the switch on the card. It is refused while a test is running, so end the test first. If there are extra files, you are asked to confirm, because turning it off removes them.

Why can't I change the video file?

The files can't change while an A/B test runs. End the test first.

Still stuck?

Ask the assistant at the top right of any dashboard page. It knows your account and can do most things for you. On a paid plan you can also open a support ticket.

Go to Support

Locked out, or need a change only we can make? Contact us about your account.