Back to Blog

Using Facebook Experiments

Using Facebook Experiments
Madeha Irshad

Test and learn to make more impactful decisions (at no additional cost).

According to Facebook, “Experiments combines multiple types of tests, formerly labeled as Test and Learn and Split Testing, allowing marketers to A/B test campaigns and measure conversion and brand lift in one place.”

Facebook has categorized the tests/experiments into three categories:

  • A/B Test
  • Holdout Test
  • Brand Study
What is A/B testing and how can you utilize it for your campaigns?

A/B testing is a great way to assess one or more ads or targeting options to understand which is performing best. Facebook splits the exposure of both testing options to determine which variable is most effectively contributing to success.

Running A/B tests is a great way to determine what you should double-down on in your advertising strategy. By continually testing and comparing different creative, copy, audiences, we are able to provide more data to help understand your audience better.

What is a Holdout Test?

This test measures the incremental conversion lift produced by a specific campaign – or the culmination of all your active campaigns. Your audience will be randomized and divided into control and exposed groups, allowing you to determine the difference your advertising makes on conversion activity, such as purchases, leads or app installs. Stated differently, holdout tests help you determine how much your advertising compels people to take actions compared to the holdout group.

Conducting a Brand Survey with Facebook Experiments

This test lets you use a brand survey to measure what incremental effect your advertising has on brand awareness, perception or recall. Your audience will be placed into control and exposed groups, ensuring that Facebook can create a baseline for your brand, reflecting relative and absolute lift when contrasting control vs. exposed survey results. Budget minimums apply depending on where you’re trying to run your brand survey to help yield a sufficient sample and reliable results.

How Does Facebook Create a Control Group?

All Experiments with a single cell use a 10 percent holdout when you measure cost per conversion lift. This means that based on your targeting criteria, Facebook will prevent 10% of your audience from seeing your ads, delivering a survey to these users to develop a baseline. A/B tests with a holdout may have a larger holdout percentage – or require a larger sample size – depending on the number of variants in the test.

Want to Learn More?

Give us a shout and let us know how we can help.

More from the Blog

Celebrating Black History Month, Insights from Sabrina Clarke Duffy, Senior VP at Hotspex

Celebrating Black History Month, Insights from Sabrina Clarke Duffy, Senior VP at Hotspex

As we honour Black History Month, we recognize the continued significance of discussions on Diversity, Equity, and Inclusion. At Hotspex Media, we had the opportunity to explore the personal story of Sabrina Clarke Duffy, our Senior Vice President.

Read Story
Raconteur Feature: What Hybrid Working Means for Sales Teams

Raconteur Feature: What Hybrid Working Means for Sales Teams

While flexibility and autonomy may help with productivity and work-life balance, in people-facing roles like sales, being around people can help build comradery and confidence. 

Read Story
Why you Need to Invest in Your Website's Mobile User Experience

Why you Need to Invest in Your Website's Mobile User Experience

Prioritizing a mobile-friendly design can enhance conversions, safeguard budgets, maintain customer satisfaction, and preserve brand reputation in the digital landscape.

Read Story