Back to Blog
Using Facebook Experiments

Using Facebook Experiments

Madeha Irshad

Test and learn to make more impactful decisions (at no additional cost).

According to Facebook, “Experiments combines multiple types of tests, formerly labeled as Test and Learn and Split Testing, allowing marketers to A/B test campaigns and measure conversion and brand lift in one place.”

Facebook has categorized the tests/experiments into three categories:

  • A/B Test
  • Holdout Test
  • Brand Study
What is A/B testing and how can you utilize it for your campaigns?

A/B testing is a great way to assess one or more ads or targeting options to understand which is performing best. Facebook splits the exposure of both testing options to determine which variable is most effectively contributing to success.

Running A/B tests is a great way to determine what you should double-down on in your advertising strategy. By continually testing and comparing different creative, copy, audiences, we are able to provide more data to help understand your audience better.

What is a Holdout Test?

This test measures the incremental conversion lift produced by a specific campaign – or the culmination of all your active campaigns. Your audience will be randomized and divided into control and exposed groups, allowing you to determine the difference your advertising makes on conversion activity, such as purchases, leads or app installs. Stated differently, holdout tests help you determine how much your advertising compels people to take actions compared to the holdout group.

Conducting a Brand Survey with Facebook Experiments

This test lets you use a brand survey to measure what incremental effect your advertising has on brand awareness, perception or recall. Your audience will be placed into control and exposed groups, ensuring that Facebook can create a baseline for your brand, reflecting relative and absolute lift when contrasting control vs. exposed survey results. Budget minimums apply depending on where you’re trying to run your brand survey to help yield a sufficient sample and reliable results.

How Does Facebook Create a Control Group?

All Experiments with a single cell use a 10 percent holdout when you measure cost per conversion lift. This means that based on your targeting criteria, Facebook will prevent 10% of your audience from seeing your ads, delivering a survey to these users to develop a baseline. A/B tests with a holdout may have a larger holdout percentage – or require a larger sample size – depending on the number of variants in the test.

Want to Learn More?

Give us a shout and let us know how we can help.

More from the Blog

New Report Highlights TikTok’s Rising Worth as a Promotional Possibility for SMBs

New Report Highlights TikTok’s Rising Worth as a Promotional Possibility for SMBs

In This Weeks News, a new report highlights TikTok’s Rising Worth for SMBs, Snapchat’s Developing a New ‘Snapchat+’ Subscription Service, and YouTube Shorts tops 1.5B logged-in monthly users.

Read Story
LinkedIn Adds Product Listings on Profiles, New Engagement Options to Build Your Brand Presence

LinkedIn Adds Product Listings on Profiles, New Engagement Options to Build Your Brand Presence

In This Weeks News LinkedIn adds new engagement options and product listings on profiles, Google offers to let ad rivals place YouTube ads, and Meta, TikTok, Google, and Twitter are all getting ready to signal-on to new misinformation guidelines in Europe.

Read Story
Meta is Developing a New ‘Basic Ads’ Product for Facebook to Counter Losses Due to Data Privacy Concerns

Meta is Developing a New ‘Basic Ads’ Product for Facebook to Counter Losses Due to Data Privacy Concerns

In This Weeks News, Meta is Developing New Basic Ads, Reddit highlights brand activation on its platform, and Snapchat shares new knowledge on how AR and digital camera advertisements can assist enhance Marketing campaign efficiency.

Read Story