Creating A/B test
Create an A/B test rule to find out which content is the best suitable for the segment you are targeting.
- Click Zones, and then select the channel for which you want to create the A/B test rule.
- Do any one of the following actions:
- If no personalization is added to the zone, click next to the zone for which you want to create A/B test rule.
- Click next to the zone for which you want to create a
rule. In the Content personalization pane, click Rule
editor, and then click New rule. Tip: You can also create an A/B test from an existing rule. To do so, perform the following steps.
- Open the rule that you want to convert to A/B test.
- In the Rule details screen, click the Convert link, which is located next to This is not an A/B test message.
- In the Select the personalization type pop up, click A/B test and then click Next.
- In the rule configuration screen, enter your unique rule name and control group percentage.
- Select the primary goal of the test. Currently, we support only the click rate as the primary goal. For more information, see "Click Rate"
- Select the Rule duration.
- Click Configure A/B test.
- Enter the number of different content variants you want to show to the channel visitors. For example, if you want to show two different content variants to two different sets of visitors, then the number of content variants would be 2.
- Enter the statistical significance percentage. Note: The statistical significance percentage should be within the range 50 - 100.
- Notify me when the test ends option is selected automatically. Click Next.
- Here, you can see all the details that are entered in the window.
- To select the content variant, click Select content. Note: You can add up to 10 variants in one A/B test rule.
- To select content for each variant, do any one of the following actions:
- If you select Acoustic Content as the content management system, you can either select the content from Acoustic Content Palette or you can enter the content in the form of HTML blob. If you select Acoustic Content, browse the content from the Acoustic Content Palette window. Use the Search bar to find the content type that you want.
- If you registered Other as the content management system, you can enter the content in the form of HTML blob or URL.
- In the Control traffic field, enter the percentage of visitors who see the default content. In the Test traffic fields, enter the percentages of visitors who see the particular variant. You need to split the percentage among the different content variants(Test group1 up to Test group10). The total percentage of traffic allocation must equal 100%.
- Click Create.
The content variants are added to the Content variants pane.
- In the Segment pane, click Select segment. You can search a segment by searching for the name or create a new segment. Click Select
- Do one of the following actions:
- Click Save.
- Click OK. The rule is saved in an inactive state.
- Click Save and publish.The rule is saved in active state. The rule is published but will not run or be applied until the start date. If the start date and time is set to future date, then status of the rule is Active - Scheduled. For more information about states of A/B test rule, see "How do I see status of my rules?"
- Click Save.
Converting a rule to an A/B test
You can use an existing test rule and enable A/B testing to find out the best suitable content for the segment that you want to target for personalization.
To create A/B test using existing rule, complete the following steps:
- Log in to Acoustic Personalization.
- Click Zones, and then select the zone for which you want to update the rule, and click .
- Click Rule editor to view the draft rules.
- Click action menu of the rule that you want to convert, and then click Edit.
- Click Convert.
- In case you want to change the rule configuration, you can edit the rule name, control group or duration, and then click Next.
- Enter the number of different content variants you want to show to the channel visitors. For example, if you want to show two different content variants to two different sets of visitors, then the number of content variants would be 2.
- Enter the statistical significance percentage. Note: The statistical significance percentage should be within the range 50 - 100.
- Click Next.
- Here, you can see all the details that are entered in the window.
- To select content, you can do any one of the following actions:
- If you select Acoustic Content as the content management system, you can either select the content from Acoustic Content Palette or you can enter the content in the form of HTML blob. If you select Acoustic Content, browse the content from the Acoustic Content Palette window. Use the Search bar to find the content type that you want.
- If you registered Other as the content management system, you can enter the content in the form of HTML blob or URL.
- In the Control traffic field, enter the percentage of visitors who see the default content. In the Test traffic fields, enter the percentages of visitors who see the particular variant. You need to split the percentage among the different content variants(Test group1 up to Test group10). The total percentage of traffic allocation must equal 100%.
- Click Create.
The content variants are added to the Content variants pane.
- You can view the segment or use Change segment to select a new segment.
- Do one of the following actions:
- Click Save.The rule is saved in an inactive state.
- Click Save and publish.The rule is saved in active state. The rule will be published but will not run or be applied until the start date. If the start date and time is set to future date, then status of the rule is Active scheduled. For more information about states of A/B test rule, see "How do I see status of my rules?"
- To confirm, click Ok.
The A/B test is saved and scheduled according to the rule duration.