I use segment to maintain audiences. At times I want to activate an audience by downloading a CSV file from segment and using it to trigger for example a discount for an audience. for each audience I would like to maintain a say 5% control group, so that I can prove the audience behavior is triggered by the discount.
I don’t seem to be able to find a method within Segment to be able to do this. Instead I need to run my downloaded file through an SFMC feature that will split out a random group of 5% from the audience.
Does anybody know of a way that such a task can be done within Segment itself. Creating for example a random 5% of the Audience in another audience that would then be the control group for that audience.
Solved
Control Groups
+4Best answer by Brendan Maher
Thanks Chauntel, I am trying this approach now. It costs a bit more in compute units, but I think it might be worth it to remove some of the manual steps in our workflow.
Right now the audience is manually downloaded as a csv, uploaded to SFMC and then SFMC does a journey split.
I think I need to combine your approach with the new SFMC batch destination so that I can automate the process. Ultimately in need the control group list in my (Azure) data warehouse, but that is another step 😊
Thank you for your help!
+3Hey
- create your audience
- create a journey where entry = member in that audience
- add randomized split in journey with your control / test group percentages
- send to destination for both branches
~Chauntel
+4Thanks Chauntel, I am trying this approach now. It costs a bit more in compute units, but I think it might be worth it to remove some of the manual steps in our workflow.
Right now the audience is manually downloaded as a csv, uploaded to SFMC and then SFMC does a journey split.
I think I need to combine your approach with the new SFMC batch destination so that I can automate the process. Ultimately in need the control group list in my (Azure) data warehouse, but that is another step 😊
Thank you for your help!
+1Hey
+4Thanks Andy.
As you suggested we are also using Azure as our rETL source and the traits we get from that are then used by our operations team to bulid the audiences. but we need to get the resulting audience to a few different systems including Salesforce Marketing Cloud
We are hoping to use the connector for Salesforce Marketing Cloud to get the audience to there. From there it can be used for push notifications and emails as well as being exported to other parts of our infrastructure including to Azure but enriched with customer interaction data. So now I am planning to put the control group logic in SFMC.
What I still need from Segment is the best way to allow users with access to create audiences and connect them to destinations to then deploy the audience quickly to SFMC. I am hoping to trigger a batch update to SFMC as soon as the audience generation has been marked complete.
+4One evolution of this approach is that rather than setting the journey as one of two groups (Control and Test), rather have it split into, say 10 groups. Then at the end of each, set a trait on the user and allocate their “Test Group” as being one of the 10.
Then when you want to construct an experiment, you don’t need to create separate randomised groups, but rather just say, I’m doing a test for “Test Groups 1-9”, but keeping “Test Group 10” as a control group. As it’s a trait, it can flow to all analytics and automation tools, so you can see the performance quickly, easily and without any extra custom configs per campaign/test.
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.