On the targeting page, you can set how many and which type of your users will participate in the experiment. This guide includes instructions on how to:
- Allocate the percentage of users who should participate in this test,
- Set filters to target specific users or devices,
- Set custom attributes for more advanced targeting.
- Set groups for more advanced targeting.
Adjust the allocation bar to set what percentage of your users will see the experiment. If you set it lower, to say 5%, that means that if your app gets 10,000 users per day, 500 users per day will see your experiment. If your experiment has 1 variant, 250 users will see the original app as a control group and 250 will see the variant.
Note that each user of your app can only be a participant of one experiment at a time by default. If you feel comfortable with having a user participate in the experiment you’re making along with other experiments running, uncheck the Exclusive Experiment box.
In addition to selecting the percentage of users to see this experiment, you can also specifically target users with certain attributes:
- Country: The user’s country according to their device settings, NOT which country they are in according to GPS.
- Device Model: The user’s device model (e.g. “iPad4,1” (iPad Mini Air), “iPhone4,1” (iPhone 4S)).
- Language: The user’s language according to their device settings.
- Screen Height: The height of the user’s device screen in pixels.
- Screen Width: The width of the user’s device screen in pixels.
- Screen Scale: The device’s screen scale or density.
- OS Version: The iOS or Android version the user’s device is running (e.g. 7.1.0 (iOS), 4.4.2 (Android)).
- User is New: Only new users who run the app for the first time after the experiment is started, or conversely only users who ran the app for the first time before the experiment started.
- Version Number: The app version as shown in the store (e.g. 2.5.2).
- Mixpanel Property: If you are using Mixpanel’s super properties, these properties will show up as available for targeting.
Simply select the property by which you want to filter, choose the comparator, and then start typing the criteria (a selectable list of options will pop up).
You can select more than one targeting filter. Note that multiple filters will have an AND relationship. As in, if you create the filter “Device Model is in iPhone 4″ and “Language is in English,” the only users who will see the experiment are users whose devices are iPhone 4′s that are also in English. Someone who is on an iPhone 4 in Chinese will not qualify for the experiment. Someone on an iPhone 5 in English would also not qualify.
Apptimize also allows you to programmatically set attributes on which you can target. Custom Attributes enable you to target based on any user characteristic that you can obtain programmatically. All you have to do is select Custom Attribute and enter the name of the targeting criteria like this:
A code snippet will appear below the targeting filters once you click Set Filter. Insert the code snippet into your app where the information is being gathered so that the criterion can be passed to Apptimize.
iOS Example Code Snippets (select one of the appropriate snippet):
[Apptimize setUserAttributeString:THE_ATTRIBUTES_VALUE forKey:@"Gender"]; // or [Apptimize setUserAttributeDouble:THE_ATTRIBUTES_VALUE forKey:@"Gender"]; // or [Apptimize setUserAttributeInteger:THE_ATTRIBUTES_VALUE forKey:@"Gender"];
Android Example Code Snippet:
Note that once you have created and integrated an attribute, you can use it again for later projects (Feature Flags or A/B Experiments) without having to re-integrate into your app. Once the code snippets are placed in your app, they are not tied to a specific project and can be used in as many projects as you’d like. You can also filter on custom attributes when analyzing results, to understand how any experiment affected a particular segment of users.
After allocating and targeting your experiment, you’re ready to view a summary of the experiment and launch the experiment to end users.
Apptimize allows you to specifically include or exclude groups of users in an experiment. The groups are defined by the list of user IDs you upload to Apptimize. You must send your internal userID to Apptimize using the Pilot Targeting in order to enable this feature. See Pilot Users and the Feature Flag Installation Guide for more information.
Unlike the Pilot Users feature in Feature Flags, groups targeting in experiments does not bypass other targeting logic. Groups targeting works just like any other targeting logic. For instance, if you target users in version 2.1.1 and in Example Group 1. The users who end up being targeted are ones who are both in version 2.1.1 and in Example Group 1.
Targeting groups in experiments also does not bypass randomization. For instance, if an experiment is targeted to include only Example Group 1, Apptimize will randomly divide Example Group 1 users into control and variants. If you select a winning variant running the experiment, the variant will be launched to the targeted users by default. Unless you change the targeting logic, the winner is rolled out to the groups you target only. This is helpful for testing experiment set-up with internal user groups as well as beta user groups.
Supported Attributes by Apptimize SDK Version
We are continually adding to the attributes that can be used to target your experiments. As we release new SDKs these features become available to you. Check here to see if your current SDK version supports a particular attribute, and don’t be concerned if you need to update your SDK – it’s easy!
Note Apptimize SDKs before 2.1.0 ignore targeting filters.
|Targeting Attribute||Supported from Apptimize SDK version|
|Device properties||2.3 +||2.3+|
|Custom Attributes||2.8 +||2.5 +|
|User is New||2.9 +||2.8 +|
|Mixpanel Super Properties||2.10 +||2.8 +|