An advanced option before launching an experiment that allows you to review the experiment in an interactive manner.
Setting the size of an experiment’s population.
Attributes defined by you that can be used for targeting and segmentation.
A variant of an experiment that is the same as the original app.
A specific piece of data with associated properties that we track in our analytics system.
Toggle that allows experiments to run in parallel with other experiments on a specific user’s device.
An A/B test that includes a control and variant(s).
Event or combination of events that measure the success of an experiment.
Taking an experiment live so that users will start participating.
Properties supplied by Apptimize automatically, e.g. country, language
A way to select a subset of your users for an experiment.
A version of an app. Variants that you create are typically different than the original app.
Users who succeeded in fulfilling goals.
The number of conversions divided by the number of participants with the confidence interval included after the result in brackets.
An expression using an attribute, operator, and criteria used to sift through data.
Raw change in conversion rate from control to variant.
Percentage better or worse a variant is compared to the control in an experiment.
Number of Sessions
Number of sessions is how many foreground to background transitions that we see.
A user in an experiment’s population who has seen a variant.
All users in an experiment who could potentially see a variant. Some users will be allocated into an experiment but never see a variant because they don’t navigate to that part of the app.
The number of users who have a second session- open the app at least a second time, in a given period of time.
Screens Viewed per Session
On Android this is the number of activities, popups, and fragments we measure during a session. On iOS it is the number of view controllers shown that we measure per session. Note that since this is how we measure screens view, it’s possible given how differently apps are architectured that we overcount the number of screens viewed, however since in an experiment you’re measuring versus a control this doesn’t adversely affect your experiment results.
A session is when a user is in your app, specifically measured by the time between when your app is foregrounded to when the app is backgrounded.
The session interval is time between consecutive sessions, specifically the time between when the app is backgrounded to when it is next foregrounded by a user.
Session length is measured by the length of time between a foreground and a background.
Standard method for statistical significance by confidence.
Direction of lift.