A content experiment is a great way to see what happens when randomly assigned course participants are exposed to different content in your course. This can provide a means of gauging if one approach to course content such as videos or quiz questions works better than another.
To add a content experiment to your course, head to Studio and go to Settings > Advanced via the navigation links at the top of the page.
Add "split_test" to the Advanced Module List input field.
If you have other values already in this field, separate them with commas. Click to save your changes. Refresh the page to update your course.
Go to Settings > Group Configurations and click on "Add your first Group Configuration".
Provide the following information in your group configuration:
- a name for your group configuration
- a description of your group configuration (optional)
- the names of your groups
The name of the group configuration might be something that pertains to what you will be testing. The description can be used to help you remember later what you are using this group configuration for. By default, group names are Group A, Group B and so on. These values won't be visible to course participants. You will need to create at least two user groups, but can create as many user groups as you'd like.
Once you have set up your group configuration, click "Create". You can use this group configuration for as many content experiments as you like.
Head to your Course Outline (Content > Outline) to build your experiment.
Click to add or edit a unit to a subsection in a section. Click on "Advanced" from the component options, and then select "Content Experiment" from the list of options.
This will add a template for the content experiment to your unit. You'll see a component that has "View" and "Select a Group Configuration" links. Click on the "Select a Group Configuration" link.
This will take you to a page where you can specify which group configuration to use for this test. Select the group configuration you just created from the drop-down menu, change the display name to something other than the default "Content Experiment" name and save your changes.
Click "View" to add content to your experiment. You'll see two or more sections on the subsequent page. Each group will have its own section. Each section corresponds to a unit that the specified user group will see when they go to the unit your experiment exists on in the course. From here, you can add components to each unit as you would to a regular unit.
In the example below, you can see two of the three groups I've created. Group A's unit has been compressed and Group B's unit has been expanded, in order to see what kinds of content I've set up for people in Group B to encounter.
Once you have set up your units as you'd like, click on the "Unit" breadcrumb above your three units to go back to the main A/B test unit you created.
Click "Publish" on this page, and that's it!
To see what your students will see in the unit you've created the content experiment in, go to the live version of the unit and select the group of choice from a drop-down menu in the unit. This will display only the content that will be visible to anyone in that particular group.
Students will not see this drop-down menu and will only see the content tied to the group they have been randomly assigned to.