Creating Highly Randomized Assignments: Quizzes and Unit Tests

The Student Experience of Highly Randomized Forms

Highly randomized forms are the most complex type of form to author. They provide the most randomization to students, no matter how many attempts you allow them. Questions are grouped into many separate pools and drawn at random so that all students receive an equal number of assessments, but with different combinations of questions. 

 

Ways to Create Highly Randomized Forms

There are several ways to randomize the assessments in terms of how you group questions. 

The most common way to group questions is by learning objective or skill. To use this method, you find the smallest learning component that you are assessing, create questions to assess it, and group them together in a pool. For example, if you wanted three highly randomized forms, you would write three parallel questions against each of the smallest learning components, and then place those three questions in their own pool file. Each form selects one of those three parallel questions for the assessment form. This method generates an assessment in which each question is randomly chosen from a group of equivalent questions. 

There are other ways to group questions. For example, you could write six parallel questions against a learning objective, put them in a pool, and select two randomly from the pool. Doing so will change the combination options for the selection. However, you must be sure that the questions you place in a pool file are equivalent. If you put questions for two different learning objectives in a single pool and select two of those questions randomly from the pool, you could receive two questions from the first learning objective and zero questions from the second. You would not be assessing students equally on the content or against one another. 

Another option is to create parallel question sets and place them in a pool. You might choose this method if you need to use a table or graphic and ask three scaffolding questions against that image. You would want those questions to stay together. If you create three sets of scaffolded questions that are parallel but different, you can place each set within an assessment section in a pool. Now your pool will select one of the three sets of questions. 

How to Create Highly Randomized Forms

The general steps are the same as creating multiple forms, except there will be many more pool files attached to the assessment page. These are the steps:

Step 1. Create an assessment page.

Step 2. Create a pool file.

Step 3. Create assessment sections. For assessments with highly randomized pools, you will repeat this process for every group of questions you have.

Step 4. Write questions. 

Step 5. Add pool to assessment page and set selection criteria. When choosing the Number of questions to draw each time, input the number of pools you want to choose from.

For detailed instructions on each of these steps, refer to the article on Creating Multiple-Form Assessments