Documentation menu

Customizing test content

Last updated on Disponible en Français

Select an item from the list below to find more information on the use case you’d like to carry out.


Customize a test

After you create a test you can customize it by specifying the questions and blocks you want to include in it.

Navigate to your My Tests page and select your test from the list.

List of tests is shown with a 1 next to the "tests" menu option in the left nav and a 2 next to the list of test.

After you select your test, click the Customize test button to begin.

Test creation verification page with an arrow pointing towards the "see questions" button.

When you click on Customize test, you will see a list of the test’s question blocks, as well as options to Add random block or Add a question.

Screen shot of the Customize Test main page.

⚠️ If you customize a test after candidates have already started taking it, you risk skewing the results for newer candidates as test duration and average expected score can differ.

Add random question blocks

A block is a list of questions that make up whole or part of a test.

To help prevent cheating, you can create a different test for each candidate by using random blocks of questions. Screen generates the random blocks based on your specified criteria, e.g. job role, domains, level of difficulty, etc.

To start, click Add a random block and select the specific criteria you are interested in.

Customize test page with an arrow pointed towards the "Add a random block" button in the "Your test" modal.

The questions in the block auto-populate based on the criteria selected; you can view the questions below the criteria selection window.

A screenshot of the "set of random questions" window with Domain, Type, Skills, Duration, and Experience options shown.

Click Save to add the block to the test.

You will see the blocks on the left and the questions on the right. View the questions a specific block contains by selecting a block.

✅Want to change the number of questions in a random block? Just increase the duration of the test to add questions and decrease the duration of the test to remove questions.

In the example below, there are SQL quiz questions for approximately five minutes, SQL coding exercises for about 25 minutes, Java quiz questions for around seven minutes, and Java coding exercises for about 42 minutes. To add another random block, click Add a random block.

Customize test page with an arrow pointed towards the "Add a random block" button in the "Your test" modal and the "Set of random questions" modal on the right.

✅ Every question that takes more than half of a block’s time will be automatically excluded from the test to prevent one question from taking the whole block. For example, in a block with a 10 minute duration, every question that takes 5 minutes or more will be excluded from the test. 

Mandatory questions

Add mandatory questions to the test by dragging and dropping questions from the Question bank on the right to the Your test section on the left.

The Your test window on the left and the question bank on the right, with an arrow leading from a Java question on the right to show how to drag to Your test on the left.

✅ You can mix and match block and question levels. For example, you might want to hire a Java expert with some PHP experience. In this case, you might create a senior/expert Java test that lasts roughly 50 minutes and add a short 10 minute junior level PHP block with a five minute duration.

Remove randomness

If you don’t want random blocks in your test, click on the three dots to the right of the PREVIEW button in Your test and select Refresh your test.

An arrow pointing towards the vertical ellipses on the top right of the your test window and a red box surrounding the "refresh your test" menu item.

Click List of questions

The refresh your test window, with an arrow pointed towards the List of questions button.

Now, every test will be non-random and have exactly the same questions.

Exclude questions from random blocks

To exclude a question from a test, select the question on the right panel and then click Exclude in the left panel.

A customized test with a question opened and an arrow pointing toward the "exclude" button.

Click Save to confirm.

To include the question again, scroll down to the bottom of the list of questions in the right panel to find the excluded question.

Then select the question, click Include in the left panel, and then Save.

A customized test with a question opened and an arrow pointing toward the "include" button. The question on the right is grayed out and marked "excluded".

Add a non-random question

⚠️ If you customize a test after candidates have taken it, new candidates might not be on a level playing field as test duration and average expected score can differ. 

Click Add a question in the left Your test panel.

The Question bank appears on the right. 

"Your test" window open with an arrow pointing towards the "add a question" button with the question bank on the right.

Choose a question from the Question bank.

If needed, you can use the ADVANCED SEARCH option to find questions. Sort results by domain, skill, type, difficulty, and duration. 

Question bank window with the question bank, domain, skill, type, difficulty, and duration items shown.

Then, either click the three dots on the right of the question and select Add to my test

Question bank window open with an arrow pointing towards the vertical ellipses and then a box around the "add to my test" option.

OR, drag the question from the Question bank on the right to Your test on the left.

The Your test window on the left and the question bank on the right, with an arrow leading from a Java question on the right to show how to drag to Your test on the left.

✅You can select as many questions as you like — you can also create an entire test out of questions that you hand-picked.  If the entire list of questions is non-random, the allotted time and the available points are more precise.

Customize a question when creating a test

You cannot edit or customize a Screen question when creating your test. Instead, you’ll need to create a new question and copy the original, editing where necessary

First, select the relevant question from the test. Then, open the question editor in another tab and select the Question type which matches the question you want to copy.

Manually re-write the information from the original question to the question editor and edit where necessary.

Save your new customized question and add it to your test

Preview correct answers

To preview the correct answer for a question, click on a question on the right and click Preview in the question details on the left.

A question selected and opened in a question window with a red arrow pointing towards the Preview button.

When the question pops up, click on Submit to see the answer.

A question editing screen with a red arrow pointing towards the "submit" button.

You’ll see the correct answer appear in green: 

Candidate's answer is at the top with the number of seconds it took the candidate to answer the question. Below are a list of the answers with the correct one highlighted green.

Test customization video tutorial

For more information on customizing your tests, check out the Modifying a test with CoderPad Screen video tutorial: