Docs Index

Creating custom questions

Last updated on Available in French

Select an item from the list for more information on custom question creation:


Create a custom question in the question editor


To create your own custom question, under SCREENING, click Question Editor.  

The Screening tab in the left nav with the question editor menu item highlighted.

If this is the first question you have created, click CREATE YOUR FIRST QUESTION.

question creation start screen with an arrow pointing to the "Create your first question" button.

If you already have a list of questions, click New question in the top right corner.

Question list screen with an arrow pointing to the "new question" button at the top right of the screen.

In the New Question pop up, select a Question type. There are four options:

New question modal with a list of the different question types open.

Select the question language(s) and click CREATE.

New question modal with "multiple choice question" type selected and "english" language selected. There's an arrow pointing to the "Create" button.

Create multiple choice questions

  • Input the Title (the candidate does not see the title).
  • Write out the question in the Statement box on the left.
  • Text options include common styling options, code inputs, LaTeX formulas, and adding images and attachments.
  • On the right, input the answer options.
  • Indicate the correct answer(s) with the switch.
  • Select Multiple answers possible if there is more than one answer.
  • Select Randomize order during the test to randomize the answer list order if required.
  • The candidate must select ALL valid answers, and no other answers, to receive the maximum points available, otherwise marks are proportional.
Multiple choice creation screen consisting of title field, statement field, and answers field.

Settings

Question settings section to select domain, skill, difficulty, duration, and points.

Add the following details:

  • The domain (i.e. technology or programming language) of your question where you can select an existing domain or create a new domain
  • The skill to test.
  • The question difficulty.
  • Timer options.
  • Total points available.
  • Whether to add the question to automatically generated tests.
  • Whether to authorize CodinGame to add this question to the CodinGame question library.

Click SAVE to save the question.

Create text questions

Input the Title and write out the question in the Statement box below.

Empty text question creation page. Consists of title and statement fields.

Add the Settings as before.

Settings for test question including fields for domain, difficulty, duration, and points.

Select (1) Automatic or (2) Manual validation in the Validation section.

1. Automatic validation

Select the skill and input the answer to the question. Candidate answers must match exactly, but are case insensitive.

Validation section with "automatic" option selected and the skill and answers field empty.

✅ Check the Regular expression box and input a regex code that allows a more flexible range of answers. Check the Oracle Java Regex description for more information.

2. Manual validation

Input a Label for the report. Select the Skill and Weight. The Points value auto-populates.

Validation section with "manual" option selected. The fields for label, skill, weight, and points are displayed.

After a candidate completes a test with a question that needs manual validation, you will receive an email inviting you to manually validate the answer to the question. The system then calculates a final score.

Create programming exercise

In the New Question pop up, select Programming exercise from the Question type dropdown list.

Next, select a specific Programming language.

✅ For multiple languages select custom question setting Multiple (Language-independent) at the bottom of the list. See the multiple language section below for more information.

New question modal with a question type of programming exercise and a programming language dropdown open with multiple languages.

The Question template dropdown contains existing CodinGame questions that you can use as a basis for your own.

New question modal with a question type of programming exercise and a programming language filed with "C" selected and a "question template" field displayed.

You can edit the details of the existing question, including adding a zip file, before choosing the settings.

Template shown with title and statement fields.

In Settings, input the points for the question.

Settings section with domain selected as "language independent", difficulty as "easy", duration as 5 minutes, and points as 100.

✅ The domain field may have more options depending on the language selected.

If you want, you can add your question to the CodinGame library by checking the authorization box. Hover over the information circle to see the details:

"By checking this box you authorize CodinGame to add this question to their library of available questions. Any CodinGame customers will be able to add your question to their campaigns. If a large pool of candidates attempt to answer your question as part of their coding test, the comparative score (used to benchmark candidates based on their skills) for your questions will be more precise.

Scroll down to see the Initial candidate answer code and the Initial candidate test code input boxes. This is the editable code your candidate sees at the start of the test.

Initial candidate answer code box on the left, and initial candidate test code box on the right.

The Code validator section stores validation code which runs against the candidate’s solution in order to assess it.

Code validator screen with some code displayed.

Underneath the Code validator is a Validator Mapping section where you can set the criteria for validation.

✅ The method field in the Validator Mapping must match the method name in the Code validator.

Validator mapping section with label, method, skill, weight, points, and status columns displayed.

You can also try out a Possible solution and test your code. Click PREVIEW to test the question:

Possible solution section with code box on the left and a "validate the solution" button on the right.

You will see the question as the candidate sees it:

A candidate question preview with question on the left, candidate's answer on the right, and test code on the bottom right.

After testing and submitting, click SAVE to save the question.

Multiple language question

You can create a multiple language programming exercise by selecting the Multiple (Language-independent) option at the bottom of the Programming language list when creating the exercise.

New question modal with "Multiple (language-independent)" option selected in the programming language drop down.

Create your question by manually inputting the details as before, but without selecting any specific language content.

You’ll then need to fill out the starter code in the Default code generator, also known as the stub generator. You’ll use a special syntax to create a list of commands that will then be translated into starter code for whatever language the candidate selects. Select View documentation above the code generator window to learn more about the commands available to you.

Default code generator. On the left is the special default code language and on the right is the selected language and the translated code.

Next, you will also see a section called Tests. Here, you can add tests that the candidate will be able to run during their assessment. These tests are visible to the candidate.

Tests section with label, input, and output fields.

You also have the option of adding Validators, which perform the same function as tests but are not visible to the test taker.

Validators section with validator name, weight, label, skill level, points, input, and output fields displayed.

✅All Multiple (Language-independent) programming exercises that you create are available to add to Language Independent tests.

Create project exercise

✅ Project exercises are usually longer than other kinds of questions.

Select Project exercise and click CREATE in the New Question window.

New question modal with "project exercise" question type selected and an arrow pointing towards the "Create" button.

Input a title and a statement for your project question.

exercise creation page with title and statement fields displayed.

In Settings, choose difficulty, timer, and points:

Settings section with domain, difficulty, duration, and points field displayed.

Then, click + Add your project to upload the project information that serves as a starting point for the candidate. All file types are acceptable.

Add the Evaluation Criteria you want to use, then PREVIEW and/or SAVE.

Evaluation criteria section with label, skill, weight, and points fields displayed.

✅Project exercises will need to be manually validated.

Add translations

Whenever you create a new question, if you select more than one language, you will find tabbed areas for inputting the text in other languages.

Multipl choice question translation screen with "English" tab opened and title, statement, and answers fields displayed.