Creating a text question in the Question Editor
CodinGame created a question editor, letting you create your own questions. There are four types: MCQ, Text, Programming Exercise and Project Exercise. This article is about text questions.
Choose your language (English, French or Spanish).
You can add translations within the question creation page.
The question’s title is not shown to the candidate during the test. You can select any title you like even if it contains part of the question’s answer.
If you wish to add images to your question, we would advise using the “Insert image” button to upload the image directly on our servers. If you choose to do some hotlinking, the image can be unhosted at any time and non visible to your candidates.
If you wish to highlight a variable, select your variable and then click on the “Insert code snippet” button.
If no text is selected, you can insert a code extract by clicking on the same button. A pop-up will appear, asking you to choose the programming language and to create the code.
Once done, click on “Save” and the code will appear in the statement.
Now you are ready to choose your settings. The domain can be a domain already present on CodinGame or a new customized one. The same goes for the skill assessed in this question. Choose your difficulty level (Easy, Medium, Hard) and the duration. For example: MCQs in our library usually are between 30 seconds and 3 minutes long depending on the statement’s length and the reflection level expected. For your questions to be equivalent to CodinGame’s library, just adjust duration and difficulty; points will adapt automatically.
Once your question is ready, if your tests are in random block format, tick the box “Allow the use of this question in automatically generated tests” for it to be within the selection. If your question has to be in your test, here is how to find it.
You can also choose to share this question with CodinGame:
When on an Enterprise License with several accounts, you can choose to share this question with all your company’s accounts for your colleagues from other business units to use it.
Next, choose your question’s validation.
- Automatic validation
Set up the skill assessed by this question (already on CodinGame or self-created) and the possible answers.
For an automatically assessed Text question, the answer of the candidate will be checked against each possible answer listed in the validation panel. If one of them matches, the candidate will get the points.
There are two types of possible answers: "classic" and "regular expression" answers. They differ in the way the matching of that answer is done with the candidate’s answer.
For "classic" answers (i.e., "Regular expression" is unchecked), the matching is done using a case-insensitive exact match. This means that the candidate’s answer must match the classic answer exactly (except for upper/lower case letters). For example, if the possible answer is "Interface," it will match and grant points for candidate answers such as "interface" or "Interface," but not if the candidate answer is "Interfaces" or "The expected word is Interface.”
For "regular expression" answers (i.e., "Regular expression" is checked) the matching is done using a regular expression match with the candidate answer. This allows more flexibility in the candidate's answer. A usual pattern when using regular expressions is ".*" which means "any character.” For example, if the possible answer is ".*Interface.*" then "Interface" or "Interfaces" or "The expected word is Interface" will all match and grant the question points to the candidate.
It is important to note that by default regular expression answers are *not* case-insensitive. This means that if the candidate answer is just "interface," the candidate will not get the points in the above example. A "flag" can be put at the beginning of the regular expression to make the expression completely case-insensitive: "(?i)". So if the possible answer is now "(?i).*Interface.*" it will match all the above candidate answers including the simple "interface" word. For advanced use, the regular expression engine used is the one from Java (see https://docs.oracle.com/javase/8/docs/api/java/util/regex/Pattern.html ).
- Manual validation
Choose Label, Skill, Weight and Points for this question.
Manual validation will require extra steps on your end. Once your candidate is finished, you will receive an email advising you to review their test. Your candidate’s test will appear as “to review” in the “comparative score” column instead of as an actual score.
Click on the candidate’s line to access the right side panel. The question to manually grade will appear as such:
To get your candidate’s final score, you will have to review this question and grade it. Click on the green tick to validate the answer or on the red cross if the candidate failed.