Weighted Question Types
The weighted question feature allows you to create your own index/scoring framework for each question within an assessment.
The overarching concept is designed to generate a numeric score depending on what responses have been selected for each question within each question domain.
Step 1 – Set Up Assessments
To setup an assessment that uses Weighted question types:
1. Create a new assessment or assessment template
2. Select the side Settings Side Panel, scroll down to the bottom of the side panel and change the Question Type to Weighted
3. When you select Weighted, three new options appear:
a. Results within domains (mandatory) – The two options here are:
Average – this averages the weighted response of all questions within each domain.
Total – this calculates the aggregate weighted response of all questions within each domain.
b. Results across domains (non-mandatory) – The two options here are:
Average – this calculates the average of all the ‘Results within domains numbers’ (either Total or Average) across all the domains within an assessment.
Total – this calculates the aggregate of all the ‘Results within domains numbers’ (either Total or Average) across all the domains within an assessment.
c. Round results to nearest integer – This rounds the results of an assessment to the nearest whole number.
Step 2 – Create Questions
Setting up weighted question types:
1. Create a new question
2. Under the Answers subsection, enter in the Ranking and Weighting options as required (as seen below)
3. Weighted question types are enabled for Radio (Custom) only. This means you are required to input your answer options. You can create as many as you like.
4. Weighted question types also have an input field called Weighting, and two dynamic fields called Total Domain Weighting and Total Assessment Weighting:
Weighting – This is the weighting that is applied to the question and will be multiplied by the Ranking of the response. So for the above question, if the respondent was to select Twice Yearly, the weighted response would be (Ranking x Weighting = 3 x 10) = 30. If they selected weekly, the weighted response would be (Ranking x Weighting = 1 x 10) = 10. Note that the Ranking is editable, so you can put in any number.
Total Domain Weighting – Shows the total weighting applied across all the questions within a domain
Total Assessment Weighting – shows all the weighting applied across the entire assessment
Step 3 – Results
In this example an Assessment was created with 2 domains, each with two questions, with:
Results within domains = Average
Results across domains = Average
When the assessment has been completed by the respondent, the results will be displayed like so:
The Answer box shows what you selected, in the first question you selected Twice Yearly, which has a weighted response of 30 (3 x 10). The second box shows the Maximum Weighted Answer Option, which is Yearly, which has a weighted response of 40 (4 x 10).
If you click on Report, you will see the following:
The following is displayed:
1. Assessment Compliance chat – this shows the Average (in green) of all the questions in Domain 1, In this example it’s (30 + 20)/2 = 25. The total stacked bar shows the highest potential Average, i.e. the average of the highest weighted responses in the Domain. For Domain 1, this would be (highest weighted response in question 1 + highest weighted response in question 2)/2 = (30 + 40)/2 = 35.
2. The Average of average scores across all domains displayed is calculated by finding the average across the domains. In this example the average of Domain 1 = 25, while the average of Domain 2 is (5 + 10)/2 = 7.5. So to calculate the Average of average scores across all domains is (25 + 7.5)/2 = 16.25. the 22.5 comes from calculating the average of the highest weighted responses within and across the two domains = ((40 + 30)/2 + (10 + 10)/2) = 22.5.
If the user had selected Results across domains = Total, then it would display (average of domain 1 + average of domain 2) = (25 + 7.5) = 32.5