Allows you to establish automated scoring criteria for various questions in the application by assigning a specific score to a response value. This score is calculated when the applicant answers the question with a value that meets the criteria for that score.
Accessing the Manage Automated Scoring Screen.
-
Step 1: Once you log in as an admin, you will be presented with the application homepage. From the application homepage, click on the application name under which you would like to make changes.
-
Step 2: If the application is not available on the application homepage, you can search for the application by clicking on the search button.
-
Step 3: After searching for the application, click on its name.
-
Step 4: Click on 'Evaluations'tab from the top navigation to set up the evaluation process.
-
Step 5: While you are under the 'Evaluations' tab, open the left navigation panel and click on 'Manage Automated Scoring' to set up automated scoring criteria.
-
Step 6: The 'Manage Automated Scoring' screen is displayed. You now have the option to select the assigned scholarship name under which you would like to set up the automated scoring criteria.
Setting up an Automated Scoring Rubric
-
Step 1: Select the assigned scholarship fund from the 'Select Scholarship' dropdown.
-
Step 2: Now click on 'Create Automated Scoring Criteria' to set up the automated scoring criteria for the selected scholarship."
-
Step 3: You will now be presented with the list of fields that you will need to use to create the automated scoring criteria.
Overview of Manage Automated Scoring report listing:
- Section: Select the section that contains the question for which you want to set the score. This will also open the Question field, where you need to select the specific question to include in setting up the criteria.
- Question (Report Display Name): Choose the name of the question upon which the score will be based.
- Type of Field: This is a read-only field and is automatically filled based on the type of question selected in Mapping Fields.
-
Condition: Set the condition type for the field. Possible conditions are:
- Contains: The answer/value contains this value.
- Starts With: The answer/value starts with this value.
- Does Not Contain: The answer/value does not contain this value.
- Is Not Empty: The answer/value is not empty (the applicant has answered this question).
- Is Empty: The answer/value field is empty (the applicant has not answered this question).
- Is Exactly: The answer/value must exactly match the value.
- Is Less Than: The answer/value is numeric and is less than the specified amount.
- Is Equal To: The answer/value is numeric and is equal to the specified amount.
- Is Greater Than: The answer/value is greater than the specified amount.
- Is Not Equal to: The answer/value is numeric and is not equal to the specified amount.
- Value: This field will appear based on the Type of Field you selected. Enter the answer the applicant must provide to receive a score. The value must be entered exactly as it was submitted by the applicant (e.g., if a dropdown listing value, it must match the value entered in the dropdown).
-
Score: Enter the score that corresponds to the specified value.
-
Example: You want to award a score of 5 points if the applicant lives in Virginia. When completing the "General Information" section, the applicant would need to select the state "VA". You would set up the automated score as shown below:
-
Example: You want to award a score of 5 points if the applicant lives in Virginia. When completing the "General Information" section, the applicant would need to select the state "VA". You would set up the automated score as shown below:
-
Step 4: Click Save and Exit to return to the automated scoring listing.
-
If you want to set up the scoring criteria for GPA questions or any other numeric question based on the minimum and maximum values, then you need to create separate criteria for each range. For example, if you need to set up criteria for GPA, you should create separate criteria with conditions for the minimum and maximum values, such as 2-2.9 and another set for 3-3.9.
Cloning Existing Scoring Criteria Within the Same Assigned Fund
Simultaneously, the system will allow you to clone the existing criteria. For example, if you need to add additional criteria for another state, where if the applicant selects 'Michigan' ('MI'), then you want to score them 5.
-
Step 1: Once you are on the 'Manage Automated Scoring' page, you will be able to view the clone button next to the scoring criteria.
-
Step 2: After clicking on the clone button, you will be presented with the 'Edit Automated Scoring Criteria' screen, which displays the existing criteria's scoring. Here, you need to update the criteria and click on 'Save & Exit'.
Once you have finished creating the automated scoring criteria for the selected fund and wish to copy the same automated scoring to another fund, you can do so by clicking on the 'Clone Automated Scoring' button on the 'Manage Automated Scoring' screen. To learn more, please click here.