The following view is visible as soon as you open the assessment tool in a course:
At a glance it is visible for which user a review is pending. It is also shown how many elements for a user need to be assessed. If there is only 1 element to assess it is listed directly. With a click on this element your directly in the corresponding assessment.
Only pending reviews are shown. Already realized reviews are not listed.
This list shows the number of users, groups and course elements which can be assessed. If you click on an entry you're entering directly the corresponding view like in "Assessment user/course structure or groups".
With the tabs "Users" or "Groups" you will get to the real assessment. In general the assessment is undertaken for Users or Course structure. In the menu on the left all course elements that can be assessed appear. The supervisor or course owner can select the element to be assessed and carry out the evaluation.
The visible columns of the table can be adapted. This is helpful to get a quick overview. Especially information about attempts, status and the last updated are often required. Especially the information about the score, attempts and last update are used often. For the update the columns can be differentiated between the update which has been done by the coach or the user, and the technical update.
|Attention: The columns in the single areas can vary between course elements.|
In the cog wheel central settings are available. These are:
Which options are available depends on the course element type and the respective configuration.
If there is a group available, the assessment can be undertaken for a group as well. In the overview all groups of the course are shown. First a group is selected and afterward the corresponding participant, if desired.
For all assessable course elements an assessment form is available. The corresponding setting options vary between course elements. In general here you can:
For the course elements test all completed tests are listed in a table above the assessment form including score, attempts, log file download option etc. The single attempts can be shown in detail if desired.
For the course element task the process is shown.
Afterward the form is saved. With "Save" all entries are saved. With "Save and set to `done` status" all entries are saved and the participant gets the status Assessed in the overview. Changes are only possible, if "Reopen for assessment" is chosen. The status does not have any influence on the visibility of the results.
As soon as a result as score or Passed/Failed is added to the assessment tool, it is visible for the user. But in some cases the result should be available for all users at the same time. This can be a task, a semester work or a test. For such scenarios the visibility of the result can be limited and can be set to visible at the desired moment.
By default all results of all assessable course elements are shown immediately. Only exception is the test, when manual correction is selected. The visibility can either be changed in the assessment form for a single user or for all users together in the overview.
To set the visibility of a single user, open the desired user. In the assessment you can see two possibilities next to results:
"Save and set to `done`status" means that the status in the overview changes from To Review to Assessed. The status done does not have any impact on the visibility.
If files have been handed in with the assessable course element the number of attempts can be changed manually.
To change the visibility for several users at the same time, open the overview of the corresponding course element in the assessment tool. A columnis shown. In this column it is shown, for which users the result is visible ( ), respective not yet visible ( ). As no icon is shown, the default setting is valid. To change the visibility, the desired users can be selected in the column on the left. After confirm with the button "Set `visible`". The following dialogue appears:
All selected users can be set either visible or invisible now. As soon as a user is set to visible he can see his result, the evidence of achievement will be updated and all following course elements depending on this one will be visible or accessible.
With the button "Set to `done`status" the status in the column status is changed. All users which have been set to done get the status assessed. This status helps you to keep an overview of the assessed users. This status does not have any impact on the visibility of the results for the user.
The diverse assessable course elements can be assessed differently. Therefore a short overview follows:
For the assessment of tasks and group tasks download first the submitted documents or the last revised version which has been uploaded by the user. Afterward the assessment form can be filled in.
If desired and configured appropriately a feedback document can be uploaded. This can for e.g. be about a detailed assessment table.
As soon as the assessment of a task is done, the button "Submission accepted" can be exerted. Thus the editing and the assessment of a task is completed definitely. An appropriate notification is sent to the user.
As soon as a user submits a task, no further submission or exchange is possible anymore. If a task is submitted accidentally or the wrong document has been uploaded, the task can be activated with "Re-open submission".
How a task or group task should be assessed e.g. with passed/failed or with a score needs to be defined in the configuration of the course element "task". In the assessment tool the assessment options cannot be changed anymore. Assessments for single or group tasks can be conducted in the course element directly.
If several attempts have been uploaded or many students need to be assessed, it is recommended to download "All submitted files" for all attempts of all students at once. In the downloaded folder you can find the task assignment as well.
For a group task the grading can be given for the whole group. Therefore both check boxes need to be ticked.
If not the whole group passed or not all of them will get the same score "For the whole group" must not be selected. Thus an individual grading per user is possible.
Depending on the question type a test can be assessed automatically. As soon as there the test consists of types with text answers, the assessments needs to be done manually. The manual assessment or possible adaptations can be done right here. The following buttons are available:
Test Statistics: Select the detailed test statistics for every question.
Result reporting: Here all test results can be exported as zip file and thus archived. The zip file title consists of the name of the test, the assigned course as well as the date and time of the download. The result download contains an html file with the user overview, folders with user results and additional files. If the test receipt is activated, it is exported as well.
Pull tests: Tests can be pulled after the end of a test session. Thereby also tests are pulled which have not been handed in or finished by the users.
Grade: With grade tests can be corrected by question type (instead by User). Thus you can see an overview of all entries from all users and you can fill in the result directly. Not the complete name but 1. assessed user, 2. assessed user etc. is shown.To every answer a comment can be added. This comment will be shown to the user in the result report afterward. Additionally for the assessable course elements essay, file upload and drawing a score can be added. In "Overview and closing" the results of all users are filled in one more time and the adaptions are shown. Then the assessment can be closed.
Reset data of test: Hereby all data of the current test are reseted. It means that all data including the results are deleted irrevocable. It is also possible to reset a single test, directly in the corresponding user settings.
Extend: Here the preset test time can be extended.
To undertake a manual assessment, every user needs to be selected separately afterward. The assessment form will then be opened and several actions are possible eg. adapt score, add assessment documents or save the log file.
Finally "Set to 'done' status" needs to be selected. All chosen users will get the status "Assessed".
If any further adaptions should be necessary, the corresponding user can be opened and with "Reopen for assessment" adaptions can be added anyway.
Depending on the question type the test can be assessed manually. As soon as there are question types with text answers in the test, a manual correction is mandatory. This manual assessment or possible adaptions can be made here.
Manual correction - on the user:
To conduct a manual assessment chose the corresponding user. The assessment form opens and adaptions can be done, e.g. adapt score, add assessment documents or save log files.
In the overview table the desired columns can be shown. The score can be shown differentiated between automatically generated score, manual score and final score. With "Reset data of test" all attempts of a user can be deleted.
Manual correction - workflow (anonymized)for the entire test:
Click on "Grade" to get to the questions overview. The table shows all questions of the test, including the corresponding correction state. You can thus see immediately if all corrections have been done, or which questions still need to be assessed and corrected, respectively.
For the correction process you can choose from two options:
Use the navigation - depending on the chosen option - to toggle between questions and users.
If needed, the solution to a question can be expanded.
In the lower part of the screen the correction state of the question is also displayed. You may enter scores or comments. Scores of auto-corrected questions can be overwritten. Furthermore, you can mark the question for review.
It may be that a couple of graders are assessing a test at the same time. If a question is being assessed by one grader, it will be blocked for the other graders.
In the administration, it can be specified for this correction process whether the users are to be listed anonymously (user 1 , user 2...).
For the assessment of the course element "Assessment" the assessment form needs to be filled it.
The assessment of the portfolio is the same in the assessment tool as in the tab grading in the portfolio itself. But here the individual sections cannot be opened, but only assessed. Thus it is recommended to undertake the assessment in the portfolio directly.
The check box of the individual users can be completed manually and the assessment form can be filled in. Depending on the configuration of the course element either a score can be granted and/or the status Passed can be given. Further information to the check list can be found here.
For the SCORM element the assessment form needs to be filled in. It is important, that in the course element in learning content either the Transfer score or passed is selected. Further information you will find here.
Also for the LTI element the assessment form can be filled in and adapted. In the course element in page content "Transfer score" must be selected coercively. According as a scaling factor or the score needs to be defined for passing. Further information about the configuration oft a LTI page you can find here.
Not only is it possible to assess single course elements, but also structure elements or a whole course can be assessed.
Therefore open the tab score the corresponding element. Now, either score and/or passed can be calculated.
If this checkbox is selected, the score of all assessable course elements can be calculated. Every course element which should be included in the calculation need to be selected. Like this it becomes possible to calculate the total score of the desired course elements.
Attention: The set up of the assessment of the course element structure needs to be done in the course editor. In the assessment tool only the results are shown.
If a course is passed can be adopted either from a minimum score or from course elements. For the minimum score the checkbox Calculate score on top needs to be selected. Afterward the minimum score can be defined.
Alternatively it can be defined, that certain assessable course elements need to be passed, to pass either the course or the structure element.
As soon as the requirements for passed are met, the user gets the status Passed.
Finally the failed score can be calculated. In general failed is shown to the user as long as the requirements for passed are not met. But if for example not all assessable course elements are edited yet, the requirements for passed cannot be met. If then the user gets shown a failed nevertheless it can be confusing. Therefore 3 possibilites exist for how to calculated the failed score:
By means of the bulk assessment you can assess several course participants simultaneously at any given time. All you need is a list of rows with values separated by tabs or commas. You will always need a user identification (user name, registered e-mail address or institutional identifier), the score, the passed status and, if so desired, a comment. The easiest way is to use a table from Excel or OpenOffice and fill it with values.
Bulk assessments can be made for the course elements task, group task and assessment. Bulk assessment for the modules task and assessment is carried out via the tab "Users". The bulk assessment for groups is done via the tab "Groups".
Creation of a bulk assessment for the course elements task or assessment
Use an external table processing program, create the required columns and enter the value assignments. Then copy the table data to the bulk assessment input field.
Depending on the configuration of the course element, different options are available. If the "grading" option is not activated in the course element, no bulk assessment can be carried out.
The evidence of achievement allows you to active or deactivate the evidences for the course. Clicking the button "Change configuration" opens "Efficiency statement" in the course setting. You can further initiate a new calculation of all existing evidences by clicking the button "Recalculate evidences of achievement".