Skip to end of metadata
Go to start of metadata

The following view is visible as soon as you open the assessment tool in a course: 

Pending reviews

At a glance it is visible for which user a review is pending. It is also shown how many elements for a user need to be assessed. If there is only 1 element to assess it is listed directly. With a click on this element your directly in the corresponding assessment.

Only pending reviews are shown. Already realized reviews are not listed. 


List of assessable items

This list shows the number of users, groups and course elements which can be assessed. If you click on an entry you're entering directly the corresponding view like in "Assessment user/course structure or groups". 

Assessment Users/course structure or Groups

With the tabs "Users" or "Groups" you will get to the real assessment. In general the assessment is undertaken for Users or Course structure. In the menu on the left all course elements that can be assessed appear. The supervisor or course owner can select the element to be assessed and carry out the evaluation.


The visible columns of the table can be adapted. This is helpful to get a quick overview. Especially information about attempts, status and the last updated are often required. Especially the information about the score, attempts and last update are used often. For the update the columns can be differentiated between the update which has been done by the coach or the user, and the technical update.



Attention: The columns in the single areas can vary between course elements.





In the cog wheel central settings are available. These are:

  • Show details/assess: to get to the corresponding test results
  • Correction: to do a manual assessment
  • Set status "done" or Reopen assessment: change to the corresponding other status
  • Set results (not yet) visible for user: To show or not the results to the users
  • Extend test time: if the test is in the status started
  • Pull running test: It pulls the running test, the user cannot continue his test. However, the results are saved so that the data filled out so far are used for the evaluation and can be seen by the instructor.
  • Reopen finished test: The user can continue his test where he had finished. If the test is limited to 1 attempt, the attempts must be reset as well so the test participant can continue with his test.
  • Reset number of attempts: sets the number of attempts to 0, but the actual test data is retained
  • Reset data of test: all data of the test is reset and cannot be restored

Which options are available depends on the course element type and the respective configuration.

Assess course group

If there is a group available, the assessment can be undertaken for a group as well. In the overview all groups of the course are shown. First a group is selected and afterward the corresponding participant, if desired. 

Assessment form

For all assessable course elements an assessment form is available. The corresponding setting options vary between course elements. In general here you can:

  • create short feedback
  • distribute assessment document
  • define passed/failed
  • score
  • set the visibility of the feedback for the learners
  • make comments for other coaches
  • close the assessment

For the course elements test all completed tests are listed in a table above the assessment form including score, attempts, log file download option etc. The single attempts can be shown in detail if desired. 

For the course element task the process is shown.

Afterward the form is saved. With "Save" all entries are saved. With "Save and set to `done` status" all entries are saved and the participant gets the status Assessed in the overview. Changes are only possible, if "Reopen for assessment" is chosen. The status does not have any influence on the visibility of the results. 

Visibility of results

As soon as a result as score or Passed/Failed is added to the assessment tool, it is visible for the user. But in some cases the result should be available for all users at the same time. This can be a task, a semester work or a test. For such scenarios the visibility of the result can be limited and can be set to visible at the desired moment. 

By default all results of all assessable course elements are shown immediately. Only exception is the test, when manual correction is selected. The visibility can either be changed in the assessment form for a single user or for all users together in the overview. 

To set the visibility of a single user, open the desired user. In the assessment you can see two possibilities next to results: 

  • directly visible for user: as soon as the assessment form is saved, the result is visible for the user
  • not yet visible for user: If the assessment form is saved, the result is saved in the assessment tool but not yet visible for the user. It will only be visible for the user if the result is set to visible manually. 

"Save and set to `done`status" means that the status in the overview changes from To Review to Assessed. The status done does not have any impact on the visibility. 

If files have been handed in with the assessable course element the number of attempts can be changed manually.

To change the visibility for several users at the same time, open the overview of the corresponding course element in the assessment tool. A column   is shown. In this column it is shown, for which users the result is visible (), respective not yet visible (). As no icon is shown, the default setting is valid. To change the visibility, the desired users can be selected in the column on the left. After confirm with the button "Set `visible`". The following dialogue appears: 

All selected users can be set either visible or invisible now. As soon as a user is set to visible he can see his result, the evidence of achievement will be updated and all following course elements depending on this one will be visible or accessible.  

With the button "Set to `done`status" the status in the column status is changed. All users which have been set to done get the status assessed. This status helps you to keep an overview of the assessed users. This status does not have any impact on the visibility of the results for the user. 


Assessment of a single course element 

The diverse assessable course elements can be assessed differently. Therefore a short overview follows:

Tasks and group tasks

For the assessment of tasks and group tasks download first the submitted documents or the last revised version which has been uploaded by the user. Afterward the assessment form can be filled in. 

If desired and configured appropriately a feedback document can be uploaded. This can for e.g. be about a detailed assessment table. 

As soon as the assessment of a task is done, the button "Submission accepted" can be exerted. Thus the editing and the assessment of a task is completed definitely. An appropriate notification is sent to the user. 

As soon as a user submits a task, no further submission or exchange is possible anymore. If a task is submitted accidentally or the wrong document has been uploaded, the task can be activated with "Re-open submission". 

How a task or group task should be assessed e.g. with passed/failed or with a score needs to be defined in the configuration of the course element "task". In the assessment tool the assessment options cannot be changed anymore. Assessments for single or group tasks can be conducted in the course element directly. 

Tip

If several attempts have been uploaded or many students need to be assessed, it is recommended to download "All submitted files" for all attempts of all students at once. In the downloaded folder you can find the task assignment as well.

Group grading

For a group task the grading can be given for the whole group. Therefore both check boxes need to be ticked. 

If not the whole group passed or not all of them will get the same score "For the whole group" must not be selected. Thus an individual grading per user is possible.


Test

Depending on the question type a test can be assessed automatically. As soon as there the test consists of types with text answers, the assessments needs to be done manually. The manual assessment or possible adaptations can be done right here. The following buttons are available: 

Test Statistics: Select the detailed test statistics for every question.

Result reporting: Here all test results can be exported as zip file and thus archived. The zip file title consists of the name of the test, the assigned course as well as the date and time of the download. The result download contains an html file with the user overview, folders with user results and additional files. If the test receipt is activated, it is exported as well.

Pull tests: Tests can be pulled after the end of a test session. Thereby also tests are pulled which have not been handed in or finished by the users. 

Grade: With grade tests can be corrected by question type (instead by User). Thus you can see an overview of all entries from all users and you can fill in the result directly. Not the complete name but 1. assessed user, 2. assessed user etc. is shown.To every answer a comment can be added. This comment will be shown to the user in the result report afterward. Additionally for the assessable course elements essay, file upload and drawing a score can be added. In "Overview and closing" the results of all users are filled in one more time and the adaptions are shown.  Then the assessment can be closed. 

Reset data of test: Hereby all data of the current test are reseted. It means that all data including the results are deleted irrevocable. It is also possible to reset a single test, directly in the corresponding user settings. 

Extend: Here the preset test time can be extended. 

To undertake a manual assessment, every user needs to be selected separately afterward. The assessment form will then be opened and several actions are possible eg. adapt score, add assessment documents or save the log file.

Finally "Set to 'done' status" needs to be selected. All chosen users will get the status "Assessed". 

If any further adaptions should be necessary, the corresponding user can be opened and with "Reopen for assessment" adaptions can be added anyway.





Depending on the question type the test can be assessed manually. As soon as there are question types with text answers in the test, a manual correction is mandatory. This manual assessment or possible adaptions can be made here. 

Manual correction - on the user:

To conduct a manual assessment chose the corresponding user. The assessment form opens and adaptions can be done, e.g. adapt score, add assessment documents or save log files. 

In the overview table the desired columns can be shown. The score can be shown differentiated between automatically generated score, manual score and final score. With "Reset data of test" all attempts of a user can be deleted.


Manual correction - workflow for the entire test:

Click on "Grade" to get to the questions overview. The table shows all questions of the test, including the corresponding correction state. You can thus see immediately if all corrections have been done, or which questions still need to be assessed and corrected, respectively.

  • Auto: questions automatically corrected by the system
  • Manual: questions corrected manually
  • Not corrected: questions which haven't been corrected yet
  • To review: questions marked for review (click on cog wheel to activate)


For the correction process you can choose from two options:

  • Tab Questions: For each question the answers of all (anonymized) participants are corrected subsequently
  • Tab Users: For each participant all questions of the test are corrected subsequently

Use the navigation - depending on the chosen option - to toggle between questions and users.

If needed, the solution to a question can be expanded.

In the lower part of the screen the correction state of the question is also displayed. You may enter scores or comments. Scores of auto-corrected questions can be overwritten. Furthermore, you can mark the question for review.

It may be that a couple of graders are assessing a test at the same time. If a question is being assessed by one grader, it will be blocked for the other graders.

In the administration, it can be specified for this correction process whether the users are to be listed anonymously (user 1 , user 2...).




Assessment

For the assessment of the course element "Assessment" the assessment form needs to be filled it. 




Portfolio

The assessment of the portfolio is the same in the assessment tool as in the tab grading in the portfolio itself. But here the individual sections cannot be opened, but only assessed. Thus it is recommended to undertake the assessment in the portfolio directly. 



Check list

The check box of the individual users can be completed manually and the assessment form can be filled in. Depending on the configuration of the course element either a score can be granted and/or the status Passed can be given. Further information to the check list can be found here


SCORM

For the SCORM element the assessment form needs to be filled in. It is important, that in the course element in learning content either the Transfer score or passed is selected. Further information you will find here

LTI

Also for the LTI element the assessment form can be filled in and adapted. In the course element in page content "Transfer score" must be selected coercively. According as a scaling factor or the score needs to be defined for passing. Further information about the configuration oft a LTI page you can find here.  

Assessment structure or course 

Not only is it possible to assess single course elements, but also structure elements or a whole course can be assessed. 

Therefore open the tab score the corresponding element. Now, either score and/or passed can be calculated. 

Calculate score

If this checkbox is selected, the score of all assessable course elements can be calculated. Every course element which should be included in the calculation need to be selected. Like this it becomes possible to calculate the total score of the desired course elements. 

Attention: The set up of the assessment of the course element structure needs to be done in the course editor. In the assessment tool only the results are shown.



Calculate passing score 

If a course is passed can be adopted either from a minimum score or from course elements. For the minimum score the checkbox Calculate score on top needs to be selected. Afterward the minimum score can be defined. 

Alternatively it can be defined, that certain assessable course elements need to be passed, to pass either the course or the structure element. 

As soon as the requirements for passed are met, the user gets the status Passed. 

Finally the failed score can be calculated. In general failed is shown to the user as long as the requirements for passed are not met. But if for example not all assessable course elements are edited yet, the requirements for passed cannot be met. If then the user gets shown a failed nevertheless it can be confusing. Therefore 3 possibilites exist for how to calculated the failed score:

  • Failed as not passed: As long as the requirements for passed are not met, failed will be shown (as described above)
  • Failed as not passed after end date of course: The calculation of the failed score is only done, when the end date of the course is reached. 
  • Set manually: Failed is only shown to the user if set manually.

Bulk assessment

By means of the bulk assessment you can assess several course participants simultaneously at any given time. All you need is a list of rows with values separated by tabs or commas. You will always need a user identification (user name, registered e-mail address or institutional identifier), the score, the passed status and, if so desired, a comment. The easiest way is to use a table from Excel or OpenOffice and fill it with values.

Bulk assessments can be made for the course elements task, group task and assessment. Bulk assessment for the modules task and assessment is carried out via the tab "Users". The bulk assessment for groups is done via the tab "Groups".


Creation of a bulk assessment for the course elements task or assessment

Use an external table processing program, create the required columns and enter the value assignments. Then copy the table data to the bulk assessment input field.

Depending on the configuration of the course element, different options are available. If the "grading" option is not activated in the course element, no bulk assessment can be carried out.

 How to create a bulk assessment

Select course element

Select the assessable course element for which a bulk assessment should be carried out. All course elements are displayed for which at least one of the following assessment features is configured:

  • Score
  • Passed
  • Comment
  • Files

Data input

Enter the assessment data for all users in the second wizard step.

Assessment values

A data row must include the following information:

  • User identification (user name, registered mail address or institutional identifier)
  • Score. Add decimals with either comma or period. Use with caution. Do not use comma decimals when applying the comma separator.
  • Passed status (see below)
  • A comment may be added if so desired

You can then start bulk assessment.

The individual steps of a bulk assessment:


1. Assessment data

Upload the assessment data created outside of OLAT by inserting the information into the free field with copy+paste.

A data line must always contain the following information:

  • User identification (user name, registered email address or institution number/matriculation number)
  • Number of points. Subpoints can be entered with commas or dots (Note: commas cannot be used if commas are used as separators)
  • Status (see below)
  • If desired, a comment can be entered in fourth position.

You can also enter data manually. Select "separated by comma" for correct input format. See below for some examples.

alesend,5,y,HervorragendThe user gets a score of 5, a passed status and a comment added.
aalesend,,y,HervorragendIf no score is required, you can omit it, but you still have to use a placeholder.
alesend,4,y,""Already existing comments can be resetted by adding "".

Use the following entries to set the passed status:

y, yes, passed, true, 1 Passed
n, no, failed, false, 0 Failed

Only for bulk assessment of the task module:

Create a folder for each individual student who receives a return file. Enter the individual feedback for each person there. Zip the file and upload it in the first step under "Assessment values".

2. Column mapping

Here you can define which columns of your externally created scoring stand for which field (for example, identifier, score, passed, comment). If you have not selected these options, the step can be skipped.

3. Validation

Here you can see again which information is transferred how and if there are any problems.

4. Schedule

Here you can define whether the valuation takes place immediately or only on a certain date.

You can also enter data manually. To do this, you must select "separated by comma" to accept the data correctly.

Proceed in the same way for group assessment. Select the desired group in the tab "Groups" and start the option "New bulk assessment" in the menu that appears.


Efficiency Statements

The evidence of achievement allows you to active or deactivate the evidences for the course. Clicking the button "Change configuration" opens "Efficiency statement" in the course setting. You can further initiate a new calculation of all existing evidences by clicking the button "Recalculate evidences of achievement".