{"id":59,"date":"2024-04-04T02:50:39","date_gmt":"2024-04-03T23:50:39","guid":{"rendered":"https:\/\/sisu.ut.ee\/juhendid\/tips-adapting-assessment-distance-learning\/"},"modified":"2024-04-10T20:01:24","modified_gmt":"2024-04-10T17:01:24","slug":"tips-adapting-assessment-distance-learning","status":"publish","type":"page","link":"https:\/\/sisu.ut.ee\/juhendid\/tips-adapting-assessment-distance-learning\/?lang=en","title":{"rendered":"Tips for adapting assessment for distance learning"},"content":{"rendered":"

\n\tRegardless of the emergency situation, it is important to understand how well the students have learnt and acquired the learning outcomes. As the content, volume and form of several courses has changed, it may also be necessary to also review the assessment of the course. If it is necessary to make changes in the assessment, the changes should be coordinated with students as soon as possible. The changes should also be recorded in the SIS.\u00a0<\/span>To change the form of assessment from graded to pass\/fail assessment, you have to submit a proposal made in consultation with the programme director; the change will be entered in the SIS by Office of Academic Affairs.\n<\/p>\n

\n\tGENERAL RECOMMENDATIONS<\/span><\/span>
\n<\/h2>\n
    \n
  1. \n\t\tReview the plans made at the beginning of the semester<\/span><\/b>\n
      \n
    1. \n\t\t\t\tIf the course in its content and form is, irrespective of the emergency situation, quite similar to what it was before (fully e-course or a course with extensive online support), it can be assessed as planned.\u00a0 <\/span>\n\t\t\t<\/li>\n
    2. \n\t\t\t\tThe assessment may take place in the planned form and no changes are needed (e.g. essay, project, electronic test). <\/span>\n\t\t\t<\/li>\n
    3. \n\t\t\t\tIf these forms of assessment are not suitable, think whether formal rearrangements are enough (bringing a test paper into the online environment) or more substantive changes are needed (for example, changing the problem setting or type of questions). <\/span><\/span>\n\t\t\t<\/li>\n
    4. \n\t\t\t\tCheck that the summative assessments and intermediate tasks are in balance. To support students\u2019 learning, it may be reasonable to distribute assignments over time. Make a clear system how many points students can get from interim assignments, and negotiate it with students. <\/span><\/span>\n\t\t\t<\/li>\n
    5. \n\t\t\t\tEnsure that assessments are not accumulated to the end of semester. If you change the method and time of assessment, it is important that you consult with the programme director who will see that the schedule of assessment in different courses is reasonable.\n\t\t\t<\/li>\n<\/ol>\n<\/li>\n
    6. \n\t\tIf changes are necessary\u2026<\/span><\/b><\/span>\n
        \n
      1. \n\t\t\t\tIf major changes are needed, first of all think of the learning outcomes. What is the most important that the student has to obtain (knowledge, skills, attitudes)? Consider the activities and assignments that would show the acquisition of the learning outcomes.\u00a0 <\/span><\/span>\n\t\t\t<\/li>\n
      2. \n\t\t\t\tIf you have already reduced the planned volume of studies, consider which part of the course should definitely be tested and what assignment would be the best for testing. <\/span><\/span>\n\t\t\t<\/li>\n
      3. \n\t\t\t\tInstead of a classical test paper, other assessment methods can be used in distance learning: for example, case analysis and problem-solving tasks (incl. justification, references to learning materials); making a study aid or a short lecture (e.g. 3 min) on a specific topic; an essay or a short paper; a critical analysis of a scientific article or research report; students prepare questions about the materials; group work \/ group project (with report).<\/span><\/span>\n\t\t\t<\/li>\n<\/ol>\n<\/li>\n
      4. \n\t\tHow to plan the duration of an online test or exam? <\/span><\/b><\/span>\n
          \n
        1. \n\t\t\t\tTaking an online exam may take the students more time (for example, adaptation to the technological environment, reading from the screen, and therefore, also reading the assignment online take more time). <\/span><\/span>\n\t\t\t<\/li>\n
        2. \n\t\t\t\tTo better plan the exam duration, it is best to take the test yourself. <\/span>The time you as a teacher spend on the test should be multiplied by the coefficient 1.5.<\/span>\n\t\t\t<\/li>\n
        3. \n\t\t\t\tWhen you set a time limit to an exam, consider that reproducing factual knowledge takes less time than discussions, analysis, case studies. <\/span>\n\t\t\t<\/li>\n
        4. \n\t\t\t\tIt is possible to adjust the time for answering by specifying the recommended length of answers to open-ended questions (approximate maximum number of words).<\/span>\n\t\t\t<\/li>\n
        5. \n\t\t\t\tBefore an important exam giving a test exam with similar technical requirements is recommended. The test exam may be short, consisting of just a few questions. It helps everyone to try out and ensure that the system works.\n\t\t\t<\/li>\n<\/ol>\n<\/li>\n
        6. \n\t\tIn the case of distance learning, the teachers\u2019 burden of providing feedback is likely to increase. How to give feedback efficiently?<\/span><\/b><\/span>\n
            \n
          1. \n\t\t\t\tIf you use the Moodle assignment or workshop activity for testing, you can use the marking guide or rubrics (see <\/span><\/span>instructions<\/a>, question 3). Create simple and clear assessment criteria with a scale. This way, instead of writing lengthy feedback, you can just tick the suitable boxes.<\/span><\/span>\n\t\t\t<\/li>\n
          2. \n\t\t\t\tGive audio feedback (with audio or video recording). For example, in Moodle forums, feedback to assignments, etc., where the Moodle text editor is used for giving feedback, you can record up to two-minute feedback in audio or video and present it to learners. It is also possible to use recording in Panopto to give feedback. Panopto allows recording of comments and assessments.<\/span><\/span>\n\t\t\t<\/li>\n
          3. \n\t\t\t\tSet a task for students to give feedback to a fellow student (for example, using the given marking guide). Ask students to justify their reasoning and assessment when giving feedback. This also makes it possible to assess the student who gives feedback.<\/span><\/span>\n\t\t\t<\/li>\n
          4. \n\t\t\t\tSpecify the recommended length of answers to open-ended questions (approximate number of words), so you can avoid getting overly long answers.\u00a0<\/span><\/span>You can switch on the word count in Moodle forum, and the word limit can be set in the assignment.\n\t\t\t<\/li>\n
          5. \n\t\t\t\tIf the course is large and you give feedback to the whole course, there is a risk that students may not be able to associate the feedback with their individual work. When you give general feedback to students, also ask everyone to find comments about their own work in the feedback.\n\t\t\t<\/li>\n<\/ol>\n<\/li>\n
          6. \n\t\tHow can you ensure that learners do not use external help while taking the test in distance learning?<\/span><\/b><\/span>\n
              \n
            1. \n\t\t\t\tAs teachers-lecturers we cannot ensure it, but we can trust the students and design the assignments in such a way that there is no point in using outside help. A well designed assessment task is a good opportunity to learn.\u00a0<\/span><\/span>Read about technical solutions and rules for identification of students below (No. 6).\n\t\t\t<\/li>\n
            2. \n\t\t\t\tInstead of testing the knowledge of facts, you should test understanding and application of knowledge. Ask students to explain their answers and reasoning (you may ask them to (audio) record and present the answers in Moodle, for example in a forum or using the assignment resource or the test, as an answer to essay-like question). <\/span><\/span>\n\t\t\t<\/li>\n
            3. \n\t\t\t\tUse an open test for assessment (permitting the use of any materials) \u2013 prepare questions that require students to think more thoroughly (for example, compare, explain the reasons for this phenomenon).<\/span><\/span>\n\t\t\t<\/li>\n
            4. \n\t\t\t\tSet a time limit for answers.<\/span><\/span>\n\t\t\t<\/li>\n
            5. \n\t\t\t\tPrepare a larger test question bank or versions of the same assignment with different source data, and divide questions to students randomly. <\/span><\/span>\n\t\t\t<\/li>\n
            6. \n\t\t\t\tBefore the exam, ask students to take a so-called oath of honesty<\/b> (for example: I will answer the questions without using outside help\/ I will answer the questions entirely on my own, using only the materials and resources permitted by the teacher<\/i>).<\/span><\/span>\n\t\t\t<\/li>\n<\/ol>\n<\/li>\n
            7. \n\t\tUse of technical solutions to evaluate student performance in tests and exams<\/strong>\n
                \n
              1. \n\t\t\t\tIf it is important to ascertain the identity of a learner during the exam, various technical solutions can be used.\n\t\t\t<\/li>\n
              2. \n\t\t\t\tOne method of checking the exam is to video record the exam: both the screen and the student.\n\t\t\t<\/li>\n
              3. \n\t\t\t\tIn this case, you should inform the student (ask the student\u2019s informed consent) and if the student refuses consent, offer a possibility to take a face-to-face exam.\n\t\t\t<\/li>\n
              4. \n\t\t\t\tThe student can record the exam, using, for example, the following computer programs:\n
                  \n
                1. \n\t\t\t\t\t\tScreen-o-matic \u2013 enables to record the screen and the webcam video at the same time; record up to 15-minute videos with the free version\n\t\t\t\t\t<\/li>\n
                2. \n\t\t\t\t\t\tOpen Broadcaster Software (OBS) \u2013 enables to record the screen and the webcam video at the same time\n\t\t\t\t\t<\/li>\n
                3. \n\t\t\t\t\t\tQuickTime Player (MacOS) \u2013 enables to record either the screen or the webcam video\n\t\t\t\t\t<\/li>\n
                4. \n\t\t\t\t\t\tPanopto \u2013 enables to capture both the screen and the webcam video, the recording is saved in the UT server, in the Panopto folder of the course, subfolder Assignments. Only the learner and the teacher can access the recorded videos. See instructions<\/a>.\n\t\t\t\t\t<\/li>\n<\/ol>\n<\/li>\n
                5. \n\t\t\t\tStudents can save the files on their computer and later upload them to the UT server and make them available for the teacher. This can be done by means of OneDrive, which each student has the right to use. The student may delete the recording later. Alternatively, it is possible to use the ownCloud server that is offered by the UT and works similarly. Detailed instructions for using OneDrive and ownCloud are available on the Helpdesk<\/a> page.\n\t\t\t<\/li>\n
                6. \n\t\t\t\tThe data recorded for identification, i.e. the videos, may be preserved no longer than until the end of the academic year. It is important to ensure technical readiness and a person responsible for deleting the data. If necessary, IT Helpdesk can help you.\n\t\t\t<\/li>\n
                7. \n\t\t\t\tThe Urkund plagiarism checking system<\/a> can be used for plagiarism detection in exam assignments.\n\t\t\t<\/li>\n
                8. \n\t\t\t\tSee also Frequently asked questions on video recordings of exams and assignments<\/a>.\n\t\t\t<\/li>\n<\/ol>\n<\/li>\n
                9. \n\t\tOrganising of thesis defences during emergency situation<\/strong>\n
                    \n
                  1. \n\t\t\t\tThesis defences may be held either with up to ten people present in the room, or online. For defences that are held in the physical room, the same measures apply as those applicable to face-to-face studies after 18 May.\n\t\t\t<\/li>\n
                  2. \n\t\t\t\tIn the case of virtual defences, due to personal data protection requirements, only applications approved by Information Technology Office must be used. The permitted video transmission applications are\u00a0BigBlueButton, Teams and Zoom. When the session is recorded it is important to ensure that the recordings are saved in storage locations under the control of the university. If you will record with Teams\u00a0make sure that the recording is not available in Stream to all UT members.\n\t\t\t<\/li>\n
                  3. \n\t\t\t\tIn order to record the defence meeting and to transmit or publish the recording, it is necessary to ask the student\u2019s written consent. The responsibility to prove the student\u2019s consent lies with the person who further processes the video recording (views, transmits or discloses the recording).\n\t\t\t<\/li>\n
                  4. \n\t\t\t\tThe recording is not stored longer than until the end of the academic year; the person who recorded the video is responsible for deleting the recording.\n\t\t\t<\/li>\n
                  5. \n\t\t\t\tTechnical advice and support is provided by IT Helpdesk.\n\t\t\t<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n

                    \n\tRECOMMENDATIONS BY ASSESSMENT METHODS <\/span><\/span><\/span>
                    \n<\/h2>\n\n\n\n\n\n\n
                    \n\t\t\t\tPlanned form of exam<\/span><\/b><\/span>\n\t\t\t<\/td>\n\n\t\t\t\tTips on how it could be done<\/span><\/b><\/span>\n\t\t\t<\/td>\n<\/tr>\n
                    \n

                    \n\t\t\t\t\tWRITTEN\u00a0<\/strong>\n\t\t\t\t<\/p>\n

                    \n\t\t\t\t\tEXAM\u00a0<\/strong>\n\t\t\t\t<\/p>\n

                    \n\t\t\t\t\t(closed materials, classroom; multiple choice questions and open-ended questions)\n\t\t\t\t<\/p>\n<\/td>\n

                    		\n

                    \n\t\t\t\t\tIn the emergency situation it is possible to have the written exam using online tools (for example, Moodle test, assignment).\u00a0\n\t\t\t\t<\/p>\n

                      \n
                    1. \n\t\t\t\t\t\tBefore the test, ask students to restart<\/i> their computers \u2013 this helps to ensure that nothing goes wrong.\u00a0\n\t\t\t\t\t<\/li>\n
                    2. \n\t\t\t\t\t\tSet a time limit <\/b>for both closed and open exam: remember that reproduction of factual knowledge takes less time than explorative, analysing problem tasks and questions. If possible, test how long it takes an average student to answer; if you try out the test yourself, multiply the time it takes you to answer with a coefficient 1.3\u20131.5.\n\t\t\t\t\t<\/li>\n
                    3. \n\t\t\t\t\t\tIn Moodle assignment you may prepare the task <\/span><\/span>so that the learner has to submit the answer in audio or video, recording it in the online assignment using the text editor.<\/span><\/span>\n\t\t\t\t\t<\/li>\n
                    4. \n\t\t\t\t\t\tIn Moodle assignment it is possible to make the exam assignment available for a fixed period only, so the learner can see the description of the assignment from the moment the assignment is open for submission.<\/span><\/span><\/span>\n\t\t\t\t\t<\/li>\n
                    5. \n\t\t\t\t\t\tIn Moodle assignment it is recommended that you require learners to use the button Add submission.<\/i><\/span><\/span><\/span>\n\t\t\t\t\t<\/li>\n
                    6. \n\t\t\t\t\t\tIf you use an open-end (essay-type) question, we recommend setting a word limit to the answer <\/b>(specify the recommended maximum length of the answer). <\/span><\/span>Prepare more questions to choose from<\/b> \u2013 the system will randomly select a different set of questions for each student.<\/span>\n\t\t\t\t\t<\/li>\n
                    7. \n\t\t\t\t\t\tAsk questions that require comparison<\/b>, application<\/b>, analysis<\/b>.<\/span><\/span><\/span>\n\t\t\t\t\t<\/li>\n
                    8. \n\t\t\t\t\t\tIf you use the Moodle test, it is advisable to set the test so that after the test submission time has passed, the answers are revealed to students automatically, and if there are many questions in a test, they are not all on the same page. When the learner moves on to the next page, the previous answer is saved to ensure that the answer is not lost if internet connection is interrupted. If questions are placed on separate pages, it is more complicated for learners to share the answers with other learners.<\/span><\/span><\/span>\n\t\t\t\t\t<\/li>\n
                    9. \n\t\t\t\t\t\tIt is recommended you set in the test settings that after completing the test (until all learners have completed it) the learner is only displayed the score and the general feedback. This helps to ensure that the questions and answers are not share to other learners.<\/span><\/span><\/span><\/span>\n\t\t\t\t\t<\/li>\n
                    10. \n\t\t\t\t\t\tIf the time limit for the test is, for example, 30 minutes, definitely make the test available for more than 30 minutes (for example, 40 minutes), because not all students may be able to start exactly at the time the test is made available and as a result, cannot pass the test on time.<\/span><\/span><\/span>\n\t\t\t\t\t<\/li>\n
                    11. \n\t\t\t\t\t\tIf you use the test window with JavaScript security (full-screen pop-up, which covers other windows and has not navigation bars, the learner cannot paste an answer copied from another page into the answer box, and you cannot open the menu by right clicking), let the learners know in advance that they cannot paste the answer in the answer box. Otherwise it may happen that the learner types a long answer in Word and later discovers that it is not possible to paste the answer into the answer box and needs to start answering from the beginning.<\/span>\u00a0<\/span><\/span><\/span><\/span>\n\t\t\t\t\t<\/li>\n
                    12. \n\t\t\t\t\t\tFor problem-solving tasks (e.g. mathematical tasks) that require showing the way to solution, ask students to write the way to solution on paper<\/b> and send it to you as a legible image\/photo (for example, in the Moodle course using Assignment or in the forum) \u2013 combine a written exam with brief oral discussions in the online environment.<\/span><\/span><\/span>\n\t\t\t\t\t<\/li>\n<\/ol>\n

                      \n\t\t\t\t\tWhen you plan an exam in an e-course, you may ask for help from the instructional designer of your faculty (which tool to use, technical solutions) or academic developers (methodological support). Instructions for Moodle test: https:\/\/sisu.ut.ee\/juhendid\/test<\/a>\n\t\t\t\t<\/p>\n<\/td>\n<\/tr>\n

                    \n

                    \n\t\t\t\t\tORAL EXAM <\/span><\/span><\/strong>\n\t\t\t\t<\/p>\n

                    \n\t\t\t\t\t(see example 2)<\/span><\/span>\n\t\t\t\t<\/p>\n<\/td>\n

                    		\n

                    \n\t\t\t\t\tTaking an oral examination in the online environment differs from a similar exam taken in a classroom. This form of exam may be less formal (as you are at each other\u2019s home) and therefore also the style of communication may be different. Before the exam, check what is visible in the background (if possible, blur the background) and ensure that no one or nothing interrupts you during the exam. <\/span><\/span>\n\t\t\t\t<\/p>\n

                      \n
                    • \n\t\t\t\t\t\tInform the student in advance<\/span><\/b> when and in which e-learning environment the exam takes place; the estimated duration of the exam and how it is conducted (describe the process). <\/span><\/span><\/span>\n\t\t\t\t\t<\/li>\n
                    • \n\t\t\t\t\t\tAs an introduction<\/span><\/b>, ask the student how he\/she has been doing, this helps both get adjusted to the e-meeting; once again, give the student an overview of how the exam will be conducted and give the student an opportunity to ask questions. <\/span><\/span><\/span>\n\t\t\t\t\t<\/li>\n
                    • \n\t\t\t\t\t\tIf necessary, ask the student to present an identity document<\/b>.<\/span><\/span><\/span>\n\t\t\t\t\t<\/li>\n
                    • \n\t\t\t\t\t\tAgree with the student on whether and how you use the web camera during the exam and whether the exam session is recorded.<\/span><\/span><\/span>\n\t\t\t\t\t<\/li>\n
                    • \n\t\t\t\t\t\tConsider how to present the exam questions to the student. Before the e-meeting you may give a preliminary assignment<\/b> (analysis, calculation, problem-solving task, case, e-test), on which basis you can start the conversation. <\/span><\/span><\/span>\n\t\t\t\t\t<\/li>\n
                    • \n\t\t\t\t\t\tGive the student a fixed time for preparation<\/b> before answering. Decide whether you continue online contact during the preparation or you make contact again after the preparation time ends. <\/span><\/span><\/span>\n\t\t\t\t\t<\/li>\n
                    • \n\t\t\t\t\t\tWhile the student is answering, take notes<\/b> about the answers. This will ensure that the information is recorded in case an unexpected technical failure occurs.\u00a0 <\/span><\/span><\/span>\n\t\t\t\t\t<\/li>\n<\/ul>\n
                        \n
                      • \n\t\t\t\t\t\tAfter the exam questions have been answered, immediately give feedback<\/b> to the student, or first ask the student to evaluate his or her performance.<\/span><\/span><\/span>\n\t\t\t\t\t<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n
                    \n\t\t\t\tPRESENTATION OF GROUP WORK OR PROJECT<\/span><\/span><\/strong>\n\t\t\t<\/td>\n\n\t\t\t\tStudents can present their group work using BigBlueButton. They can also provide feedback to each other. To assess each student\u2019s contribution to group work, you may ask the students to add process analysis \u2013 the group will take records of each student\u2019s ideas and contribution. Group members can also score each student\u2019s contribution in Moodle.<\/span><\/span>\n\t\t\t<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

                    \n\t
                    Tips for online assessment (easy-to-read methods and principles):\u00a0<\/span>https:\/\/www.teachology.ca\/knowledgebase\/how-do-i-assess-student-learning-online<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

                    Regardless of the emergency situation, it is important to understand how well the students have learnt and acquired the learning outcomes. As the content, volume and form of several courses has changed, it may also be necessary to also review …<\/p>\n","protected":false},"author":6,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"inline_featured_image":false,"footnotes":""},"class_list":["post-59","page","type-page","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/sisu.ut.ee\/juhendid\/wp-json\/wp\/v2\/pages\/59","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sisu.ut.ee\/juhendid\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/sisu.ut.ee\/juhendid\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/sisu.ut.ee\/juhendid\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/sisu.ut.ee\/juhendid\/wp-json\/wp\/v2\/comments?post=59"}],"version-history":[{"count":1,"href":"https:\/\/sisu.ut.ee\/juhendid\/wp-json\/wp\/v2\/pages\/59\/revisions"}],"predecessor-version":[{"id":1792,"href":"https:\/\/sisu.ut.ee\/juhendid\/wp-json\/wp\/v2\/pages\/59\/revisions\/1792"}],"wp:attachment":[{"href":"https:\/\/sisu.ut.ee\/juhendid\/wp-json\/wp\/v2\/media?parent=59"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}