Assessment - FAQ
What is a weekly feedback quiz?
Weekly feedback quizzes are short quizzes delivered through Examplify that first year and second year Foundations Curriculum students will complete at home each week. While low stakes, these will help students examine how well they have learned the week’s material. These quizzes will focus on key concepts that must be understood, but some higher-level questions related to comprehension and application of concepts will also be included.
Is there a time limit to complete the weekly feedback quiz?
There is no time "limit" to complete the quiz; however, it is best to do the quiz in one sitting. Students are expected to complete the quizzes before the deadline in order for their results to be uploaded to the Learner Chart.
Do I get the results of the weekly feedback quiz right away?
Yes, you will be able to see your score as soon as you complete the quiz. Also, once your quiz has been uploaded you will receive a detailed feedback report in your ExamSoft account.
Additional weekly feedback quiz attempts
Students have access to two additional attempts of each weekly feedback quiz. These attempts are for learning purposes only and will not appear in the Learner Chart. Students will receive feedback reports in their ExamSoft accounts, showing the learning objectives attached to all questions and the question stems, after completing the quiz and after each subsequent attempt.
What if I forgot to do a weekly feedback quiz, or am sick and cannot write the quiz?
There is no make-up time or approvals of absence or deferrals if students miss a quiz. Missed weekly feedback quizzes will be indicated as incomplete in your Learner Chart.
What is a mastery exercise?
Mastery exercises are mandatory invigilated written assessments for first, second and third year students. Students complete these assessments using Examplify on their own devices. These assessments may include multiple-choice questions, short-answer questions, essay questions or key feature questions.
Are mastery exercises all weighted equally in Foundations Curriculum courses?
No, mastery exercises are weighted according to the amount of material (number of weeks of material) they cover in the first and second years.
Mastery exercise question review for Foundations Curriculum students
Faculty will provide a debrief or ‘teaching point’ for questions answered poorly by the class. Neither the question nor answers will be released. This is to maintain the integrity of the exam bank, and to ensure that students focus on the learning objective addressed by the question or the learning gap identified as opposed to the question itself.
Students who performed poorly on a Mastery Exercise should reach out to the OHPSA academic coach or course director to discuss learning and studying strategies. Rules and regulations are in place to maintain the integrity of the MD Program’s question banks. Hence, viewing of assessments is limited to written assessments that include short answer questions (SAQs) and/or other narrative components, in order to request a re-mark of a written assessment.
How are mastery exercises created for Foundations Curriculum courses?
Multiple choice questions (MCQs) on mastery exercises are written to assess one or more end-of-week learning objective(s). MCQs are developed by content experts who are usually directly involved in teaching. The question stems in the MCQs will include all of the information required to answer the question. There is one correct answer and three incorrect alternatives known as distractors.
Mastery exercise questions are designed to assess not just whether students can remember facts and understand concepts, but also if they can apply the content being taught to a real-life like clinical situation.
Any learning objective can serve as the basis of an assessment question on a mastery exercise, including those objectives that are covered by pre-week and self-learning.
Following each mastery exercise, and prior to approving the students’ results for publication, the course director reviews the performance statistics of each question and the mastery exercise as a whole in accordance with evidence-informed processes endorsed by the Test Committee.
Once the mastery exercise results are approved by the course director students will receive a report summarizing their performance that can be used to guide their further studying.
How is the passing mark of mastery exercises determined for Foundations Curriculum courses? Why are they different for the different courses in the Foundations Curriculum?
Based on the input and review of the the Student Assessment and Standards Committee (SASC), the Foundations Committee, and the Curriculum Committee, we currently use the Hofstee method for standard setting for Mastery Exercises (ME). This approach asked members from SASC and the Foundations Committee to examine ME data from the previous academic year. Using their understanding of the objectives and goals of each course as well as the historical ME data, each committee member was asked to estimate what the acceptable values would be for the minimum and maximum pass mark in each course as well as the minimum and maximum number of students who could possibly be below the pass mark. This does not mean that there will always be the minimum number of students below the pass mark every year. Instead, these judgements are just an approach to help judges communicate their sense of the expected difficulty of each course. Combing all of this information from members of both committees, we plot the average values on to previous ME data for a particular course and identify which score satisfies the best estimates of the committee. This point becomes the new pass mark for the course. The current year’s pass marks were estimated using the data from the 2018/19 MEs. The new pass marks are deployed and re-evaluated again at end of the academic year.
ITM - 76
CPC 1 - 73
CPC 2 - 70
CPC 3 - 72
Adapted CPC 3 - 72
Life Cycle - 74
Complexity and Chronicity - 75