Core Principles of Assessment
It is a fundamental component of both learning and teaching and is a central component of teaching and the curriculum.
What is assessment?
Assessment
What is process employed to make judgements about learners achievements?
Aligning the test or the observation to the learning objectives for the course or the rotation
What will ensure the assessment is valid/reliable
It's all reflective to me
What is reflect rubric for assessing reflective writing
Using multiple methods, multiple assessors, and decision making
what is optimizing assessment
Purpose behind Assessment
What is optimizing learning?
Develop a faculty development program to train raters to diminish severity, leniency, central tendency and the halo effect.
What are ways to account for variability in faculty doing assessments
"My congratulations, Captain—a dazzling display of logic"
What is Using a Logic Model to Assist in the Planning, Implementation, and Evaluation of Educational Programs?
"Wisdom of crowds" A group process conducted by clinical competency committees is now a required component of the Next Accreditation System in the United States for graduate medical education
What is value of group assessment?
It's an Assessment of Competence
What is Hundert's six interrelated domains model used to assess?
"A useful way to understand the concept of the progression of knowledge, skills and attitudes in medical education".
What is Miller's Framework for clinical assessment?
it measures what is meant to measure
What is a valid assessment instrument?
A proposed model that incorporates an assessment of medical knowledge, technical skill, clinical reasoning, professionalism, communication skills and reflection.
What do we want to assess to ensure development of entrustable professional activities?
An effective educational intervention
What is peer assessment of learners?
It is the consistency or reproducibility of an assessment.
What is reliability?
Useful equation
what is van der Vleuten and Shuwirth’s3 utility equation (ie, utility x validity x reliability x acceptability x educational impact x cost effectiveness)?
A way to improve the assessment system
What is ongoing learner assessment and program evaluation?
"Students can, with difficulty, escape from....
but can't escape from....."
What is poor teaching but not poor assessment?
1.Organized, integrated, and comprehensive. 2. Complementary to the summative assessment system. 3. Provides data and feedback in many different forms from a variety of sources.
What are some elements of a formative assessment system?
I'm a rater, you're a rater, we're all raters
what is inter-rater reliability?