Assessments that evaluate a students ability to apply the knowledge and skills they've learned in a practical content
What are performance assessments?
Acronym for a large insurance company and method to generate large quantities of test content
What is AIG?
Denotes where you stopped reading and popular standard setting method.
What is the bookmark?
Body part + Committee of State Advisors = Poster Hanger
What is a thumb TAC?
Q1
Q1
Response time indicator + marriage invitation deposit
What is an "Engagement Ring"?
The two groupings in a DIF analysis
What is focal and reference?
Former residents of Thailand + online test delivery method = Common Pet
What is a Siamese CAT?
The book "The Big Test" is about which assessment?
What is the SAT?
Performance assessment appears to be regaining popularity as an administration format
Discussion Topic:
What role do you think performance assessments will play in large scale assessment in the near future?
The use of AIG to generate content that accurately reflects content standards is very appealing
Discussion Topic:
Should AIG be utilized to generate items for summative assessments?
Standard setting involves the intersection of psychometrics, content, policy and group dynamics
Discussion Topic:
What does the next decade hold for standard setting?
It appears that the scope of educational assessment is expanding, but there are fewer available professionals that can serve on technical advisory committees.
Discussion Topic:
How do we address the shortage of measurement professionals to serve on TACs?
Q2
Q2
Our focus on response time has shifted from test speededness to discussions of student engagement
Discussion Topic:
What other response process data do we expect will become a standard part of educational assessment and how might that work..??
In recent years there's been a push to go beyond differential item functioning in evaluating equity of our assessments
Discussion Topic:
What are some options for evaluating equity in assessment outside of traditional quantitative approaches?
Adaptive testing has started to become more prevalent within educational assessment.
Discussion Topic:
Will adaptive testing become more prevalent within state summative assessments? If so, why do you think this will be the case.
What movie star's careers were launched after they appeared in "The Perfect Score", which was about students stealing the answers to the SAT
What is NONE?
The score that all psychometricians would typically prefer not to report within summative assessments
What is a subscore?
Car that can change into a robot and a type of neural network
What is a transfomer?
Stops the ship and linking set within an equating
What is an anchor?
IRT Assumption + July 4th
What is Local Independence Day?
Q3
Q3
IRT model for polytomous items + cashless purchasing option
What is a "Partial Credit Card"?
The type of validity at risk if accommodations interfere with the KSA needed to respond to an item.
What is construct validity?
Common measure of reliability + term for top dog
What is Chronbach's Alpha Dog?
What 1988 movie included a testing company addressing spikes in student scores using data forensics?
What is Stand and Deliver?
Smallest number of participants you need for your work
What is MORE?
Steely Dan song and name of early essay scoring tool
What is PEG?
Japanese currency and former president of NCME
Who is Yen?
Controls the Television + an appraisal
What is remote testing?
Q4
Q4
Holder of money + system of evaluating schools based on student performance.
What is "Bank-Accountability"
Two paired Critical Elements in peer review related to equity
What are 4.2 Fairness and Accessibility and 5.1 Inclusion of Students With Disabilities?
______ called this graphic probably the greatest data visualization ever made
Who is Tufte?
Three television shows that had episodes that centered on standardized testing.
What are the Simpsons, South Park and King of the Hill?
Summative assessments are commonly labelled as not providing data that can be used to impact instructional practices and more policy makers are looking at alternatives to traditional summative assessments.
Discussion Topic:
What are some general thoughts about these new innovative approaches to traditional summative assessments?
Automated scoring of student responses using AI and large-language models has long been available, but only recently has it started to be used in statewide summative assessment
Discussion Topic:
Is it fair and accurate to use AI scoring in large-scale summative assessments?
There was a time when the field spent more time debating measurement models or DIF indices. However, it appears that we are entering a new era not limited by computing power
Discussion Topic
What does the field of educational measurement look like in the future..?
The ability to provide remote testing as an option for large scale assessments has become an important topic since the pandemic
Discussion Topic:
How does the implementation of remote testing in state summative assessments enhance validity, and how does it undermine student privacy and exacerbate inequalities?
Q5
Q5
Accountability and assessment are often lumped together in the same conversation
Discussion Topic:
Why is accountability important in assessment and how do we think this relationship will evolve over the next decade?
The increasing use of AI and machine learning in assessment has raised concerns about bias.
Discussion Topic:
What is the potential impact of AI on fairness, validity and educational integrity?
Social and emotional learning provides important context for understanding student learning and by extension assessment
Discussion Topic:
Do you anticipate that social and emotional learning will become an important component factor within assessment? If so, how?
The number of graduate programs in psychometrics is getting smaller, which has a significant impact on the field.
Discussion Topic:
What are the biggest challenges to attracting new students to the field of psychometrics, given that stardom is unlikely?