Policy & Best Practice
All Things AI
Acronyms, Homonyms & Measurement
Before & After
Audience Questions
More Before & After
Equity & Equality
Potpourri
Assessment in Pop Culture
100
Assessments that evaluate a students ability to apply the knowledge and skills they've learned in a practical content
What are performance assessments?
100
Acronym for a large insurance company and method to generate large quantities of test content
What is AIG?
100
Denotes where you stopped reading and popular standard setting method.
What is the bookmark?
100
Body part + Committee of State Advisors = Poster Hanger
What is a thumb TAC?
100
Q1
Q1
100
Response time indicator + marriage invitation deposit
What is an "Engagement Ring"?
100
The two groupings in a DIF analysis
What is focal and reference?
100
Former residents of Thailand + online test delivery method = Common Pet
What is a Siamese CAT?
100
The book "The Big Test" is about which assessment?
What is the SAT?
200
Performance assessment appears to be regaining popularity as an administration format
Discussion Topic:
What role do you think performance assessments will play in large scale assessment in the near future?
200
The use of AIG to generate content that accurately reflects content standards is very appealing
Discussion Topic:
Should AIG be utilized to generate items for summative assessments?
200
Standard setting involves the intersection of psychometrics, content, policy and group dynamics
Discussion Topic:
What does the next decade hold for standard setting?
200
It appears that the scope of educational assessment is expanding, but there are fewer available professionals that can serve on technical advisory committees.
Discussion Topic:
How do we address the shortage of measurement professionals to serve on TACs?
200
Q2
Q2
200
Our focus on response time has shifted from test speededness to discussions of student engagement
Discussion Topic:
What other response process data do we expect will become a standard part of educational assessment and how might that work..??
200
In recent years there's been a push to go beyond differential item functioning in evaluating equity of our assessments
Discussion Topic:
What are some options for evaluating equity in assessment outside of traditional quantitative approaches?
200
Adaptive testing has started to become more prevalent within educational assessment.
Discussion Topic:
Will adaptive testing become more prevalent within state summative assessments? If so, why do you think this will be the case.
200
What movie star's careers were launched after they appeared in "The Perfect Score", which was about students stealing the answers to the SAT
What is NONE?
300
The score that all psychometricians would typically prefer not to report within summative assessments
What is a subscore?
300
Car that can change into a robot and a type of neural network
What is a transfomer?
300
Stops the ship and linking set within an equating
What is an anchor?
300
IRT Assumption + July 4th
What is Local Independence Day?
300
Q3
Q3
300
IRT model for polytomous items + cashless purchasing option
What is a "Partial Credit Card"?
300
The type of validity at risk if accommodations interfere with the KSA needed to respond to an item.
What is construct validity?
300
Common measure of reliability + term for top dog
What is Chronbach's Alpha Dog?
300
What 1988 movie included a testing company addressing spikes in student scores using data forensics?
What is Stand and Deliver?
400
Smallest number of participants you need for your work
What is MORE?
400
Steely Dan song and name of early essay scoring tool
What is PEG?
400
Japanese currency and former president of NCME
Who is Yen?
400
Controls the Television + an appraisal
What is remote testing?
400
Q4
Q4
400
Holder of money + system of evaluating schools based on student performance.
What is "Bank-Accountability"
400
Two paired Critical Elements in peer review related to equity
What are 4.2 Fairness and Accessibility and 5.1 Inclusion of Students With Disabilities?
400
______ called this graphic probably the greatest data visualization ever made
Who is Tufte?
400
Three television shows that had episodes that centered on standardized testing.
What are the Simpsons, South Park and King of the Hill?
500
Summative assessments are commonly labelled as not providing data that can be used to impact instructional practices and more policy makers are looking at alternatives to traditional summative assessments.
Discussion Topic:
What are some general thoughts about these new innovative approaches to traditional summative assessments?
500
Automated scoring of student responses using AI and large-language models has long been available, but only recently has it started to be used in statewide summative assessment
Discussion Topic:
Is it fair and accurate to use AI scoring in large-scale summative assessments?
500
There was a time when the field spent more time debating measurement models or DIF indices. However, it appears that we are entering a new era not limited by computing power
Discussion Topic
What does the field of educational measurement look like in the future..?
500
The ability to provide remote testing as an option for large scale assessments has become an important topic since the pandemic
Discussion Topic:
How does the implementation of remote testing in state summative assessments enhance validity, and how does it undermine student privacy and exacerbate inequalities?
500
Q5
Q5
500
Accountability and assessment are often lumped together in the same conversation
Discussion Topic:
Why is accountability important in assessment and how do we think this relationship will evolve over the next decade?
500
The increasing use of AI and machine learning in assessment has raised concerns about bias.
Discussion Topic:
What is the potential impact of AI on fairness, validity and educational integrity?
500
Social and emotional learning provides important context for understanding student learning and by extension assessment
Discussion Topic:
Do you anticipate that social and emotional learning will become an important component factor within assessment? If so, how?
500
The number of graduate programs in psychometrics is getting smaller, which has a significant impact on the field.
Discussion Topic:
What are the biggest challenges to attracting new students to the field of psychometrics, given that stardom is unlikely?