Policy & Best Practice
All Things AI
Acronyms, Homonyms & Measurement
Before & After
Audience Questions
More Before & After
Equity & Equality
Potpourri
Assessment in Pop Culture
100

Assessments that evaluate a students ability to apply the knowledge and skills they've learned in a practical content

What are performance assessments?

100

Acronym for a large insurance company and method to generate large quantities of test content

What is AIG?

100

Denotes where you stopped reading and popular standard setting method.

What is the bookmark?

100

Body part + Committee of State Advisors = Poster Hanger

What is a thumb TAC?

100

Q1

Q1

100

Response time indicator + marriage invitation deposit

What is an "Engagement Ring"?

100

The two groupings in a DIF analysis

What is focal and reference?

100

Former residents of Thailand + online test delivery method = Common Pet

What is a Siamese CAT?

100

The book "The Big Test" is about which assessment? 

What is the SAT?

200

Performance assessment appears to be regaining popularity as an administration format

Discussion Topic:

What role do you think performance assessments will play in large scale assessment in the near future?

200

The use of AIG to generate content that accurately reflects content standards is very appealing

Discussion Topic:

Should AIG be utilized to generate items for summative assessments? 

200

Standard setting involves the intersection of psychometrics, content, policy and group dynamics

Discussion Topic:

What does the next decade hold for standard setting?

200

It appears that the scope of educational assessment is expanding, but there are fewer available professionals that can serve on technical advisory committees.  

Discussion Topic:

How do we address the shortage of measurement professionals to serve on TACs?

200

Q2

Q2

200

Our focus on response time has shifted from test speededness to discussions of student engagement

Discussion Topic:

What other response process data do we expect will become a standard part of educational assessment and how might that work..??

200

In recent years there's been a push to go beyond differential item functioning in evaluating equity of our assessments  

Discussion Topic:

What are some options for evaluating equity in assessment outside of traditional quantitative approaches?

200

Adaptive testing has started to become more prevalent within educational assessment.

Discussion Topic:

Will adaptive testing become more prevalent within state summative assessments? If so, why do you think this will be the case. 

200

What movie star's careers were launched after they appeared in "The Perfect Score", which was about students stealing the answers to the SAT

What is NONE?

300

The score that all psychometricians would typically prefer not to report within summative assessments

What is a subscore?

300

Car that can change into a robot and a type of neural network

What is a transfomer?

300

Stops the ship and linking set within an equating

What is an anchor?

300

IRT Assumption + July 4th

What is Local Independence Day?

300

Q3

Q3

300

IRT model for polytomous items + cashless purchasing option

What is a "Partial Credit Card"?

300

The type of validity at risk if accommodations interfere with the KSA needed to respond to an item.  

What is construct validity?

300

Common measure of reliability + term for top dog

What is Chronbach's Alpha Dog?

300

What 1988 movie included a testing company addressing spikes in student scores using data forensics?

What is Stand and Deliver?

400

Smallest number of participants you need for your work

What is MORE?

400

Steely Dan song and name of early essay scoring tool

 What is PEG?

400

Japanese currency and former president of NCME

Who is Yen?

400

Controls the Television + an appraisal

What is remote testing?

400

Q4

Q4

400

Holder of money + system of evaluating schools based on student performance.

What is "Bank-Accountability"

400

Two paired Critical Elements in peer review related to equity

What are 4.2 Fairness and Accessibility and 5.1 Inclusion of Students With Disabilities?

400

______ called this graphic probably the greatest data visualization ever made

Who is Tufte?

400

Three television shows that had episodes that centered on standardized testing.

What are the Simpsons, South Park and King of the Hill?

500

Summative assessments are commonly labelled as not providing data that can be used to impact instructional practices and more policy makers are looking at alternatives to traditional summative assessments.

Discussion Topic:

What are some general thoughts about these new innovative approaches to traditional summative assessments?

500

Automated scoring of student responses using AI and large-language models has long been available, but only recently has it started to be used in statewide summative assessment

Discussion Topic:


Is it fair and accurate to use AI scoring in large-scale summative assessments?

500

There was a time when the field spent more time debating measurement models or DIF indices. However, it appears that we are entering a new era not limited by computing power

Discussion Topic

What does the field of educational measurement look like in the future..?

500

The ability to provide remote testing as an option for large scale assessments has become an important topic since the pandemic

Discussion Topic:

How does the implementation of remote testing in state summative assessments enhance validity, and how does it undermine student privacy and exacerbate inequalities?

500

Q5

Q5

500

Accountability and assessment are often lumped together in the same conversation

Discussion Topic:

Why is accountability important in assessment and how do we think this relationship will evolve over the next decade?

500

The increasing use of AI and machine learning in assessment has raised concerns about bias.  

Discussion Topic:

What is the potential impact of AI on fairness, validity and educational integrity?

500

Social and emotional learning provides important context for understanding student learning and by extension assessment

Discussion Topic:

Do you anticipate that social and emotional learning will become an important component factor within assessment?  If so, how?

500

The number of graduate programs in psychometrics is getting smaller, which has a significant impact on the field.

Discussion Topic:

What are the biggest challenges to attracting new students to the field of psychometrics, given that stardom is unlikely?