Statistical Aspects of the Validation Process
Scaling
Test Development
Generalizability Theory
Regression and Review Concepts
SPSS
100

What type of analysis was originally designed to classify objects into one or two clearly defined groups?

Discriminant Analysis

100

What is the difference between a latent variable and an observed variable? 

A latent variable is the proposed psychological construct (e.g., "gratitude") that cannot be directly observed; an observed variable is an operationalized way of measuring a response (e.g., self-report scores on the GRAT-6, a gratitude questionnaire) that theoretically should be representative of the connected latent variable.

100

According to the 11 guidelines of test development discussed in lecture, which of the following steps comes first in the test development process?

Write the test items 

Identify the population

Conduct factor analysis 

Develop norms

Identify the population

(Guideline 4) 

100

Which prior theoretical approach does generalizability extend?

Classical Test Theory

100

What is the purpose of using a regression framework, as opposed to correlation?

To make specific predictions

100

Which function in SPSS is used to create an average score across several items?

Compute Variable

200

What are the two general purposes (types) of discriminant analysis?

To describe differences (descriptive DA)

To predict classifications (predictive DA)

200

Which type of scaling treats people as the objects of scaling and is concerned with a person's level of achievement or ability?

Psychological Scaling

200

What was the first guideline for test development? 

(of the 11 guidelines)

Articulate a Philosophical Foundation for the Test

200

What is the main goal of generalizability theory?

To increase the dependability of measurements

200

In the regression equation (Ŷ = b1X + b0), what does b0 represent? 

The intercept of the regression line 

200

If you want to copy your code into a Syntax file instead of just creating output, what button do you push in SPSS?

Paste

300

How much variance is explained in one variable by the other variable if the Pearson's correlation coefficient (r) is -.70?

49%

|(-.70*-.70)| = .49

300

What is the given term to represent words, sentences, names, pictures, and similar elements that are used to locate individuals on a unidimensional linear scale or multidimensional map? 

Psychological Objects

300

List 3 (of the 5) test purposes listed under Guideline 2.

Diagnostic (remediation & improvement)

Classification (identification leading to treatment)

Selection (college admission / career direction)

Progress (matriculation & growth over time)

Placement (course placement & counseling) 

300

What were the two types of studies discussed in lecture based on generalizability theory?

G-Study (Generalizability Study)

D-Study (Decision Study) 

300

What does the intercept represent? 

The predicted value of "Y" when "X" is equal to 0. 

300

What does "sig." represent in SPSS output?

A p-value 

("Significance")

400

What is the possible range of outcomes in logistic regression?

0 to 1 

400
What is the system of scaling in which the system is directly measurable, such as a sensory perception, in an absolute or relative sense?

Psychophysical Scaling

400

What word is covered up here?

Confirmatory

400

Similar to how we interpret alpha for reliability, what statistic is used to measure dependability?

G (generalizability) Coefficient

400

True/False

Regression lines travel through 0 on the X variable and 0 on the Y variable.

False

(But, they do travel through the means of both variables)

400
When looking at Cohen's d and r2 in SPSS output, you are looking at what type of statistics?

Effect sizes

500

If a forecaster uses scores on a scale to predict that 14 of 15 participants will matriculate from 11th grade to 12th grade, but the true number was 12 of the 15 participants, then how many false positives were there in this scenario?

(14 predicted minus 12 actual) 

500

What are the three approaches to scaling discussed in class?

Stimulus Centered

Response Centered

Subject Center

500

According to Guideline 11, what are the four components that should be included in the technical manual for a new test? 

1. Test Development Procedure

2. Administration Procedures

3. Scaling and Scoring Procedures

4. Norm Info and Score Reporting 

500

What is the equation for classical test theory?

Xi = Ti + ei

500
If an outcome is dichotomous, what type of regression should you use?

Logistic regression (predicting "0s" and "1s")

500

Which of the following statistics is "sensitive to sample size"?

d, r, n 

M
e
n
u