Statistical Aspects of the Validation Process
Scaling
Test Development
Generalizability Theory
Regression and Review Concepts
SPSS
100
What type of analysis was originally designed to classify objects into one or two clearly defined groups?
Discriminant Analysis
100
What is the difference between a latent variable and an observed variable?
A latent variable is the proposed psychological construct (e.g., "gratitude") that cannot be directly observed; an observed variable is an operationalized way of measuring a response (e.g., self-report scores on the GRAT-6, a gratitude questionnaire) that theoretically should be representative of the connected latent variable.
100
According to the 11 guidelines of test development discussed in lecture, which of the following steps comes first in the test development process?
Write the test items
Identify the population
Conduct factor analysis
Develop norms
Identify the population
(Guideline 4)
100
Which prior theoretical approach does generalizability extend?
Classical Test Theory
100
What is the purpose of using a regression framework, as opposed to correlation?
To make specific predictions
100
Which function in SPSS is used to create an average score across several items?
Compute Variable
200
What are the two general purposes (types) of discriminant analysis?
To describe differences (descriptive DA)
To predict classifications (predictive DA)
200
Which type of scaling treats people as the objects of scaling and is concerned with a person's level of achievement or ability?
Psychological Scaling
200
What was the first guideline for test development?
(of the 11 guidelines)
Articulate a Philosophical Foundation for the Test
200
What is the main goal of generalizability theory?
To increase the dependability of measurements
200
In the regression equation (Ŷ = b1X + b0), what does b0 represent?
The intercept of the regression line
200
If you want to copy your code into a Syntax file instead of just creating output, what button do you push in SPSS?
Paste
300
How much variance is explained in one variable by the other variable if the Pearson's correlation coefficient (r) is -.70?
49%
|(-.70*-.70)| = .49
300
What is the given term to represent words, sentences, names, pictures, and similar elements that are used to locate individuals on a unidimensional linear scale or multidimensional map?
Psychological Objects
300
List 3 (of the 5) test purposes listed under Guideline 2.
Diagnostic (remediation & improvement)
Classification (identification leading to treatment)
Selection (college admission / career direction)
Progress (matriculation & growth over time)
Placement (course placement & counseling)
300
What were the two types of studies discussed in lecture based on generalizability theory?
G-Study (Generalizability Study)
D-Study (Decision Study)
300
What does the intercept represent?
The predicted value of "Y" when "X" is equal to 0.
300
What does "sig." represent in SPSS output?
A p-value
("Significance")
400
What is the possible range of outcomes in logistic regression?
0 to 1
400
What is the system of scaling in which the system is directly measurable, such as a sensory perception, in an absolute or relative sense?
Psychophysical Scaling
400
What word is covered up here?
Confirmatory
400
Similar to how we interpret alpha for reliability, what statistic is used to measure dependability?
G (generalizability) Coefficient
400
True/False
Regression lines travel through 0 on the X variable and 0 on the Y variable.
False
(But, they do travel through the means of both variables)
400
When looking at Cohen's d and r2 in SPSS output, you are looking at what type of statistics?
Effect sizes
500
If a forecaster uses scores on a scale to predict that 14 of 15 participants will matriculate from 11th grade to 12th grade, but the true number was 12 of the 15 participants, then how many false positives were there in this scenario?
2
(14 predicted minus 12 actual)
500
What are the three approaches to scaling discussed in class?
Stimulus Centered
Response Centered
Subject Center
500
According to Guideline 11, what are the four components that should be included in the technical manual for a new test?
1. Test Development Procedure
2. Administration Procedures
3. Scaling and Scoring Procedures
4. Norm Info and Score Reporting
500
What is the equation for classical test theory?
Xi = Ti + ei
500
If an outcome is dichotomous, what type of regression should you use?
Logistic regression (predicting "0s" and "1s")
500
Which of the following statistics is "sensitive to sample size"?
d, r, n
r