Reliability
Evidence of reliability/precision indicates that _______________.
A. test scores will likely be consistent across repeated measurements
B. the test taker is properly administering and using the test
C. the test is measuring what it is designed to measure
D. a test possesses an important but not essential property
A. test scores will likely be consistent across repeated measurements
Which of the following would provide evidence of a test’s validity based on content?
A. the extent to which test questions are representative of the knowledge domain measured
B. the extent to which a person’s test scores can predict his or her current and future behavior
C. the extent to which the test taker recognizes the purpose of each test question
D. a numerical analysis of the test’s construct dimensions
A. the extent to which test questions are representative of the knowledge domain measured
When test developers correlate test scores with the criterion scores, the resulting number is called the _______________.
A. content coefficient
B. criterion coefficient
C. reliability coefficient
D. validity coefficient
D. validity coefficient
Which one of the following would be most likely to establish that a test is grounded in psychological theory?
A. the correlation between test score and external criteria
B. the correlation between the test scores of the same people at two different points in time
C. a high coefficient alpha from a test of internal consistency
D. evidence of validity based on the test’s relationship with other constructs
D. evidence of validity based on the test’s relationship with other constructs
When using the split halves method of estimating reliability/precision, which one of the following requires adjustment to compensate for splitting the test into halves?
A. assignment of the test questions
B. correlation method
C. the reliability coefficient
D. the test scores
C. the reliability coefficient
_______________ is/are difficult to describe because people disagree on what behaviors represent, whereas _______________ is/are clearly described in observable and measurable behaviors.
A. Concrete attributes; abstract attributes
B. Abstract attributes; concrete attributes
C. Concurrent validity; construct validity
D. Construct validity; concurrent validity
B. Abstract attributes; concrete attributes
Which of the following is observable and measurable, such as the number of accidents on the job, days absent, or disciplinary problems in a month?
A. internal criterion
B. objective criterion
C. subjective criterion
D. validity criterion
B. objective criterion
Which one of the following is an abstract construct?
A. job satisfaction
B. job turnover
C. days absent in a 30-day period
D. number of customer complaints in one week
A. job satisfaction
Estimating reliability/precision using methods of internal consistency is appropriate only for tests that are _______________.
A. heterogeneous
B. homogeneous
C. unstandardized
D. standardized
B. homogeneous
Evidence of validity based on content is most appropriate for what types of tests?
A. achievement tests that measure concrete attributes
B. personality tests that measure absolute attributes
C. concrete tests that measure aptitude and achievement
D. comparative tests that measure personality characteristics
A. achievement tests that measure concrete attributes
Squaring the validity coefficient between a test and a criterion will tell us about the amount of _______________.
A. shared variance
B. reliability
C. validity
D. homogeneity
A. shared variance
When the scores on a test correlate strongly with scores on other tests that measure the same construct, we say the test has _______________.
A. evidence of validity based on content
B. evidence of validity based on relations with external criteria
C. convergent evidence of validity
D. discriminant evidence of validity
C. convergent evidence of validity
What is the amount of consistency among scorers’ judgments called?
A. test–retest agreement
B. interscorer agreement
C. intrascorer agreement
D. internal agreement
B. interscorer agreement
Which one of the following statements best describes a practical test?
A. the driving portion of a driving test
B. the math portion of the SAT
C. tests such as temperature or weight measurement
D. a job interview
A. the driving portion of a driving test
Y’ = a + bX is the _______________.
A. correlation equation
B. predictive validity equation
C. linear regression equation
D. multiple regression equation
C. linear regression equation
When a researcher chooses three constructs that are unrelated in theory and three types of tests such as objective, projective, and a peer rating to measure each of the constructs, she is conducting a _______________.
A. multitrait–multimethod design
B. content validation study
C. generalizability study
D. factor analysis
A. multitrait–multimethod design
As the reliability/precision of a test decreases, which one of the following items increases?
A. standard deviation
B. standard error of measurement
C. internal consistency
D. difficulty
B. standard error of measurement
When you ask experts to rate the extent to which individual questions are essential to measure the testing universe, you are gathering evidence of validity based on _______________.
A. relations with other variables
B. internal structure
C. test content
D. response processes
C. test content
In a regression equation, the intercept is the place where the _______________.
A. x and y axes cross
B. regression line crosses the y-axis
C. regression line crosses the x-axis
D. slope is zero
B. regression line crosses the y-axis
When an underlying theory explains the relation between a predictor and a criterion based on a psychological theory, there is _______________.
A. concurrent evidence of validity
B. predictive evidence of validity
C. evidence of construct validity
D. convergent evidence of validity
C. evidence of construct validity