Surveys
If you were observing workers performing a task and recording the results, you be completing a _______________.
A. structured observation
B. structured record review
C. personal interview
D. individually administered survey
A. structured observation
Test developers refer to test stimuli or test questions as _______________.
A. univariate items
B. the basis for scoring
C. test items
D. projective questions
C. test items
The main purpose of the validation study is to _______________.
A. get the reactions of test takers and test users
B. gather data on the construct(s) that the test measures
C. confirm the test’s ability to yield meaningful and accurate results
D. comply with legal requirements that tests must have evidence of validity
C. confirm the test’s ability to yield meaningful and accurate results
What are nonsampling measurement errors?
A. errors resulting from respondents not being chosen randomly from the population
B. errors resulting from respondents failing to answer questions or return the survey
C. errors that occur during analysis and interpretation of survey data
D. errors that occur because of poor survey design or administration
D. errors that occur because of poor survey design or administration
Which test format would the stem, “Which one word from each of the following pairs of words is most descriptive of you?” be part of?
A. short essay format
B. multiple-choice format
C. true/false format
D. forced choice format
D. forced choice format
The validity coefficients that result when a test is cross-validated are usually expected to be _______________.
A. the same as the validity coefficients found in the original validation study
B. lower than the validity coefficients found in the original validation study
C. higher than the validity coefficients found in the original validation study
D. unrelated to the validity coefficients found in the original validation study
B. lower than the validity coefficients found in the original validation study
Which one of the following is TRUE about simple random sampling?
A. Every respondent has a 95% probability of being chosen in the sample.
B. Every respondent has an equal probability of completing the survey.
C. Every member of a sample has an equal chance of completing the survey.
D. Every member of a population has an equal chance of being chosen for the sample.
D. Every member of a population has an equal chance of being chosen for the sample.
Which one of the following formats would be best to use when the test takers are likely to answer dishonestly?
A. multiple choice
B. forced choice
C. true/false
D. structured interview
B. forced choice
What is single-group validity?
A. when validity coefficients for different subgroups differ
B. when a test is valid for one group but not for another group
C. when the target audience comprises only one type of test takers
D. when the test is valid for use only one time
B. when a test is valid for one group but not for another group
What does homogeneity of the population refer to?
A. how similar the people in a population are to one another
B. how similar the respondents to the survey are to one another
C. the extent to which the target audience is similar to the population
D. the extent to which the sample represents the population
A. how similar the people in a population are to one another
What are response sets?
A. ways of responding that test takers find most comfortable
B. the four or five responses provided in a multiple-choice question
C. equipment, such as computers, used to respond to tests
D. patterns of responding that result in false or misleading information
D. patterns of responding that result in false or misleading information
What is the purpose of test norms?
A. to provide a structure that makes it easy to identify test bias
B. to provide a reference point or structure for understanding one test taker's score
C. to show that many people have taken the test and their scores were normally distributed
D. to provide evidence of reliability and validity for the test
B. to provide a reference point or structure for understanding one test taker's score
The more _______________ the members of the population, the _______________ the sample that is necessary.
A. similar; larger
B. similar; smaller
C. knowledgeable; smaller
D. educated; smaller
B. similar; smaller
Test and survey developers should balance items for which the correct response would be positive with an equal number of items for which the correct response would be negative to control for which bias?
A. social desirability
B. faking
C. random responding
D. acquiescence
D. acquiescence
When a common regression line for two groups is used to predict performance, but the individual regressions lines for the groups differ where they cross the Y axis, which one of the following problems may occur?
A. The performance of the group whose regression line crosses the y-axis at a higher point will be overpredicted.
B. The performance of the group whose regression line crosses the y-axis at a lower point will be overpredicted.
C. The performance of both groups will be overpredicted.
D. The performance of neither group will be overpredicted.
B. The performance of the group whose regression line crosses the y-axis at a lower point will be overpredicted.