Stats
Validity
Sampling
Data Collection Method
Types of Studies
100

Daniella wanted to see how an IV affects a DV in two different production teams. She is unable to randomly assign groups, however Daniella noticed that the age is higher than one group vs the other production group. She is using age for statistical control. Using age in this scenario is called what?

Covariate

100

What is Content Validity?

Consistency between the test items or problems and kinds of situations or problems that occur on the job.

Is the assessment content and composition appropriate given what is being measured?

100

Daniella is hired to help Coldwell Banker. The company has five different groups and they have the same amount of employees in each group. She wants to make sure that the information is precise and that there is representativeness in the sample. What type of sampling can Daniella do to ensure that each group is represented?

Stratified Random Sampling

100

Daniella is hired to help Coldwell Banker. She goes during their corporate meetings and takes notes of what she sees taking place during the meeting.  People notice her and speak up more than they normally would. What are things Daniella can do to avoid reactivity?

Two Items

100

Daniella has finally collected survey data from the employees at Coldwell Banker. She was able to assess the covariation among the variables, but she doesn’t know which variable causes the other. How can Daniella adjust the design to make it more amendable for causality?

Make it a Longitudinal Design

200

Daniella had passed out a survey to Coldwell banker. She feels that the results were impacted by social desirability responding. She wants to empirically assess the potential impact of common variance. She decides to do a Meta-Analysis Study. Which of the following defines a Meta-Analysis Study?

examination of data from a number of independent studies of the same subject, in order to determine overall trends.

200

What is Construct Validity?

The degree to which a test measures what it claims (or purports) to be measuring

Deals with whether the assessment is measuring the correct construct (trait/attribute/ability/skill)

200

Daniella is hired to help Coldwell Banker. The Company has ten groups teams that do the same things, but for different clients. They are also located very far away from each other. Daniella wants to randomly select some groups for her face-to-face interviews. What type of sampling can Daniella to achieve her goals?

Cluster Sampling

200

Daniella is hired to help Coldwell Banker. She goes during their corporate meetings and takes notes of what she sees taking place during the meeting. She has now collected her data.What are cons of this collection method (observation) (4 items)?

Labor intensive

Time Consuming

 Subject to Bias

 Hard to Make Sense Out of the Notes

200

Daniella decided she wanted to do an ESM study (Experience Sampling Methodology) to make her survey design more amendable for causality.  She collects data over a limited period of time (2 weeks). She is able to collect data during multiple points. This is also helpful because Daniella is able to assess with-in person changes over a short period of time. What are some cons to using this method?

Making participants comply with collection requirements

Potential for reactivity

300

Daniella had performed an experiment. However, she made some mistakes and had wrongfully concluded that there was a relationship between two variables. What type of error did Daniella do?

Type 1--(Falsley rejected null hypothesis when a true difference does not exist).

300

What is Discriminant Validity? 

Measure of the lack of association among constructs that are supposed to be different

The degree to which a construct measure "diverges" from other measures that should be measuring different things.

Tests that constructs that should have no relationship, do in fact not have any relationship

300

Daniella is hired to help Coldwell Banker. The Company has ten groups teams that do the same things, but for different clients. They are also located very far away from each other. Daniella wants to randomly select some groups for her face-to-face interviews. What is a pro of this type of sampling (two items)?

Cut down and travel time and expenses

300

Daniella wanted to do research on SHRM, so she became a member. She wanted to see how first year I/O’s transitioned into more developed professionals and the training process. While it is useful to collect data in this manner there are some potential cons. What are the cons of this data collection method (Participant Observation-- 2 items)?

 May Change Phenomenon under Investigation

 Lose Objectivity

300

Daniella wanted to find out how effective Coldwell Banker’s production training programs were. She is able to identify the independent variable, but she is not able to randomly assign people to the training condition. What would we call this scenario?

A Quasi-Experiment

400

Statistical Power is affected by these three factors

Sample Size

Effect Size

Alpha Level

400

What is Predictive Validity?

The extent which a score on a scale or test predicts score on criterion measure. Example: college admissions test scores predict college grade point average.

400

Daniella tries to do a face-to-face survey, but only gets a lousy 10 percent of feedback. Some employees were unable to answer due to their schedules. Some people were worried their responses would not be confidential. Which of the following could Daniella do to get a higher response rate (3 items)?

Mailing questionnaires

Questionnaire via telephone

Sending a survey via internet

400

Daniella is hired to help Coldwell Banker. She has requested to see the employee records to see the employee turnover rate. What are pros to this method of collecting data (Archival Data--3 items)?

Many Archival Data Sets are readily available to the public and on the internet

It is non-reactive data so there is no chance for participants to distort the responses in any way

Records are less distorted than self-reports of the same behavior

400

Which of the following are characteristics to distinguish a true experiment from other methods (3 items)?

Manipulation of an Independent Variable and measurement of a dependent variable

Random assignment to experimental conditions

Maximum control by the experimenter

500

What is a Statistical Artifact?

Factors that may lead to differences between studies are controlled for. For example, Sample size and unreliability need to be statistically weighted.

500

What is Validity?

How confident we can be that the observed DV is a result of the IV alone.

500

What is experience sampling?

Researchers collect data at multiple points in time during a limited time frame

500

Daniella is hired to help Coldwell Banker. Daniella has requested to see the employee records to see the employee turnover rate. What are cons to this method of collecting data (Archival data- 3 items)?

Only covers the interest of the researcher that created the data

Easy to make inferences on the data that might not be true

Data may not be accurate

500

Daniella wanted to find out how napping during lunch effects productivity. She randomly selects people at Coldwell Banker to be in the sleep condition and the non-sleep condition and gave both employee groups some tasks to see who was able to complete it in a shorter amount of time (after lunch). What is the independent variables, dependent variables and control in this experiment?

IV: Sleep and Non-Sleep Conditions

DV: A. Measuring how long the employees completed the tasks

Controls/Constant: A. Time of lunch and time to complete the tasks