Sampling
General term for the selected part of a larger group of potential participants taken with the intent of generalizing from the smaller group or sample to the theoretical population.
Sample
The consistency of a series of measurements.
Reliability
Degree to which a measure or test measures that which it was intended to measure.
Measurement validity
1. Respect for persons
2. Beneficence
3. Justice
The Belmont Report
standardized, achievement, performance, aptitude tests versus personality, attitude, questionnaires, and interviews
Tests or Observation data versus Self-report measures
Extent to which the research may be generalized based upon the degree to which the research environment is similar to the natural environment.
What is ecological external validity
True score + Error = ??
Observed Test Score
You need agreement by experts, participants and raters are not influenced by irrelevant factors, meaningful factor structure, effect size of the relationship, meta-analysis, Pros>Cons
The five aspects of determining validity
The APA ethics code added what two things to the Belmont report (beneficence, justice, respect)
What is fidelity/responsibility and integrity
The contacting and finding of participants is easier and more efficient and the data is safer, but people can close out of the window and with an IP address they are never fully anonymous.
What are the pros and cons of using internet questionnaires?
A school district wants to assess the reading proficiency of 5th-grade students across all schools in the district. The researchers randomly select 10 schools from the population and all 5th grades from these schools are included in the study.
Cluster Sampling
A method to determine interitem reliability if each item on the test has multiple choices or has dichotomous choices. (internal consistency)
Cronbach's alpha
Comparing similar constructs/similar concepts are sticking together versus comparing different scales measuring the same concept
What is the difference between convergent and concurrent validity
In one you know the information and keep it private while the other no one knows the information expect the participant
What is the difference between confidentiality and anonymity
A type of manipulation that uses priming
Straightforward manipulation
A researcher wants to study job satisfaction among employees in a company. There are 200 hundred junior-level employees, 150 mid-level employees, and 50 senior-level employees. The researcher decides to include 80 participants (40 from junior, 30 from mid, 10 from senior).
Stratified Equal Proportions
A researcher develops a new scale to measure introversion and wants to ensure that the scale produces consistent results over time. The researcher administers the scale to a group of participants and repeats the test with the same group two weeks later. The researcher then compares the scores from both administrations to evaluate the consistency of the results.
Test-retest reliability
A professor designs a final exam to measure students' understanding of a psychology course. To ensure the exam is valid, the professor asks two other experts in the field to review the test and confirm that it adequately covers all the topics from the course syllabus, including theories, research methods, and key concepts.
Content validity
Active IV- manipulation check
A clinical trial is testing a new medication for anxiety. Participants in the trial are not fully informed about the potential side effects, which include severe nausea and fatigue. As a result, some participants experience significant harm that could have been avoided with better disclosure and monitoring.
Threat to what?
Beneficence
A type of manipulation that uses a confederate
Staged Manipulations
A public health researcher wants to study dietary habits in a city with majority makeup of white (60%), black/AA (30%), and Hispanic (10%). To ensure representation proportional to the population, the researcher samples 60% of white participants, 30% of black/AA participants, and 10% of Hispanic participants.
Stratified with different proportions
A researcher creates a 20-item questionnaire to measure self-esteem. To assess the reliability of the questionnaire, the researcher randomly splits the 20 items into two halves (e.g., odd-numbered and even-numbered questions) and calculates the correlation between the scores on the two halves of the test.
Split-half reliability
A researcher develops a new scale to measure social anxiety. To assess the validity of the scale, the researcher examines whether the scores are strongly correlated with an established social anxiety questionnaire and weakly correlated with a measure of general intelligence.
Construct Validity
Which threat to reliability is this?
A researcher administers a 200-item questionnaire to participants in a single session. By the time participants reach the later sections of the questionnaire, many report feeling tired and begin to rush through the questions without fully reading them, resulting in inconsistent responses.
Threat to reliability through participant fatigue
A researcher wants to measure people's attitudes toward a new product. They decide to use a scale where participants rate the product on a set of bipolar adjectives, such as "Good - Bad," "Useful - Useless," and "Innovative - Uninspired." Participants are asked to mark their position on a 7-point scale between each pair of adjectives.
Semantic Differential Scale