Chapter 7
What is a true experiment?
subjects are randomly assigned to an experimental group that receives a treatment and the comparison group that does not receive the treatment.
Generalizing vs Overgeneralizing
Generalizing: from what we have observed to other times, places, people.
Overgeneralization: When we conclude what we have observed or know to be true, is true for all cases
Three stages of formulating a research question.
1. Identifying one or more questions for study
2. Refining the question
3. Evaluating the question
What are the ASA Ethical Principles?
-Achieving valid results
-Honesty and openness
-Protecting research participant
-Avoiding harm to research participant
-Informed consent
-Avoiding deception
-Maintaining privacy and confidentiality
-Benefits outweigh the risks
Unit of analysis vs Unit of observation
Analysis: The level of social life on which a research question is focused, such as individuals, groups, towns, or nations
Observation: Measures are obtained from a sample
3 major features of a true experiment.
1. Two groups (experimental and control group)
2. Variation in the independent variable
3. Random assignment to the two or more comparison groups
What is an Ego-Based Commitment?
Making statements about the social world that conform to our own needs rather than to the observable facts.
What is the systems theory?
Study of systems as they relate to one another within a larger more complex system.
Conceptualization vs Operationalization
Conceptualization: specifying what one means by a term (fuzzy ideas)
Operationalization: connecting concepts to observations
Ecological Fallacy vs Reductionist Fallacy vs Individualistic Fallacy
Ecological: an error in reasoning in which incorrect conclusions about individual-level processes are drawn from group-level data
Reductionist: An error in reasoning in which incorrect conclusions about group-level processes are based on individual-level data
Individualistic Fallacy: Belief that association on an individual level are intrinsically more truthful
What are the 3 criteria of causality?
1. Non-spuriousness
2. Association
3. Time order
What is the scientific method?
making conjectures (hypothesis): deriving predictions from them as logical consequences, and then carrying out experiments or observations based on those predictions.
Inductive vs Deductive Reasoning
Deductive: Starting with a theory and then testing some of its implications with data
Inductive: First collecting data and then developing a theory that explains patterns in the data.
Different levels of measurement and their properties
Nominal: Variables whose values have no mathematical interpretation.
Ordinal: greater than or less than distinctions
Ratio/Interval: absolute zero
Needs Assessment vs Evaluability Assessment vs Process Evaluation
Needs: Attempts to determine the needs of the population
Evaluability Assessment: Conducted to learn in advance
Process Evaluation: investigates the process of service delivery
What are quasi-experiments?
research design where there is a comparison group comparable to the experimental group in critical ways, but subjects are not randomly assigned to these groups.
What are the steps to the scientific method?
1. Research Question
2. Lit Review
3. Hypothesis
4. Identify IV and DV
5. Collection of Data
6. Data analysis
What is the 2 step process in reviewing literature?
1st stage: assess each article separately
2nd stage: assess the implications of the entire set of articles for the relevant aspects of your research
Reliability vs Validity
Reliability: Measurement yields consistent scores when the phenomenon is not changing
Validity: Accuracy of a measure
Impact Analysis vs Efficiency Analysis
Impact: Analysis of which a treatment or other service has an effect
Efficiency: Type of evaluation research that compares program costs with program effects it can either be cost-benefit or cost-effective
What are limitations to a true experiment design (3)
Time Order: Comparing pre-test to post-test scores
Non-spuriousness: if a design has used randomization effectively we can be more confident in conclusions
Context: control over conditions
What are the strengths and weaknesses of social research?
Strengths: cost-effective, generalizability, reliability, versatility.
Weaknesses: Inflexibility and lack of potential depth
What 3 goals should a literature review accomplish?
1. Summarizing prior research
2. Critique prior research
3. Situate your research question within the literature
What is Triangulation?
The use of multiple methods to study one research question. Also used to average the use of two or more different measures.