Other
What correlation coefficient would you use if your data is ordinal (ranked)?
Spearman’s rs (also called Spearman’s 𝝆)
What are the qualities of a good testable hypothesis? (name 6)
Testable, falsifiable, precise, rational, parsimonious, makes a prediction
Scales of dependent level measurements (name 4)
Nominal, ordinal, interval, ratio
Requirements for causality (name 4)
Covariation, temporal sequence, eliminating confounds, validity of psychological statement
What is p-hacking and HARKing?
P-hacking is when researchers misreport true effect sizes as significant when they are not. HARKing is hypothesizing after results are already known
If you see a pooled variance estimate in the denominator of an independent samples t calculation, what does this tell you?
The samples sizes are different.
What is the importance of replication?
Replication is an experimental tool to demonstrate that the same findings can be obtained in any other place by any other researcher
External validity refers to how well the research findings generalize to represent a population. Internal validity provides information about causality. To increase internal validity we can use chronbachs alpha as a measure of internal reliability and internal variance. To increase external validity we can have a large N that is well representative of the population.
Factors that threaten internal validity (9 possible answers)
Attrition (participant drop out), confounding variables, diffusion, experimenter bias, historical events, instrumentation, statistical regression, testing
What does null hypothesis significance testing tell us?
The probability that our experimental results are due to chance compared to our actual results. It does not tell us how they are different or indicate direction.
We construct a 95% confidence interval around our sample mean. What does this tell us?
Over repeated samples, we expect 95% of the confidence intervals to capture mu/sample mean.
What is the difference between a theory and a hypothesis?
A theory can explain or describe a broad range of behaviors. A hypothesis is a formally stated expectation about how a behavior operates.
What are ways to group/organize data- is grouping data/variables good?
Categorizing dichotomous variables, categorizing ranges into groups, pooling data responses. These techniques distort actual relationships, lead to imprecise measurements, and limit accuracy of conclusions.
What is random sampling and what are its advantages?
Random sampling is a technique where each sample has an equal probability of being chosen. This eliminates researcher bias and aids in drawing conclusions
How can a p-curve be affected by p-hacking?
If a researcher's p-hack yields nonsignificant results the p-curve shape will be altered close to the perceived significance threshold, the curve will have an overabundance of values that are just below .05
What is an availability heuristic?
When we make an assumption based off of what we know/what is available to you.
What is the difference between exact replications and conceptual replications?
What does an internal reliability measure account for?
An internal reliability measure should describe how the covariance in our experiment, it should describe how one variable corresponds with the change in another in measurable terms
What is the current crisis in psychological science and what are ways to self correct the crisis?
What are types of errors one can make by drawing conclusions from NHST?
Type I errors (false positives), type II errors (false negatives), and statistical errors/errors in the validity of our measures
True or false?
Never infer a casual connection from a correlation between two variables.
True. We cannot tell the direction of causation from a mere correlation.
What can replication help us control for? (name 5)
Sampling error/reducing the likelihood of making a type I error, control for variables, control for fraud, generalize to larger populations, verify underlying hypothesis
What are two ways to quantify reliability of measures?
Test-retest and split-half reliability
What are the aspects of a rigorous experimental design (according to Fiske, 2016)? (describe 3)
Use null hypothesis testing only in exploratory stages of research, do not over claim in research, use replication
What are researcher degrees of freedom? Give one example of a researcher degree of freedom for hypothesizing, design, collection, analyses, and reporting
Researcher degrees of freedom are arbitrary choices made by the researcher which can be used for personal gain and can increase type I error rate. This can happen when conducting explorative research without a hypothesis (HARKing), measuring additional variables to use as covariates or independent variables later on, discarding data during data collection in a non-blinded manner, using alternative inclusion/exclusion criteria, failing to assure reproducibility