Single Subject and Qualitative Research
Effect Sizes and CIs
CATE and Pseudoscience tools
Systematic Reviews and Meta Analysis
Diagnostic Evidence
100

This phase in single-subject designs establishes the benchmark for comparison

What is baseliine phase?

100

This statistic shows how big the treatment effect is, not just whether it exists

What is an effect size?

100

The CATE form is used to evaluate the strength and quality of this type of evidence

What is treatment?

100

This type of review uses a structured, replicable process to summarize all evidence on a research question

What is a systematic review?

100

This property describes whether a test measures what it claims to measure

What is validity?

200

Name one defining feature of a single subject research design.

What is individual as own control, rigorous and repeated measures of variables, use of baseline to document the "problem", or visual analysis of graphed data?
200

These are ranges of plausible values for an effect size and indicate precision

What are confidence intervals?

200

Name the three items that display true experiments.

1. randomization, 2. manipulation of variables, and 3. control group/variables

200

This quantitative technique combines effect sizes across studies to provide an overall estimate

What is a meta-analysis?

200

This form of reliability measures how consistent scores are when the same test is given twice

What is test-retest reliability?

300

This qualitative tradition studies cultures or groups in their natural environments with extended observations

What is ethnography?

300
This type of effect size measures the difference between two group means (the one we talked about the most).

What is Cohen's d?

interpretation: 0.2=small, 0.5=medium, and 0.8=large

300

This is the amount of points in a CATE.

What is 15?

300

This graphic displays individual study results and a pooled estimate, using squares and diamonds

What is a forest plot?

300

This diagnostic metric measures how well a test correctly identifies individuals with a disorder

What is sensitivity?

400

This term describes the average rate of behavior during a phase in single-subject designs

What is level?

400

This is what an effect size tells a researcher/reader.

What is how large the difference is (not just if there is a difference)?

400

This is the amount of tools listed to detect pseudoscience.

What is 5?

400

This term refers to variability among studies in a meta-analysis

What is heterogeneity?

400

Name the four types of validity.

What are criterion, content, construct, and face validity?

criterion- quantitative, content- test items, construct- big picture, and face- looks like

500

This qualitative approach captures the “essence” of lived experiences using concepts like intentionality and bracketing

What is phenomenology?

500

A narrow CI represents this. 

What is more precision, showing how true the magnitude is?

500

This tool describes confirmation bias. We need to remember to look at all evidence and not just some that fits the agenda.

What is "Don't ignore the Misses and Count only the Hits"?

500

List the seven steps of developing a systematic review.

1. define research question, 2. develop search protocol, 3. conduct a comprehensive search, 4. screen studies for eligibility, 5. extract data, 6. assess study quality, and 7. synthesize findings

500

Describe the formula used to find specificity.

Specificity= true negatives/true negatives+false positives