Threats to Validity
Assessment Methods
Agreement
Single Case Designs
Miscellaneous
100


Threat to internal validity that involves a gradual change over time due to growing older, stronger, or smarter


Maturation

100

A teacher counting how many times a student raises his hands would be an example of what type of assessment method

Frequency count

100


Two observers are assessing their level of agreement using Pearson Product Moment Correlation. They calculate an agreement ratio of r = .93.  Does this indicate strong or unrelated agreement?


Strong agreement (close to +1.00)
100


This type of design includes multiple intervention and baseline phases


ABAB

100


Another term for a false positive


Type 1 Error

200


All students participating in a study suddenly receive a new teacher.  This threat to validity is known as ...


History

200


During a 30-second interval, you are asked to identify whether the behavior occurred during the entire interval.  This assessment method is known as...

Whole interval recording

200


Calculating the agreement between two observers independently recording behaviors often during frequency observations


Frequency ratio

200


Identifying whether or not there is a data "jump" between phases


Level (change)

200


The simplest explanation that describes a phenomenon of interest


Parsimony

300


This threat to external validity is defined as the extent to which results could be generalized to subjects 



Generalizability in subjects


300

During a 30-second interval, you are asked to identify whether the behavior occurred at the end of the interval.  This is known as what type of assessment method?

Momentary time sampling
300


Assesses whether there is agreement within each instance of the observed behavior usually during specific intervals. 


Point-by-point agreement

300


A researcher wants to examine the effects of praise on student behavior during math, reading, and science.  What design would they implement?


Multiple baseline design

300


An error that occurs when a test for a disease reports a negative result when the patient is infected.


Type II error
400


Excessive variability in data is a type of threat known as...



Threat to Data-Evaluation Validity


400

During a 30-second interval, you are asked to identify if the behavior occurred at all. This is known as what type of assessment method?

Partial interval recording

400


When an observer slowly moves away from the operationalized definition of the behavior this may affect levels of agreement.  This is known as...


Observer drift

400

Comparing the points in the intervention phase that do not overlap with the points in baseline is known as...

Percent of non-overlapping data
400


A hypothesis that differs from the one that the researcher was interested in examining


Plausible hypothesis

500


Any change that takes place in the measure or assessment procedure that would result in a threat to internal validity is known as...


Instrumentation

500


Identifying whether or not a task was completed (completed vs. not completed) is an example of what type of assessment method?


Discrete Categorization

500

The agreement helps establish (reliability or accuracy) in the data collected.

Reliability

500


Draw a graph with change in mean, trend (slope), and rapid latency with no change in level


(View response)

500


In a logic model, the resources required for a program (or study) are also known as?


Inputs

M
e
n
u