Definitions
Primary Reinforcer
A consequence that functions as a reinforcer because it is important in sustaining the life of the individual or the continuation of the species
Flow
When shaping is implemented, it can create this state of flow in which we lose track of time and self.
Stimulus preference assessment
A rank-ordered list of preferred stimuli is obtained by observing choices between those stimuli.These are especially useful when working with nonverbal clients.
Differential Reinforcement
a procedure in which a previously reinforced behavior is placed on extinction while a second behavior is reinforced.
If the conditioned reinforcer is no longer paired with the primary reinforcer, then the conditioned reinforcer will no longer be valuable. This is due to_________ ______.
What are the pros of using a token economy?
-More difficult behaviors can be awarded more tokens. so there is fair compensation for the desired behavior.
-It is easy to keep tokens on hand and reinforce desired behavior immediately.
-Reinforcing with a token is less likely to disrupt the desired behavior relative to providing the back-up reinforcer (like access to an ipad)
-Tokens can be exchanged for a lot of different backup reinforcers, so the motivation to keep earning tokens is always high.
Some examples of primary reinforcers for humans are...
food, water, sleep, sexual stimulation, temperature regulation, oxygen, pain reduction
Token Economy
A set of rules governing the delivery of response-contingent conditioned reinforcers (tokens, points, etc.) that may be later exchanged for one or more backup reinforcers.
Motivating Operation
An environmental and/or biological event that (1) temporarily alters the value of a specific reinforcer and (2) increases/decreases the probability of behaviors yielding that reinforcer
Premack Principle
A high-probability behavior will function as a reinforcer when made contingent upon a low-probability behavior.
DRI
differential reinforcement of incompatible behavior; a procedure in which a previously reinforced behavior is placed on extinction while a second, incompatible behavior is reinforced.
*very similar to DRA, but the behavior we are teaching is physically incompatible with the challenging behavior
Habits are formed when an operant response has been repeatedly reinforced...
hundreds, if not thousands of times in the presence of the same antecedent stimulus.
What are the 6 principles of effective shaping?
1. Objectively define the terminal behavior.
2. Determine the dimension of the current behavior that the learner falls short.
3. Ensure that each step of the approximations are neither too easy nor too difficult.
4. Use differential reinforcement.
5. Be sure the learner has mastered each approximation before advancing to the next one.
6. If the next approximation proves too difficult, lower the reinforcement criterion until responding is reinforced again.
Give an example of DRA
Reinforcing "money please" and extinguishing crying for money.
*Also an example of Functional Communication Training (FCT)
Generalized Conditioned Reinforcer
A conditioned reinforcer that signals a delay reduction to more than one back-up reinforcer.
Establishing Operation
An environmental and/or biological event that (1) temporarily increases the value of a specific reinforcer and (2) increases the probability of behaviors yielding that reinforcer.
Breakpoint
The breakpoint is the maximum amount of behavior the reinforcer will maintain. This is a good measure of reinforcer efficacy.
DRA
differential reinforcement of an alternative response; a procedure in which a previously reinforced behavior is placed on extinction while a second, alternative behavior is reinforced.
Some examples of generalized conditioned reinforcers are...
money, points, tallies, punches in a punch card
What are the 4 dimensions of reinforcer efficacy?
1. Contingency
2. Immediacy
3. Quality
4. Size
Give an example of DRI.
Reinforcing lever pressing and extinguishing scratching on the floor (can't do both at once).
Marking
The conditioned reinforcer immediately follows the response, and this helps the individual learn which response produced the backup reinforcer. For example, presenting a clicker sound (that has already been paired with a primary reinforcer) immediately after a correct response and before the primary reinforcer is presented.
Abolishing Operation
An environmental and/or biological event that (1) temporarily decreases the value of a specific reinforcer and (2) decreases the probability of behaviors yielding that reinforcer
Operant behavior that is (1) evoked by antecedent stimuli and (2) persists despite the imposition of an AO.
DRL
Differentially reinforcing behavior that occurs at a low-rate and extinguishing behavior that occurs at a higher rate.
Responding that meets the reinforcement contingency no longer produces the reinforcer and, as a result falls to baseline (no-reinforcer) levels. This is called _____.
Extinction
What are the effects of extinction?
1. Reduction in the operant behavior
2. Emotional responding
3. Extinction burst (temporary increase in magnitude or frequency of the behavior)
4. Variety
5. Resurgence (engaging in other behaviors that have historically resulted in the same reinforcer)
Give an example of how you would condition a new reinforcer.
Process: Pair a primary or previously conditioned reinforcer with a neutral stimulus multiple times; then the newly conditioned stimulus will function as a conditioned reinforcer on its own.
Example: Pair praise (e.g., good job!) with food. Then, "good job!" can be used as a reinforcer to teach new skills or increase behavior without food.
Shaping
Differential reinforcement of successive approximations to a terminal behavior.
Reinforcer Survey
a structured interview or written survey that asks the individual to identify highly preferred activities that probably function as reinforcers (we don't know for sure until we provide them contingent on a specific behavior).
Escape-Extinction
responding that meets the negative reinforcement contingency no longer removes or reduces the aversive event. As a result, responding decreases to baseline (no-reinforcer) levels
Differential Reinforcement of Variability
Responses, or patterns of responses, that have either never been emitted before or have not been emitted in quite some time are reinforced, and repetition of recent response topographies are extinguished.
To condition a new reinforcer, we use _______ learning procedures.
Pavlovian (classical/respondent)
What are the principles for effective conditioned reinforcers?
1. Use an effective backup reinforcer.
2. Use a salient conditioned reinforcer.
3. Use a conditioned reinforcer that signals a large delay reduction to the backup reinforcer.
4. Make sure the conditioned reinforcer is not redundant.
Give an example of a mentalistic use of the term "motivation."
Saying someone has the "will", "desire", "determine" or some other internal drive to get things done that others who do not do those things do not have.
*this is not useful when we want to help people change their behavior for better.
Spontaneous Recovery of Operant Behavior
the temporary resumption in operant responding following time away from the extinction setting
Functional Analysis of Behavior
The scientific method used to (1) determine if a problem behavior is an operant and (2) identify the reinforcer that maintains that operant
Automatic Reinforcer
A consequence that is directly produced by the response – it is not provided by someone else – and which increases the behavior above a no-reinforcer baseline
DRO
Differential reinforcement of Other behavior; reinforcement is provided contingent upon abstaining from the problem behavior for a specified interval of time (while other behavior is occurring).
Percentile schedules of reinforcement are an ________ shaping technique.
automated
5 Strategies for Changing Habits
1. Identify antecedent stimuli that evoke bad habits.
2. Add antecedent stimuli that will evoke good habits.
3. Set the bar low (shaping).
4. Reinforce the new behavior (extrinsic or intrinsic reinforcers or both).
5. Gradually increase the goal (shaping).