Definitions I
Response-consequence contingency
A contingency that describes the causal (IF → THEN) relation between an operant behavior and its consequence.
Operant Behavior
Behavior influenced by antecedent and consequent events; a generic class of responses influenced by antecedents, with each response in the class producing the same consequence (revised definition Ch. 5 under "The Generic Nature of Operant Behavior")
Functional Analysis of Behavior
The scientific method used to (1) determine if a problem behavior is an operant and (2) identify the reinforcer that maintains that operant
Positive vs Negative
Positive: add, +
Negative: remove, -
*not good/bad, not increase/decrease behavior
Phylogenetic behavior
Examples: Moro reflex, rooting reflex, palmar grasp, sucking reflex, corneal reflex, startle reflex
What are the principles of effective Pavlovian conditioning?
2. The CS/NS is a salient event
3. The CS/NS signals a delay reduction to the US
Superstitious behavior
Behavior that occurs when the individual behaves as though a response–consequence contingency exists when, in fact, the relation between response and consequence is noncontingent.
Antecedent
An observable stimulus that is present before the behavior occurs.
Automatic Reinforcer
A consequence that is directly produced by the response – it is not provided by someone else – and which increases the behavior above a no-reinforcer baseline
Unconditioned Stimulus (US) vs Conditioned Stimulus (CS) vs Neutral Stimulus (NS)
US: elicits an unconditioned response (UR) without having to be paired with a CS.
CS: A previously NS that through repeated pairings with the US now elicits a CR.
NS: A stimulus that does not elicit any response until it is paired with a US.
Positive Reinforcement
Example:
Before: No free samples
Behavior: Go to Costco
After: Free samples
*Make sure you are adding a stimulus that increases behavior
What are the 3 things learned during Pavlovian conditioning?
1. The CS signals a delay reduction to the US.
2. The CS signals when the US is coming.
3. The CS signals which US is coming.
Consequence
An observable stimulus change that occurs after the behavior.
Reinforcer
a consequence that increases operant behavior above its baseline level.
Differential Reinforcement
a procedure in which a previously reinforced behavior is placed on extinction while a second behavior is reinforced.
Antecedent vs consequence
Antecedent occurs before the behavior. Consequence occurs after.
Negative Reinforcement--Escape
Example:
Before: Annoying fly in my face
Behavior: Swat with fly zapper
After: No annoying fly in my face
*Removal of an aversive stimulus that increases the behavior
Who first studied reinforcement?
Thorndike (Skinner continued and expanded on his work)
Pavlovian Extinction
The procedure in which the CS is presented repeatedly without the US of which is a reduction or elimination of the CS's ability to evoke the CR.
Reinforcement (general)
the process or procedure whereby a reinforcer increases operant behavior above its baseline level.
DRA
a procedure in which a previously reinforced behavior is placed on extinction while a second, alternative behavior is reinforced.
Reinforcement vs noncontingent reinforcement (NCR)
Reinforcement: consequences are reliably presented as a result of the behavior.
NCR: consequences are presented that happen to occur after a behavior.
Negative Reinforcement--Avoidance
Example:
Before: QB is going to get sacked by a defensive player
Behavior: QB runs backward and throws the ball
After: QB not going to get sacked
*Something bad is going to happen but you behave in a way to avoid it which increases the behavior
How do you know a stimulus is a reinforcer?
2. it increases behavior
3. when it is no longer presented (turned off), behavior decreases
Habituation
The gradual reduction in reflex responding following repeated presentations of the eliciting stimulus.
*Not the same as respondent extinction
The tendency for loss prevention (SRA−) to influence behavior more than presentation of the same stimulus (SR+).
DRI
a procedure in which a previously reinforced behavior is placed on extinction while a second, incompatible behavior is reinforced.
Reward vs Reinforcer
Reward: a consequence that we think will increase behavior; a preferred stimulus
Reinforcer: a stimulus that we have tested and know that it increases behavior (and decreases when no longer presented)
Respondent Conditioning
Example:
US: Food
NS/CS: Bell
UR/CR: Salivation
What are the 5 effects of extinction?
1. Reduction in the operant behavior
2. Emotional responding
3. Extinction burst (temporary increase in magnitude or frequency of the behavior)
4. Variety
5. Resurgence (engaging in other behaviors that have historically resulted in the same reinforcer)
Graduated Exposure
Gradual exposure to successively stronger approximations of the CS in order to reduce fear responses.
Extinction
Responding that meets the reinforcement contingency no longer produces the reinforcer and, as a result, it falls to baseline (no-reinforcer) levels.
Differential reinforcement of variability
Responses, or patterns of responses, that have either never been emitted before or have not been emitted in quite some time are reinforced, and repetition of recent response topographies are extinguished.
Intrinsic motivation vs Extrinsic reinforcers
Intrinsic motivation: being motivated to do something without added reinforcers that are not related to that task.
Extrinsic reinforcers: stimuli presented after a behavior to increase the frequency of the response that are not directly related to the task.
DRI
Reinforcing lever pressing and extinguishing scratching on the floor (can't do both at once).
Describe key differences between respondent and operant conditioning.
Operant: focus on consequences and behaviors of the musculo-skeletal system (not reflexes)
Respondent: focus on reflexes and glandular responses and the stimuli that precede (come before) them.
Spontaneous recovery of operant behavior
the temporary resumption in operant responding following time away from the extinction setting
Escape-extinction
responding that meets the negative reinforcement contingency no longer removes or reduces the aversive event. As a result, responding decreases to baseline (no-reinforcer) levels
DRL
Differentially reinforcing behavior that occurs at a low-rate and extinguishing behavior that occurs at a higher rate.
Strengthening vs information theory of reinforcement
Strengthening: response-reinforcer pairings strengthen a response to further establish it.
Information: response-reinforcer pairings provide information to the organism for how to get those reinforcers; behavior is controlled by the likely future, as exemplified by the past.
DRA
Reinforcing "money please" and extinguishing crying for money.