Definitions I
Response-consequence contingency
A contingency that describes the causal (IF → THEN) relation between an operant behavior and its consequence.
Operant Behavior
Behavior influenced by antecedent and consequent events; a generic class of responses influenced by antecedents, with each response in the class producing the same consequence (revised definition Ch. 5 under "The Generic Nature of Operant Behavior")
Positive vs Negative
Positive: add, +
Negative: remove, -
*not good/bad, not increase/decrease behavior
Phylogenetic behavior
Examples: Moro reflex, rooting reflex, palmar grasp, sucking reflex, corneal reflex, startle reflex
What are the principles of effective Pavlovian conditioning?
2. The CS/NS is a salient event
3. The CS/NS signals a delay reduction to the US
Superstitious behavior
Behavior that occurs when the individual behaves as though a response–consequence contingency exists when, in fact, the relation between response and consequence is noncontingent.
Antecedent
An observable stimulus that is present before the behavior occurs.
Unconditioned Stimulus (US) vs Conditioned Stimulus (CS) vs Neutral Stimulus (NS)
US: elicits an unconditioned response (UR) without having to be paired with a CS.
CS: A previously NS that through repeated pairings with the US now elicits a CR.
NS: A stimulus that does not elicit any response until it is paired with a US.
Positive Reinforcement
Example:
Before: No free samples
Behavior: Go to Costco
After: Free samples
*Make sure you are adding a stimulus that increases behavior
What are the 3 things learned during Pavlovian conditioning?
1. The CS signals a delay reduction to the US.
2. The CS signals when the US is coming.
3. The CS signals which US is coming.
Consequence
An observable stimulus change that occurs after the behavior.
Reinforcer
a consequence that increases operant behavior above its baseline level.
Antecedent vs consequence
Antecedent occurs before the behavior. Consequence occurs after.
Negative Reinforcement--Escape
Example:
Before: Annoying fly in my face
Behavior: Swat with fly zapper
After: No annoying fly in my face
*Removal of an aversive stimulus that increases the behavior
Who first studied reinforcement?
Thorndike (Skinner continued and expanded on his work)
Pavlovian Extinction
The procedure in which the CS is presented repeatedly without the US of which is a reduction or elimination of the CS's ability to evoke the CR.
Reinforcement (general)
the process or procedure whereby a reinforcer increases operant behavior above its baseline level.
Reinforcement vs noncontingent reinforcement (NCR)
Reinforcement: consequences are reliably presented as a result of the behavior.
NCR: consequences are presented that happen to occur after a behavior.
Negative Reinforcement--Avoidance
Example:
Before: QB is going to get sacked by a defensive player
Behavior: QB runs backward and throws the ball
After: QB not going to get sacked
*Something bad is going to happen but you behave in a way to avoid it which increases the behavior
How do you know a stimulus is a reinforcer?
2. it increases behavior
3. when it is no longer presented (turned off), behavior decreases
Habituation
The gradual reduction in reflex responding following repeated presentations of the eliciting stimulus.
*Not the same as respondent extinction
Noncontingent consequence (and the effects of it)
Occurs after a response, but not because the response caused it to occur.
When the reinforcer that usually follows that behavior is now provided noncontingently (freely), the target behavior decreases because they do not have to behave to get it--they get it for free. See pages 124-125 of the book for more information.
Reward vs Reinforcer
Reward: a consequence that we think will increase behavior; a preferred stimulus
Reinforcer: a stimulus that we have tested and know that it increases behavior (and decreases when no longer presented)
Respondent Conditioning
Example:
US: Food
NS/CS: Bell
UR/CR: Salivation
What are the 5 effects of extinction?
1. Reduction in the operant behavior
2. Emotional responding
3. Extinction burst (temporary increase in magnitude or frequency of the behavior)
4. Variety
5. Resurgence (engaging in other behaviors that have historically resulted in the same reinforcer)
Graduated Exposure
Gradual exposure to successively stronger approximations of the CS in order to reduce fear responses.
Exploring and exploiting
Upon introduction to a new environment, an organism will explore ways to get a desired reinforcer. This results in a lot of response variability. After they learn which behavior results in the desired reinforcer, they will exclusively behave that way (i.e., exploitation) and response variability will decrease.
Intrinsic motivation vs Extrinsic reinforcers
Intrinsic motivation: being motivated to do something without added reinforcers that are not related to that task.
Extrinsic reinforcers: stimuli presented after a behavior to increase the frequency of the response that are not directly related to the task.
Taste-aversion learning
Eating a burger (NS) results in illness (food poisoning; US (toxin)->UR (vomiting)). For awhile after that, the smell of a burger (CS) results in a nauseous feeling (CR)
Describe key differences between Pavlovian (respondent) and operant conditioning.
Operant: focus on consequences and behaviors of the musculo-skeletal system (not reflexes)
Pavlovian (Respondent): focus on reflexes and glandular responses and the stimuli that precede (come before) them.
Spontaneous recovery of operant behavior
the temporary resumption in operant responding following time away from the extinction setting
Elicit
When a specific stimulus occasions a specific reflex response, we say that the stimulus elicits the response. This term is used exclusively with Pavlovian (respondent/classical) conditioning and Pavlovian (respondent/classical) behavior.
Strengthening vs information theory of reinforcement
Strengthening: response-reinforcer pairings strengthen a response to further establish it.
Information: response-reinforcer pairings provide information to the organism for how to get those reinforcers; behavior is controlled by the likely future, as exemplified by the past.
Who studied Pavlovian conditioning and how it explains how children acquire phobias (fear responses)? Hint: Little Albert
John B. Watson
Pavlovian (respondent/classical) extinction vs Habituation
Pavlovian extinction occurs when the conditioned stimulus and unconditioned stimulus are no longer paired together resulting in the conditioned stimulus no longer eliciting the conditioned response. Occurs after Pavlovian conditioning.
Habituation is when the reflex response (unconditioned response) no longer occurs after repeated presentations of the unconditioned stimulus. Pavlovian conditioning did not occur prior to this event.