Records |
Author |
Neuringer, A. |
Title |
Reinforced variability in animals and people: implications for adaptive action |
Type |
Journal Article |
Year |
2004 |
Publication ![sorted by Publication field, descending order (down)](img/sort_desc.gif) |
The American Psychologist |
Abbreviated Journal |
Am Psychol |
Volume |
59 |
Issue |
9 |
Pages |
891-906 |
Keywords |
Animals; Behavior, Animal; *Choice Behavior; Conditioning, Operant; Creativeness; Discrimination (Psychology); Humans; Memory; Problem Solving; *Reinforcement (Psychology) |
Abstract |
Although reinforcement often leads to repetitive, even stereotyped responding, that is not a necessary outcome. When it depends on variations, reinforcement results in responding that is diverse, novel, indeed unpredictable, with distributions sometimes approaching those of a random process. This article reviews evidence for the powerful and precise control by reinforcement over behavioral variability, evidence obtained from human and animal-model studies, and implications of such control. For example, reinforcement of variability facilitates learning of complex new responses, aids problem solving, and may contribute to creativity. Depression and autism are characterized by abnormally repetitive behaviors, but individuals afflicted with such psychopathologies can learn to vary their behaviors when reinforced for so doing. And reinforced variability may help to solve a basic puzzle concerning the nature of voluntary action. |
Address |
Department of Psychology, Reed College, Portland, OR 97202, USA. allen.neuringer@reed.edu |
Corporate Author |
|
Thesis |
|
Publisher |
|
Place of Publication |
|
Editor |
|
Language |
English |
Summary Language |
|
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
0003-066X |
ISBN |
|
Medium |
|
Area |
|
Expedition |
|
Conference |
|
Notes |
PMID:15584823 |
Approved |
no |
Call Number |
Equine Behaviour @ team @ |
Serial |
4106 |
Permanent link to this record |
|
|
|
Author |
Hogan, D.E.; Zentall, T.R.; Pace, G. |
Title |
Control of pigeons' matching-to-sample performance by differential sample response requirements |
Type |
Journal Article |
Year |
1983 |
Publication ![sorted by Publication field, descending order (down)](img/sort_desc.gif) |
The American journal of psychology |
Abbreviated Journal |
Am J Psychol |
Volume |
96 |
Issue |
1 |
Pages |
37-49 |
Keywords |
Animals; Association; *Color Perception; Columbidae; Cues; *Discrimination Learning; Reinforcement Schedule; Time Factors |
Abstract |
Pigeons were trained on a matching-to-sample task in which sample hue and required sample-specific observing behavior provided redundant, relevant cues for correct choices. On trials that involved red and yellow hues as comparison stimuli, a fixed-ratio 16 schedule (FR 16) was required to illuminate the comparisons when the sample was red, and a differential-reinforcement-of-low-rates 3-sec schedule (DRL 3-sec) was required when the sample was yellow. On trials involving blue and green hues as comparison stimuli, an FR 16 schedule was required when the sample was blue and a DRL 3-sec schedule was required when the sample was green. For some pigeons, a 0-sec delay intervened between sample offset and comparison onset, whereas other pigeons experienced a random mixture of 0-sec and 2-sec delay trials. Test trial performance at 0-sec delay indicated that sample-specific behavior controlled choice performance considerably more than sample hue did. Test performance was independent of whether original training involved all 0-sec delay trials or a mixture of 0-sec and 2-sec delays. Sample-specific observing response requirements appear to facilitate pigeons' matching-to-sample performance by strengthening associations between the observing response and correct choice. |
Address |
|
Corporate Author |
|
Thesis |
|
Publisher |
|
Place of Publication |
|
Editor |
|
Language |
English |
Summary Language |
|
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
0002-9556 |
ISBN |
|
Medium |
|
Area |
|
Expedition |
|
Conference |
|
Notes |
PMID:6859346 |
Approved |
no |
Call Number |
refbase @ user @ |
Serial |
265 |
Permanent link to this record |
|
|
|
Author |
Nallan, G.B.; Pace, G.M.; McCoy, D.F.; Zentall, T.R. |
Title |
The role of elicited responding in the feature-positive effect |
Type |
Journal Article |
Year |
1983 |
Publication ![sorted by Publication field, descending order (down)](img/sort_desc.gif) |
The American journal of psychology |
Abbreviated Journal |
Am J Psychol |
Volume |
96 |
Issue |
3 |
Pages |
377-390 |
Keywords |
Animals; Color Perception; Columbidae; *Discrimination (Psychology); Male; Practice (Psychology); Reinforcement (Psychology); Time Factors |
Abstract |
Hearst and Jenkins proposed in 1974 that elicited responding accounts for the feature-positive effect. To test this position, pigeons were exposed to a feature-positive or feature-negative discrimination between successively presented displays--one consisted of a red and a green response key and the other consisted of two green response keys. There were four main conditions: 5-5 (5-sec trials, 5-sec intertrial intervals), 5-30, 30-30, and 30-180. Conditions 5-30 and 30-180 should produce the largest amount of elicited responding, and therefore the largest feature-positive effects. A response-independent bird was yoked to each response-dependent bird to allow direct assessment of the amount of elicited responding generated by each condition. Contrary to the predictions by Hearst and Jenkins's theory, response-dependent birds showed large feature-positive effects in each condition. The largest feature-positive effect was obtained in condition 5-5. Response-independent birds produced similar results, but manifested low response rates. |
Address |
|
Corporate Author |
|
Thesis |
|
Publisher |
|
Place of Publication |
|
Editor |
|
Language |
English |
Summary Language |
|
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
0002-9556 |
ISBN |
|
Medium |
|
Area |
|
Expedition |
|
Conference |
|
Notes |
PMID:6650707 |
Approved |
no |
Call Number |
refbase @ user @ |
Serial |
266 |
Permanent link to this record |
|
|
|
Author |
Zentall, T.R.; Weaver, J.E.; Clement, T.S. |
Title |
Pigeons group time intervals according to their relative duration |
Type |
Journal Article |
Year |
2004 |
Publication ![sorted by Publication field, descending order (down)](img/sort_desc.gif) |
Psychonomic bulletin & review |
Abbreviated Journal |
Psychon Bull Rev |
Volume |
11 |
Issue |
1 |
Pages |
113-117 |
Keywords |
Animals; Columbidae; *Discrimination (Psychology); Reinforcement (Psychology); Time Factors; Time Perception |
Abstract |
In the present research, we asked whether pigeons tended to judge time intervals not only in terms of their absolute value but also relative to a duration from which they must be discriminated (i.e., longer or shorter). Pigeons were trained on two independent temporal discriminations. In one discrimination, sample durations of 2 and 8 sec were associated with, for example, red and green hue comparisons, respectively, and in the other discrimination, sample durations of 4 and 16 sec were associated with vertical and horizontal line comparisons, respectively. If pigeons are trained on a temporal discrimination and tested with intermediate durations, the subjective midpoint typically occurs close to the geometric mean of the two trained values. The 4- and 8-sec values were selected to be the geometric mean of the two values in the other discrimination. When a 4-sec test sample was presented with the comparisons from the 2- and 8-sec discrimination, the pigeons preferred the comparison associated with the shorter sample. Similarly, when an 8-sec test sample was presented with the comparisons from the 4- and 16-sec discrimination, the pigeons preferred the comparison associated with the longer sample. Thus, a relative grouping effect was found. That is, durations that should have produced indifferent choice were influenced by their relative durations (shorter than or longer than the alternative) during training. |
Address |
Department of Psychology, University of Kentucky, Lexington, Kentucky 40506-0044, USA. zentall@pop.uky.edu |
Corporate Author |
|
Thesis |
|
Publisher |
|
Place of Publication |
|
Editor |
|
Language |
English |
Summary Language |
|
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
1069-9384 |
ISBN |
|
Medium |
|
Area |
|
Expedition |
|
Conference |
|
Notes |
PMID:15116995 |
Approved |
no |
Call Number |
refbase @ user @ |
Serial |
231 |
Permanent link to this record |
|
|
|
Author |
Clement, T.S.; Feltus, J.R.; Kaiser, D.H.; Zentall, T.R. |
Title |
“Work ethic” in pigeons: reward value is directly related to the effort or time required to obtain the reward |
Type |
Journal Article |
Year |
2000 |
Publication ![sorted by Publication field, descending order (down)](img/sort_desc.gif) |
Psychonomic bulletin & review |
Abbreviated Journal |
Psychon Bull Rev |
Volume |
7 |
Issue |
1 |
Pages |
100-106 |
Keywords |
Animals; Behavior, Animal/*physiology; Cognition/physiology; Columbidae; Discrimination Learning/physiology; Female; Male; Reinforcement (Psychology); *Reward; Time Factors |
Abstract |
Stimuli associated with less effort or with shorter delays to reinforcement are generally preferred over those associated with greater effort or longer delays to reinforcement. However, the opposite appears to be true of stimuli that follow greater effort or longer delays. In training, a simple simultaneous discrimination followed a single peck to an initial stimulus (S+FR1 S-FR1) and a different simple simultaneous discrimination followed 20 pecks to the initial stimulus (S+FR20 S-FR20). On test trials, pigeons preferred S+FR20 over S+FR1 and S-FR20 over S-FR1. These data support the view that the state of the animal immediately prior to presentation of the discrimination affects the value of the reinforcement that follows it. This contrast effect is analogous to effects that when they occur in humans have been attributed to more complex cognitive and social factors. |
Address |
University of Kentucky, Lexington, USA |
Corporate Author |
|
Thesis |
|
Publisher |
|
Place of Publication |
|
Editor |
|
Language |
English |
Summary Language |
|
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
1069-9384 |
ISBN |
|
Medium |
|
Area |
|
Expedition |
|
Conference |
|
Notes |
PMID:10780022 |
Approved |
no |
Call Number |
refbase @ user @ |
Serial |
248 |
Permanent link to this record |
|
|
|
Author |
Sole, L.M.; Shettleworth, S.J.; Bennett, P.J. |
Title |
Uncertainty in pigeons |
Type |
Journal Article |
Year |
2003 |
Publication ![sorted by Publication field, descending order (down)](img/sort_desc.gif) |
Psychonomic bulletin & review |
Abbreviated Journal |
Psychon Bull Rev |
Volume |
10 |
Issue |
3 |
Pages |
738-745 |
Keywords |
Animals; Behavior, Animal; Columbidae; *Decision Making; Reinforcement (Psychology); Reward; Transfer (Psychology); Visual Perception |
Abstract |
Pigeons classified a display of illuminated pixels on a touchscreen as sparse or dense. Correct responses were reinforced with six food pellets; incorrect responses were unreinforced. On some trials an uncertain response option was available. Pecking it was always reinforced with an intermediate number of pellets. Like monkeys and people in related experiments, the birds chose the uncertain response most often when the stimulus presented was difficult to classify correctly, but in other respects their behavior was not functionally similar to human behavior based on conscious uncertainty or to the behavior of monkeys in comparable experiments. Our data were well described by a signal detection model that assumed that the birds were maximizing perceived reward in a consistent way across all the experimental conditions. |
Address |
University of Toronto, Toronto, Ontario, Canada |
Corporate Author |
|
Thesis |
|
Publisher |
|
Place of Publication |
|
Editor |
|
Language |
English |
Summary Language |
|
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
1069-9384 |
ISBN |
|
Medium |
|
Area |
|
Expedition |
|
Conference |
|
Notes |
PMID:14620372 |
Approved |
no |
Call Number |
refbase @ user @ |
Serial |
366 |
Permanent link to this record |
|
|
|
Author |
Roper, K.L.; Zentall, T.R. |
Title |
Directed forgetting in animals |
Type |
Journal Article |
Year |
1993 |
Publication ![sorted by Publication field, descending order (down)](img/sort_desc.gif) |
Psychological bulletin |
Abbreviated Journal |
Psychol Bull |
Volume |
113 |
Issue |
3 |
Pages |
513-532 |
Keywords |
Animals; Behavior, Animal; *Cognition; Columbidae; Conditioning (Psychology); Discrimination Learning; Female; Humans; Male; Memory Disorders/*psychology; Reinforcement (Psychology); Task Performance and Analysis |
Abstract |
Directed-forgetting research with animals suggests that animals show disrupted test performance only under certain conditions. Important variables are (a) whether during training, the cue to forget (F cue) signals nonreward (i.e., that the trial is over) versus reward (i.e., that reinforcement can be obtained) and (b) given that reinforcement can be obtained on F-cue trials, whether the post-F-cue response pattern is compatible with the baseline memory task. It is proposed that some findings of directed forgetting can be attributed to trained response biases, whereas others may be attributable perhaps to frustration-produced interference. It is suggested that directed forgetting in animals should be studied using procedures similar to those used to study directed forgetting in humans. This can be accomplished by presenting, within a trial, both to-be-remembered and to-be-forgotten material. |
Address |
Department of Psychology, University of Kentucky, Lexington 40506 |
Corporate Author |
|
Thesis |
|
Publisher |
|
Place of Publication |
|
Editor |
|
Language |
English |
Summary Language |
|
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
0033-2909 |
ISBN |
|
Medium |
|
Area |
|
Expedition |
|
Conference |
|
Notes |
PMID:8316612 |
Approved |
no |
Call Number |
refbase @ user @ |
Serial |
259 |
Permanent link to this record |
|
|
|
Author |
Christensen, J.W. |
Title |
Object habituation in horses: Voluntary vs. negatively reinforced approach to frightening stimuli |
Type |
Conference Article |
Year |
2012 |
Publication ![sorted by Publication field, descending order (down)](img/sort_desc.gif) |
Proceedings of the 2. International Equine Science Meeting |
Abbreviated Journal |
Proc. 2. Int. Equine. Sci. Mtg |
Volume |
in press |
Issue |
|
Pages |
|
Keywords |
Habituation; learning; fearfulness; stress; reinforcement |
Abstract |
The ability and ease of horses to habituate to frightening stimuli greatly increases safety in the horse-human relationship. Several different techniques have been suggested for habituation training of horses and under certain conditions, preventing animals from avoidance reactions during exposure to frightening stimuli is believed to facilitate habituation. Response prevention does, however, lead to a loss of control, which is a known stress inducer in both animals and humans. This experiment investigated whether horses show increased stress responses when negatively reinforced to approach a mildly frightening stimulus, compared to horses allowed to voluntarily explore the same stimulus. We further investigated whether the prevention of avoidance responses in horses that are negatively reinforced to approach the stimulus, facilitates habituation to the stimulus. Twenty-two 2-3 years old Danish warmblood geldings were included in the study. Half of the horses (NR group) were negatively reinforced (through halter and rope pressure) by a familiar human handler to approach a collection of frightening objects (six open and colourful umbrellas) placed in a semi-circle in a familiar test arena. The other half of the horses were released in the arena and were free to avoid or explore the objects (VOL group). On the next day, all horses were exposed to the objects again without a human to investigate the rate of habituation. Behavioural and heart rate responses were recorded on both days. Data were analysed in a two way repeated measures ANOVA and post hoc analysed via the Holm-Sidak method. In the VOL group, all horses initially chose to avoid the unknown objects, whereas the handler managed to get all horses in the NR group to approach and stand next to the objects within the first 2-min session. As expected, horses in the NR group had a significantly longer duration of alertness (sec, mean ± se: NR: 23 ± 4.1 vs. VOL: 16 ± 4.7, P=0.026) and a higher max HR in the first session (bpm, mean ± se: NR: 106 ± 5.2 vs. VOL: 88 ± 4.4, P=0.004). On the next day, however, the NR horses spent significantly less time investigating the objects (sec, mean ± se: NR: 13 ± 4.1 vs. VOL: 24 ± 6.0, P=0.005) and had a shorter latency to approach a feed container, placed next to the objects (sec, mean ± se: NR: 25 ± 3.9 vs. VOL: 47 ± 16.2, P=0.031), indicating increased habituation. In conclusion, negatively reinforced approach to mildly frightening objects appears to increase stress responses during the initial exposure, but also to facilitate habituation in young horses. |
Address |
|
Corporate Author |
Christensen, J.W. |
Thesis |
|
Publisher |
Xenophon Publishing |
Place of Publication |
Wald |
Editor |
Krueger, K. |
Language |
|
Summary Language |
|
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
978-3-9808134-26 |
ISBN |
|
Medium |
|
Area |
|
Expedition |
|
Conference |
|
Notes |
|
Approved |
no |
Call Number |
Equine Behaviour @ team @ |
Serial |
5499 |
Permanent link to this record |
|
|
|
Author |
Pickens, C.L.; Holland, P.C. |
Title |
Conditioning and cognition |
Type |
Journal Article |
Year |
2004 |
Publication ![sorted by Publication field, descending order (down)](img/sort_desc.gif) |
Neuroscience and Biobehavioral Reviews |
Abbreviated Journal |
Neurosci Biobehav Rev |
Volume |
28 |
Issue |
7 |
Pages |
651-661 |
Keywords |
Animals; Association Learning/physiology; Cognition/*physiology; Conditioning (Psychology)/*physiology; Discrimination Learning/physiology; Humans; Memory; Models, Psychological; Reinforcement (Psychology); Visual Perception/physiology |
Abstract |
Animals' abilities to use internal representations of absent objects to guide adaptive behavior and acquire new information, and to represent multiple spatial, temporal, and object properties of complex events and event sequences, may underlie many aspects of human perception, memory, and symbolic thought. In this review, two classes of simple associative learning tasks that address these core cognitive capacities are discussed. The first set, including reinforcer revaluation and mediated learning procedures, address the power of Pavlovian conditioned stimuli to gain access, through learning, to representations of upcoming events. The second set of investigations concern the construction of complex stimulus representations, as illustrated in studies of contextual learning, the conjunction of explicit stimulus elements in configural learning procedures, and recent studies of episodic-like memory. The importance of identifying both cognitive process and brain system bases of performance in animal models is emphasized. |
Address |
Department of Psychological and Brain Sciences, Johns Hopkins University, 3400 North Charles Street, Baltimore, MD 21218, USA |
Corporate Author |
|
Thesis |
|
Publisher |
|
Place of Publication |
|
Editor |
|
Language |
English |
Summary Language |
|
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
0149-7634 |
ISBN |
|
Medium |
|
Area |
|
Expedition |
|
Conference |
|
Notes |
PMID:15555675 |
Approved |
no |
Call Number |
Equine Behaviour @ team @ |
Serial |
2803 |
Permanent link to this record |
|
|
|
Author |
de Waal, F.B.M.; Davis, J.M. |
Title |
Capuchin cognitive ecology: cooperation based on projected returns |
Type |
Journal Article |
Year |
2003 |
Publication ![sorted by Publication field, descending order (down)](img/sort_desc.gif) |
Neuropsychologia |
Abbreviated Journal |
Neuropsychologia |
Volume |
41 |
Issue |
2 |
Pages |
221-228 |
Keywords |
Animals; Attention; Cebus/*psychology; *Cooperative Behavior; Decision Making; Dominance-Subordination; Female; Male; *Motivation; Reaction Time; Reinforcement Schedule; *Social Behavior |
Abstract |
Stable cooperation requires that each party's pay-offs exceed those available through individual action. The present experimental study on brown capuchin monkeys (Cebus apella) investigated if decisions about cooperation are (a) guided by the amount of competition expected to follow the cooperation, and (b) made instantaneously or only after a period of familiarization. Pairs of adult monkeys were presented with a mutualistic cooperative task with variable opportunities for resource monopolization (clumped versus dispersed rewards), and partner relationships (kin versus nonkin). After pre-training, each pair of monkeys (N=11) was subjected to six tests, consisting of 15 2 min trials each, with rewards available to both parties. Clumped reward distribution had an immediate negative effect on cooperation: this effect was visible right from the start, and remained visible even if clumped trials alternated with dispersed trials. The drop in cooperation was far more dramatic for nonkin than kin, which was explained by the tendency of dominant nonkin to claim more than half of the rewards under the clumped condition. The immediacy of responses suggests a decision-making process based on predicted outcome of cooperation. Decisions about cooperation thus take into account both the opportunity for and the likelihood of subsequent competition over the spoils. |
Address |
Living Links, Yerkes Primate Center, Emory University, 954 N. Gatewood Road, Atlanta, GA 30322, USA. dewaal@emory.edu |
Corporate Author |
|
Thesis |
|
Publisher |
|
Place of Publication |
|
Editor |
|
Language |
English |
Summary Language |
|
Original Title |
|
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
Series Volume |
|
Series Issue |
|
Edition |
|
ISSN |
0028-3932 |
ISBN |
|
Medium |
|
Area |
|
Expedition |
|
Conference |
|
Notes |
PMID:12459220 |
Approved |
no |
Call Number |
refbase @ user @ |
Serial |
182 |
Permanent link to this record |