Clement, T. S., & Zentall, T. R. (2002). Second-order contrast based on the expectation of effort and reinforcement. J Exp Psychol Anim Behav Process, 28(1), 64–74.
Abstract: Pigeons prefer signals for reinforcement that require greater effort (or time) to obtain over those that require less effort to obtain (T. S. Clement, J. Feltus, D. H. Kaiser, & T. R. Zentall, 2000). Preference was attributed to contrast (or to the relatively greater improvement in conditions) produced by the appearance of the signal when it was preceded by greater effort. In Experiment 1, the authors of the present study demonstrated that the expectation of greater effort was sufficient to produce such a preference (a second-order contrast effect). In Experiments 2 and 3, low versus high probability of reinforcement was substituted for high versus low effort, respectively, with similar results. In Experiment 3, the authors found that the stimulus preference could be attributed to positive contrast (when the discriminative stimuli represented an improvement in the probability of reinforcement) and perhaps also negative contrast (when the discriminative stimuli represented reduction in the probability of reinforcement).
|
Zentall, T. R., & Clement, T. S. (2002). Memory mechanisms in pigeons: evidence of base-rate neglect. J Exp Psychol Anim Behav Process, 28(1), 111–115.
Abstract: In delayed matching to sample, once acquired, pigeons presumably choose comparisons according to their memory for (the strength of) the sample. When memory for the sample is sufficiently weak, comparison choice should depend on the history of reinforcement associated with each of the comparison stimuli. In the present research, pigeons acquired two matching tasks in which Sample S1 was associated with one comparison from each task, C1 and C3, whereas Sample S2 was associated with Comparison C2, and Sample S3 was associated with Comparison C4. As the retention interval increased, the pigeons showed a bias to choose the comparison (C1 or C3) associated with the more frequently occurring sample (S1). Thus, pigeons were sensitive also to the (irrelevant) likelihood that each of the samples was presented. The results suggest that pigeons may allow their reference memory for the overall sample frequency to influence comparison choice, independent of the comparison stimuli present.
|
Pickens, C. L., & Holland, P. C. (2004). Conditioning and cognition. Neurosci Biobehav Rev, 28(7), 651–661.
Abstract: Animals' abilities to use internal representations of absent objects to guide adaptive behavior and acquire new information, and to represent multiple spatial, temporal, and object properties of complex events and event sequences, may underlie many aspects of human perception, memory, and symbolic thought. In this review, two classes of simple associative learning tasks that address these core cognitive capacities are discussed. The first set, including reinforcer revaluation and mediated learning procedures, address the power of Pavlovian conditioned stimuli to gain access, through learning, to representations of upcoming events. The second set of investigations concern the construction of complex stimulus representations, as illustrated in studies of contextual learning, the conjunction of explicit stimulus elements in configural learning procedures, and recent studies of episodic-like memory. The importance of identifying both cognitive process and brain system bases of performance in animal models is emphasized.
|
Urcuioli, P. J., DeMarse, T. B., & Zentall, T. R. (1998). Transfer across delayed discriminations: II. Differences in the substitutability of initial versus test stimuli. J Exp Psychol Anim Behav Process, 24(1), 47–59.
Abstract: In 2 experiments, pigeons were trained on, and then transferred to, delayed simple discriminations in which the initial stimuli signalled reinforcement versus extinction following a retention interval. Experiment 1 showed that discriminative responding on the retention test transferred to novel test stimuli that had appeared in another delayed simple discrimination but not to stimuli having the same reinforcement history off-baseline. By contrast, Experiment 2 showed that performances transferred to novel initial stimuli whether they had been trained on-baseline or off-baseline. These results suggest that the test stimuli in delayed simple discriminations acquire control over responding only in the memory task itself. On the other hand, control by the initial stimuli, if coded as outcome expectancies, does not require such task-specific training.
|
Zentall, T. R., Sherburne, L. M., Roper, K. L., & Kraemer, P. J. (1996). Value transfer in a simultaneous discrimination appears to result from within-event pavlovian conditioning. J Exp Psychol Anim Behav Process, 22(1), 68–75.
Abstract: When pigeons acquire a simple simultaneous discrimination, some of the value acquired by the S+ transfers to the S-. The mechanism underlying this transfer of value was examined in three experiments. In Experiment 1, pigeons trained on two simultaneous discriminations (A + B- and C +/- D-) showed a preference for B over D. This preference was reduced, however, following the devaluation of A. In Experiment 2, when after the same original training, value was given to D, the pigeons' preference for C did not significantly increase. In Experiment 3, when both discriminations involved partial reinforcement (S +/-), A + C- training resulted in a preference for B over D, whereas B + D- training resulted in a preference for A over C. Thus, simultaneous discrimination training appears to result in bidirectional within-event conditioning involving the S+ and S-.
|
Boysen, S. T., Bernston, G. G., Hannan, M. B., & Cacioppo, J. T. (1996). Quantity-based interference and symbolic representations in chimpanzees (Pan troglodytes). J Exp Psychol Anim Behav Process, 22(1), 76–86.
Abstract: Five chimpanzees with training in counting and numerical skills selected between 2 arrays of different amounts of candy or 2 Arabic numerals. A reversed reinforcement contingency was in effect, in which the selected array was removed and the subject received the nonselected candies (or the number of candies represented by the nonselected Arabic numeral). Animals were unable to maximize reward by selecting the smaller array when candies were used as array elements. When Arabic numerals were substituted for the candy arrays, all animals showed an immediate shift to a more optimal response strategy of selecting the smaller numeral, thereby receiving the larger reward. Results suggest that a response disposition to the high-incentive candy stimuli introduced a powerful interference effect on performance, which was effectively overridden by the use of symbolic representations.
|
Boysen, S. T., & Berntson, G. G. (1995). Responses to quantity: perceptual versus cognitive mechanisms in chimpanzees (Pan troglodytes). J Exp Psychol Anim Behav Process, 21(1), 82–86.
Abstract: Two chimpanzees were trained to select among 2 different amounts of candy (1-6 items). The task was designed so that selection of either array by the active (selector) chimpanzee resulted in that array being given to the passive (observer) animal, with the remaining (nonselected) array going to the selector. Neither animal was able to select consistently the smaller array, which would reap the larger reward. Rather, both animals preferentially selected the larger array, thereby receiving the smaller number of reinforcers. When Arabic numerals were substituted for the food arrays, however, the selector animal evidenced more optimal performance, immediately selecting the smaller numeral and thus receiving the larger reward. These findings suggest that a basic predisposition to respond to the perceptual-motivational features of incentive stimuli can interfere with task performance and that this interference can be overridden when abstract symbols serve as choice stimuli.
|
Zentall, T. R., & Sherburne, L. M. (1994). Transfer of value from S+ to S- in a simultaneous discrimination. J Exp Psychol Anim Behav Process, 20(2), 176–183.
Abstract: Value transfer theory has been proposed to account for transitive inference effects (L. V. Fersen, C. D. L. Wynne, J. D. Delius, & J. E. R. Staddon, 1991), in which following training on 4 simultaneous discriminations (A+B-, B+C-, C+D-, D+E-) pigeons show a preference for B over D. According to this theory, some of the value of reinforcement acquired by each S+ transfers to the S-. In the transitive inference experiment, C (associated with both reward and nonreward) can transfer less value to D than A (associated only with reward) can transfer to B. Support for value transfer theory was demonstrated in 2 experiments in which an S- presented in the context of a stimulus to which responses were always reinforced (S+) was preferred over an S- presented in the context of a stimulus to which responses were sometimes reinforced (S +/-).
|
Shettleworth, S. J., & Plowright, C. M. (1992). How pigeons estimate rates of prey encounter. J Exp Psychol Anim Behav Process, 18(3), 219–235.
Abstract: Pigeons were trained on operant schedules simulating successive encounters with prey items. When items were encountered on variable-interval schedules, birds were more likely to accept a poor item (long delay to food) the longer they had just searched, as if they were averaging prey density over a short memory window (Experiment 1). Responding as if the immediate future would be like the immediate past was reversed when a short search predicted a long search next time (Experiment 2). Experience with different degrees of environmental predictability appeared to change the length of the memory window (Experiment 3). The results may reflect linear waiting (Higa, Wynne, & Staddon, 1991), but they differ in some respects. The findings have implications for possible mechanisms of adjusting behavior to current reinforcement conditions.
|
Sankey, C., Richard-Yris, M. - A., Henry, S., Fureix, C., Nassur, F., & Hausberger, M. (2010). Reinforcement as a mediator of the perception of humans by horses (Equus caballus). Anim. Cogn., 13(5), 753-764.
Abstract: A central question in the interspecific human/animal relationship is how domestic animals perceive humans as a significant element of their environment. In this study, we tested the hypothesis that the use of positive or negative reinforcement in horse training may have consequences on the animals’ perception of humans, as a positive, negative or neutral element. Two groups of ponies were trained to walk backwards in response to a vocal order using either positive or negative reinforcement. Heart rate monitors and behavioural observations were used to assess the animals’ perception of humans on the short (just after training) and long (5 months later) terms. The results showed that the type of reinforcement had a major effect on the subsequent animals’ perception of familiar and unfamiliar humans. Negative reinforcement was rapidly associated with an increased emotional state, as revealed by heart rate measurements and behavioural observations (head movements and ears laid back position). Its use led the ponies to seek less contact with humans. On the contrary, ponies trained with positive reinforcement showed an increased interest in humans and sought contact after training. This is especially remarkable as it was reached in a maximum of 5 sessions of 1 to 3 min (i.e. 5 to 15 min) and had lasting effects (visible after 5 months). Even learning was positively influenced by positive reinforcement. Overall, horses seem capable of associating humans to particular experiences and display extended long-term memory abilities.
|