Clement, T. S., Feltus, J. R., Kaiser, D. H., & Zentall, T. R. (2000). “Work ethic” in pigeons: reward value is directly related to the effort or time required to obtain the reward. Psychon Bull Rev, 7(1), 100–106.
Abstract: Stimuli associated with less effort or with shorter delays to reinforcement are generally preferred over those associated with greater effort or longer delays to reinforcement. However, the opposite appears to be true of stimuli that follow greater effort or longer delays. In training, a simple simultaneous discrimination followed a single peck to an initial stimulus (S+FR1 S-FR1) and a different simple simultaneous discrimination followed 20 pecks to the initial stimulus (S+FR20 S-FR20). On test trials, pigeons preferred S+FR20 over S+FR1 and S-FR20 over S-FR1. These data support the view that the state of the animal immediately prior to presentation of the discrimination affects the value of the reinforcement that follows it. This contrast effect is analogous to effects that when they occur in humans have been attributed to more complex cognitive and social factors.
|
Sole, L. M., Shettleworth, S. J., & Bennett, P. J. (2003). Uncertainty in pigeons. Psychon Bull Rev, 10(3), 738–745.
Abstract: Pigeons classified a display of illuminated pixels on a touchscreen as sparse or dense. Correct responses were reinforced with six food pellets; incorrect responses were unreinforced. On some trials an uncertain response option was available. Pecking it was always reinforced with an intermediate number of pellets. Like monkeys and people in related experiments, the birds chose the uncertain response most often when the stimulus presented was difficult to classify correctly, but in other respects their behavior was not functionally similar to human behavior based on conscious uncertainty or to the behavior of monkeys in comparable experiments. Our data were well described by a signal detection model that assumed that the birds were maximizing perceived reward in a consistent way across all the experimental conditions.
|
Nallan, G. B., Pace, G. M., McCoy, D. F., & Zentall, T. R. (1983). The role of elicited responding in the feature-positive effect. Am J Psychol, 96(3), 377–390.
Abstract: Hearst and Jenkins proposed in 1974 that elicited responding accounts for the feature-positive effect. To test this position, pigeons were exposed to a feature-positive or feature-negative discrimination between successively presented displays--one consisted of a red and a green response key and the other consisted of two green response keys. There were four main conditions: 5-5 (5-sec trials, 5-sec intertrial intervals), 5-30, 30-30, and 30-180. Conditions 5-30 and 30-180 should produce the largest amount of elicited responding, and therefore the largest feature-positive effects. A response-independent bird was yoked to each response-dependent bird to allow direct assessment of the amount of elicited responding generated by each condition. Contrary to the predictions by Hearst and Jenkins's theory, response-dependent birds showed large feature-positive effects in each condition. The largest feature-positive effect was obtained in condition 5-5. Response-independent birds produced similar results, but manifested low response rates.
|
Neuringer, A. (2004). Reinforced variability in animals and people: implications for adaptive action. Am Psychol, 59(9), 891–906.
Abstract: Although reinforcement often leads to repetitive, even stereotyped responding, that is not a necessary outcome. When it depends on variations, reinforcement results in responding that is diverse, novel, indeed unpredictable, with distributions sometimes approaching those of a random process. This article reviews evidence for the powerful and precise control by reinforcement over behavioral variability, evidence obtained from human and animal-model studies, and implications of such control. For example, reinforcement of variability facilitates learning of complex new responses, aids problem solving, and may contribute to creativity. Depression and autism are characterized by abnormally repetitive behaviors, but individuals afflicted with such psychopathologies can learn to vary their behaviors when reinforced for so doing. And reinforced variability may help to solve a basic puzzle concerning the nature of voluntary action.
|