Abstract: Although reinforcement often leads to repetitive, even stereotyped responding, that is not a necessary outcome. When it depends on variations, reinforcement results in responding that is diverse, novel, indeed unpredictable, with distributions sometimes approaching those of a random process. This article reviews evidence for the powerful and precise control by reinforcement over behavioral variability, evidence obtained from human and animal-model studies, and implications of such control. For example, reinforcement of variability facilitates learning of complex new responses, aids problem solving, and may contribute to creativity. Depression and autism are characterized by abnormally repetitive behaviors, but individuals afflicted with such psychopathologies can learn to vary their behaviors when reinforced for so doing. And reinforced variability may help to solve a basic puzzle concerning the nature of voluntary action.

Abstract: Although conventional therapies prevent organophosphate (OP) lethality, laboratory animals exposed to such treatments typically display behavioral incapacitation. Pretreatment with purified exogenous human or equine serum butyrylcholinesterase (Eq-BuChE), conversely, has effectively prevented OP lethality in rats and rhesus monkeys, without producing the adverse side effects associated with conventional treatments. In monkeys, however, using a commercial preparation of Eq-BuChE has been reported to incapacitate responding. In the present study, repeated administration of commercially prepared Eq-BuChE had no systematic effect on behavior in rhesus monkeys as measured by a six-item serial probe recognition task, despite 7- to 18-fold increases in baseline BuChE levels in blood. Antibody production induced by the enzyme was slight after the first injection and more pronounced following the second injection. The lack of behavioral effects, the relatively long in vivo half-life, and the previously demonstrated efficacy of BuChE as a biological scavenger for highly toxic OPs make BuChE potentially more effective than current treatment regimens for OP toxicity.

Abstract: We report that an African gray parrot (Psittacus erithacus), Alex, responds to stimuli on a relative basis. Previous laboratory studies with artificial stimuli (such as pure tones) suggest that birds make relational responses as a secondary strategy, only after they have acquired information about the absolute values of the stimuli. Alex, however, after learning to respond to a small set of exemplars on the basis of relative size, transferred this behavior to novel situations that did not provide specific information about the absolute values of the stimuli. He responded to vocal questions about which was the larger or smaller exemplar by vocally labeling its color or material, and he responded “none” if the exemplars did not differ in size. His overall accuracy was 78.7%.

Abstract: Forty-four horses were used to determine if a learned stimulus could be used to increase acquisition of a response unrelated to the original learned task. Horses were paired by age, breed and sex. One randomly chosen horse from each pair served as the control while the remaining horse was trained to respond to a visual stimulus by pushing a lever to obtain a food reward. In Experiment I (n=28), the food reward was delivered in a feed box located equidistant between two levers located 2.7 m apart on one wall of the test stall. Trained horses were given 30 training trials daily until they achieved at least 85% correct responses in three nonconsecutive days. After each trained horse reached criterion, both horses in the pair were tested in 30 trials daily for five consecutive days in a modified Y maze. The stimulus that indicated the correct lever in the initial training task was used to signify the correct arm of the maze for both the control and trained horses. The correct arm of the maze was changed randomly during each daily session, and correct choices resulted in a food reward. In Experiment II (n=16), levers were located on opposite walls (11 m apart) of the test stall, and the stimulus and modified Y maze were simplified. Trained horses received 15 training trials daily until they reached at least 85% correct responses on three consecutive days. As each trained horse achieved this criterion, both horses in the pair were tested in a maze for 15 trials daily for 7 days. Again, the stimulus from initial lever-pressing task was used to signify the rewarded arm of the maze. Correct choices of trained and control horses in both experiments were compared using a paired t-test. In Experiment I, no differences (P>0.34) in mean correct responses were detected between trained and control horses on the first day in the maze (15.3 and 16.8, respectively) or after 5 days in the maze (84.0 and 82.1, respectively). Similarly, in Experiment II, trained and control horses did not differ (P>0.50) in mean correct responses on the first day (6.9 and 7.4, respectively) or after 7 days in the maze (63.6 and 61.6, respectively). These results indicate that the stimuli used to solve the lever-pressing task were not utilized by horses in the maze task, and that horses may have difficulty transferring learned visual stimuli to new tasks.

Abstract: This series of studies investigated horses' ability to learn the concept of sameness under several different conditions. Before experimentation began, three horses were shaped to touch individually presented stimuli with their muzzles, and then to make two responses to two matching cards from an array of three. A modified version of the identity matching-to-sample (IMTS) procedure was used to present stimuli in a variety of configural arrangements on a barn wall (Experiment 1 and Experiment 2), and on a flat panel mounted to a barn door (Experiment 3). The task in each experiment was to select the two stimulus cards that were the same (either circles or Xs) and to avoid the nonmatching stimulus card (either a star or a square). In Experiment 1, the mean accuracy rate for selecting the matching alternatives was 74%. The horses' accuracy levels reached a mean level of 83% during Experiment 2, in which they received additional trials and an intermittent secondary reinforcement schedule. In Experiment 3, when the stimuli were moved further apart from each other within arrangements and were presented on a novel background, the mean accuracy rate was 73%. These data demonstrate that horses can learn complex discrimination problems involving the concept of sameness, and that they are able to generalize this learning to a novel stimulus presentation situation. These results also suggest that a relational discrimination test may be useful for assessing horses' learning ability and the level of training appropriate for individual horses.