Abstract: After Charles Darwin's The Expression of the Emotions in Man and Animals, published in 1872, we had to wait 60 years before the theme of animal expressions was picked up by another astute observer. In 1935, Nadezhda Ladygina-Kohts published a detailed comparison of the expressive behavior of a juvenile chimpanzee and of her own child. After Kohts, we had to wait until the 1960s for modern ethological analyses of primate facial and gestural communication. Again, the focus was on the chimpanzee, but ethograms on other primates appeared as well. Our understanding of the range of expressions in other primates is at present far more advanced than that in Darwin's time. A strong social component has been added: instead of focusing on the expressions per se, they are now often classified according to the social situations in which they typically occur. Initially, quantitative analyses were sequential (i.e., concerned with temporal associations between behavior patterns), and they avoided the language of emotions. I will discuss some of this early work, including my own on the communicative repertoire of the bonobo, a close relative of the chimpanzee (and ourselves). I will provide concrete examples to make the point that there is a much richer matrix of contexts possible than the common behavioral categories of aggression, sex, fear, play, and so on. Primate signaling is a form of negotiation, and previous classifications have ignored the specifics of what animals try to achieve with their exchanges. There is also increasing evidence for signal conventionalization in primates, especially the apes, in both captivity and the field. This process results in group-specific or “cultural” communication patterns.

Abstract: When novel and familiar faces are viewed simultaneously, humans and monkeys show a preference for looking at the novel face. The facial features attended to in familiar and novel faces, were determined by analyzing the visual exploration patterns, or scanpaths, of four monkeys performing a visual paired comparison task. In this task, the viewer was first familiarized with an image and then it was presented simultaneously with a novel and the familiar image. A looking preference for the novel image indicated that the viewer recognized the familiar image and hence differentiates between the familiar and the novel images. Scanpaths and relative looking preference were compared for four types of images: (1) familiar and novel objects, (2) familiar and novel monkey faces with neutral expressions, (3) familiar and novel inverted monkey faces, and (4) faces from the same monkey with different facial expressions. Looking time was significantly longer for the novel face, whether it was neutral, expressing an emotion, or inverted. Monkeys did not show a preference, or an aversion, for looking at aggressive or affiliative facial expressions. The analysis of scanpaths indicated that the eyes were the most explored facial feature in all faces. When faces expressed emotions such as a fear grimace, then monkeys scanned features of the face, which contributed to the uniqueness of the expression. Inverted facial images were scanned similarly to upright images. Precise measurement of eye movements during the visual paired comparison task, allowed a novel and more quantitative assessment of the perceptual processes involved the spontaneous visual exploration of faces and facial expressions. These studies indicate that non-human primates carry out the visual analysis of complex images such as faces in a characteristic and quantifiable manner.

Abstract: This study was designed to examine whether chimpanzees and monkeys exhibit a global-to-local precedence in the processing of hierarchically organized compound stimuli, as has been reported for humans. Subjects were tested using a sequential matching-to-sample paradigm using stimuli that differed on the basis of their global configuration or local elements, or on both perceptual attributes. Although both species were able to discriminate stimuli on the basis of their global configuration or local elements, the chimpanzees exhibited a global-to-local processing strategy, whereas the rhesus monkeys exhibited a local-to-global processing strategy. The results suggest that perceptual and attentional mechanisms underlying information-processing strategies may account for differences in learning by primates.

Abstract: A number of animal species have evolved the cognitive ability to detect when they are being watched by other individuals. Precisely what kind of information they use to make this determination is unknown. There is particular controversy in the case of the great apes because different studies report conflicting results. In experiment 1, we presented chimpanzees, orangutans, and bonobos with a situation in which they had to request food from a human observer who was in one of various attentional states. She either stared at the ape, faced the ape with her eyes closed, sat with her back towards the ape, or left the room. In experiment 2, we systematically crossed the observer's body and face orientation so that the observer could have her body and/or face oriented either towards or away from the subject. Results indicated that apes produced more behaviors when they were being watched. They did this not only on the basis of whether they could see the experimenter as a whole, but they were sensitive to her body and face orientation separately. These results suggest that body and face orientation encode two different types of information. Whereas face orientation encodes the observer's perceptual access, body orientation encodes the observer's disposition to transfer food. In contrast to the results on body and face orientation, only two of the tested subjects responded to the state of the observer's eyes.

Abstract: The ability of organisms to discriminate social signals, such as affective displays, using different sensory modalities is important for social communication. However, a major problem for understanding the evolution and integration of multimodal signals is determining how humans and animals attend to different sensory modalities, and these different modalities contribute to the perception and categorization of social signals. Using a matching-to-sample procedure, chimpanzees discriminated videos of conspecifics' facial expressions that contained only auditory or only visual cues by selecting one of two facial expression photographs that matched the expression category represented by the sample. Other videos were edited to contain incongruent sensory cues, i.e., visual features of one expression but auditory features of another. In these cases, subjects were free to select the expression that matched either the auditory or visual modality, whichever was more salient for that expression type. Results showed that chimpanzees were able to discriminate facial expressions using only auditory or visual cues, and when these modalities were mixed. However, in these latter trials, depending on the expression category, clear preferences for either the visual or auditory modality emerged. Pant-hoots and play faces were discriminated preferentially using the auditory modality, while screams were discriminated preferentially using the visual modality. Therefore, depending on the type of expressive display, the auditory and visual modalities were differentially salient in ways that appear consistent with the ethological importance of that display's social function.