Abstract: The ability of organisms to discriminate social signals, such as affective displays, using different sensory modalities is important for social communication. However, a major problem for understanding the evolution and integration of multimodal signals is determining how humans and animals attend to different sensory modalities, and these different modalities contribute to the perception and categorization of social signals. Using a matching-to-sample procedure, chimpanzees discriminated videos of conspecifics' facial expressions that contained only auditory or only visual cues by selecting one of two facial expression photographs that matched the expression category represented by the sample. Other videos were edited to contain incongruent sensory cues, i.e., visual features of one expression but auditory features of another. In these cases, subjects were free to select the expression that matched either the auditory or visual modality, whichever was more salient for that expression type. Results showed that chimpanzees were able to discriminate facial expressions using only auditory or visual cues, and when these modalities were mixed. However, in these latter trials, depending on the expression category, clear preferences for either the visual or auditory modality emerged. Pant-hoots and play faces were discriminated preferentially using the auditory modality, while screams were discriminated preferentially using the visual modality. Therefore, depending on the type of expressive display, the auditory and visual modalities were differentially salient in ways that appear consistent with the ethological importance of that display's social function.

Abstract: Female zebra finches show a preference for male zebra finches over heterospecific males based solely on the auditory cues of males, such as songs. The present study was designed to investigate whether females show a similar preference for male zebra finches based solely on visual cues. Using a Y-maze apparatus, social preference of female zebra finches was studied between male zebra finches and male Bengalese finches in three experiments. In experiment 1, where female zebra finches could see and hear live male zebra finches and male Bengalese finches, the females preferred to associate with the male zebra finches. In experiment 2, using a sound-attenuated experimental apparatus, subjects could see, but not hear, male zebra finches and male Bengalese finches. The subjects did not show a significant preference for associating with zebra finches. In experiment 3, as in experiment 2, females could see live male zebra finches and male Bengalese finches in the sound-attenuated chambers. However, in experiment 3, the subjects also heard prerecorded auditory cues (i.e., songs and calls) of male zebra finches, which were presented simultaneously in both arms of the maze. Although the females could not use the auditory cues to identify the location of the male zebra finches, they preferred to associate with the male zebra finches rather than the male Bengalese finches. These results suggest that visual cues alone were effective in initiating choice behaviors by females and that auditory cues facilitate such visually based choice behaviors.

Abstract: Humans regularly produce new utterances that are understood by other members of the same language community. Linguistic theories account for this ability through the use of syntactic rules (or generative grammars) that describe the acceptable structure of utterances. The recursive, hierarchical embedding of language units (for example, words or phrases within shorter sentences) that is part of the ability to construct new utterances minimally requires a 'context-free' grammar that is more complex than the 'finite-state' grammars thought sufficient to specify the structure of all non-human communication signals. Recent hypotheses make the central claim that the capacity for syntactic recursion forms the computational core of a uniquely human language faculty. Here we show that European starlings (Sturnus vulgaris) accurately recognize acoustic patterns defined by a recursive, self-embedding, context-free grammar. They are also able to classify new patterns defined by the grammar and reliably exclude agrammatical patterns. Thus, the capacity to classify sequences from recursive, centre-embedded grammars is not uniquely human. This finding opens a new range of complex syntactic processing mechanisms to physiological investigation.