Abstract: The intraparietal cortex is involved in the control of visually guided actions, like reach-to-grasp movements, which require extracting the 3D shape and position of objects from 2D retinal images. Using fMRI in behaving monkeys, we investigated the role of the intraparietal cortex in processing stereoscopic information for recovering the depth structure and the position in depth of objects. We found that while several areas (CIP, LIP, and AIP on the lateral bank; PIP and MIP on the medial bank) are activated by stereoscopic stimuli, AIP and an adjoining portion of LIP are sensitive only to depth structure. Furthermore, only these two regions are sensitive to both the depth structure and the 2D shape of small objects. These results indicate that extracting 3D spatial information from stereo involves several intraparietal areas, among which AIP and anterior LIP are more specifically engaged in extracting the 3D shape of objects.

Abstract: The neural mechanisms of stereoscopic 3D shape perception have only recently been investigated. Here we review the two cortical regions in which these mechanisms have been studied so far in macaques: a small subpart of inferotemporal cortex called TEs, and the caudal intraparietal (CIP) region. Neurons in TEs respond selectively to the orientation and curvature in depth of stereoscopic surfaces and this region provides a detailed 3D shape description of surface boundaries and surface content. This description is evoked only by binocular stimuli in which subjects see depth and it does not vary if depth is specified by different cues. Neurons in CIP are a selective for orientation in depth of surfaces and elongated objects, and their responses are also unaffected by changes in depth cues. Thus, stereoscopic 3D shape is processed in both the dorsal, occipito-parietal and the ventral, occipito-temporal streams.

Abstract: The capacity to anticipate the timing of environmental cues allows us to allocate sensory resources at the right time and prepare actions. Such anticipation requires knowledge of elapsed time and of the probability that an event will occur. Here we show that neurons in the parietal cortex represent the probability, as a function of time, that a salient event is likely to occur. Rhesus monkeys were trained to make eye movements to peripheral targets after a light dimmed. Within a block of trials, the 'go' times were drawn from either a bimodal or unimodal distribution of random numbers. Neurons in the lateral intraparietal area showed anticipatory activity that revealed an internal representation of both elapsed time and the probability that the 'go' signal was about to occur (termed the hazard rate). The results indicate that the parietal cortex contains circuitry for representing the time structure of environmental cues over a range of seconds.

Abstract: Most of the actions our brains perform on a daily basis, such as perceiving, speaking, and driving a car, require timing on the scale of tens to hundreds of milliseconds. New discoveries in psychophysics, electrophysiology, imaging, and computational modeling are contributing to an emerging picture of how the brain processes, learns, and perceives time.

Abstract: Stereoscopic vision requires the correspondence problem to be solved, i.e., discarding "false" matches between images of the two eyes, while keeping correct ones. To advance our understanding of the underlying neuronal mechanisms, we compared single neuron responses to correlated and anticorrelated random dot stereograms (RDSs). Inferior temporal neurons, which respond selectively to disparity-defined three-dimensional shapes, showed robust selectivity for correlated RDSs portraying concave or convex surfaces, but unlike neurons in areas V1, MT/V5, and MST, were not selective for anticorrelated RDSs. These results show that the correspondence problem is solved at least in far extrastriate cortex, as it is in the monkey's perception.

Abstract: The lower bank of the superior temporal sulcus (TEs), part of the inferior temporal cortex, contains neurons selective for disparity-defined three-dimensional (3-D) shape. The large majority of these TEs neurons respond to the spatial variation of disparity, i.e., are higher-order disparity selective. To determine whether curved boundaries or curved surfaces by themselves are sufficient to elicit 3-D shape selectivity, we recorded the responses of single higher-order disparity-selective TEs neurons to concave and convex 3-D shapes in which the disparity varied either along the boundary of the shape, or only along its surface. For a majority of neurons, a 3-D boundary was sufficient for 3-D shape selectivity. At least as many neurons responded selectively to 3-D surfaces, and a number of neurons exhibited both surface and boundary selectivity. The second aim of this study was to determine whether TEs neurons can represent differences in second-order disparities along the horizontal axis. The results revealed that TEs neurons can also be selective for horizontal 3-D shapes and can code the direction of curvature (vertical or horizontal). Thus, TEs neurons represent both boundaries and surfaces curved in depth and can signal the direction of curvature along a surface. These results show that TEs neurons use not only boundary but also surface information to encode 3-D shape properties.

Abstract: Neurons in the rostral lower bank of the superior temporal sulcus (TEs), part of the inferior temporal cortex, respond selectively to three-dimensional (3D) shapes. We have investigated how these neurons represent disparity-defined 3D structure. Most neurons were selective for either first-order (disparity gradients) or second-order (disparity curvature) disparities. The latter selectivity proved remarkably vulnerable to disparity discontinuities, such as sharp edges or steps in disparity. The majority of the neurons remained selective for small disparity variations within the stimulus. 3D shape selectivity was preserved when the frontoparallel position or the stimulus size was altered. Thus, in TEs, 3D shape is coded by first- and second-order disparity-selective neurons, which are highly sensitive to spatial variations of disparity.

Abstract: The anterior part of the macaque inferior temporal cortex, area TE, occupies a large portion of the temporal lobe and is critical for object recognition. Thus far, no relation between anatomical subdivisions of TE and neuronal selectivity has been described. Here, we present evidence that neurons selective for three-dimensional (3D) shape are concentrated in the lower bank of the superior temporal sulcus, whereas neurons in lateral TE are generally unselective for 3D shape, though equally selective for 2D shape. These findings reveal that TE consists of at least two distinct areas, one of which processes a specific object property.

Abstract: Real-world objects are three-dimensional (3D). Yet, it is unknown whether the neurons of the inferior temporal cortex, which is critical for object recognition, are selective for the 3D shape of objects. We tested for such selectivity by comparing responses to stereo-defined curved 3D shapes derived from identical pairs of monocular images. More than one-third of macaque inferior temporal neurons were selective for 3D shape. In the vast majority of those neurons, this selectivity depended on the global binocular disparity gradient and not on the local disparity. Thus, inferior temporal cortex processes not only two-dimensional but also 3D shape information.

Abstract: Rhesus monkeys can have deficiencies in stereo vision, making it necessary to screen monkey subjects intended for single cell studies of stereo-based depth processing. We measured VEPs in two monkeys using a dynamic random-dot display in which a stereo-defined checkerboard reversed in depth. Monkeys fixated upon a small dot during stimulus presentation. One monkey showed clear evoked potentials in response to changes in disparity that were similar to those obtained in human subjects, using an identical stimulus paradigm. Controls with presentations of the monocular stimulus sequences (in which no depth reversal can be perceived) yielded no or much weaker VEPs. In the other animal, however, there was no difference in evoked potential between the two conditions. These electrophysiological findings closely match the performance of these same two subjects in a disparity discrimination task in which they were previously trained. We conclude that VEPs using this type of stimulus display can be used to screen monkeys for single cell or behavioral studies of stereopsis.