Probing the Role of Feature Dimension Maps in Visual Cognition: Impact of Salience Level (Expt 1.1)

Overview

How does one know what to look at in a scene? Imagine a "Where's Waldo" game - it's challenging to find Waldo because there are many 'salient' locations in the picture, each vying for one's attention. One can only attend to a small location on the picture at a given moment, so to find Waldo, one needs to direct their attention to different locations. One prominent theory about how one accomplishes this claims that important locations are identified based on distinct feature types (for example, motion or color), with locations most unique compared to the background most likely to be attended. An important component of this theory is that individual feature dimensions (again, color or motion) are computed within their own 'feature maps', which are thought to be implemented in specific brain regions. However, whether and how specific brain regions contribute to these feature maps remains unknown. The goal of this study is to determine how brain regions that respond strongly to different feature types (color and motion) and which encode spatial locations of visual stimuli extract 'feature dimension maps' based on stimulus properties, including feature contrast. The investigators hypothesize that feature-selective brain regions act as neural feature dimension maps, and thus encode representations of salient location(s) based on their preferred feature dimension. The investigators will scan healthy human participants using functional MRI (fMRI) in a repeated-measures design while they view visual stimuli made salient based on different combinations of feature dimensions. The investigators will employ state-of-the-art multivariate analysis techniques that allow them to reconstruct an 'image' of the stimulus representation encoded by each brain region to dissect how neural tissue identifies salient locations. Each participant will perform a challenging task at the center of the screen to ensure they keep their eyes still and ignore the stimuli presented in the periphery, which are used to gauge how the visual system automatically extracts important locations without confounding factors like eye movements. Across trials and experiments the investigators will manipulate 1) the 'strength' of the salient locations based on how different the salient stimulus is compared to the background, 2) the number of salient locations, and 3) the feature value(s) used to make each location salient. Altogether, these manipulations will help the investigators fully understand these critical salience computations in the healthy human visual system.

In this experiment, participants will engage in all task conditions in a repeated-measures design. Participants are not randomly assigned to groups, as all participants will experience the same set of experimental manipulations. In this experiment, participants will engage in a series of challenging visual attention tasks while their eye position is tracked during fMRI scanning. In all tasks, participants will perform challenging discrimination judgments based on a stimulus presented at the fixation point (discriminate the aspect ratio of a + target - wide or tall?). Behavioral responses will be recorded with a button press, which participants will make using a fMRI-compatible button box held in their right hand. In this Experiment, the investigators will manipulate aspects of the stimulus display while holding the behavioral task constant. These manipulations will allow the investigators to test the role of feature-selective retinotopic regions of interest (ROIs) in automatically extracting salient information from the environment to guide visual attention. In this Experiment (Experiment 1.1), the investigators will test the effect of changing the salience-defining feature of a visual stimulus display on stimulus representations reconstructed from fMRI activation patterns in feature-selective retinotopic ROIs. Participants will continuously perform the challenging fixation discrimination task while occasional salient stimuli appear. Stimuli will consist of flickering checkerboards, static colored dot fields with localized salient patches of differently-colored dots, and moving grayscale dot fields with localized salient patches of dots moving in a different direction. Single neurons in macaque visual cortex have been shown to respond to salient stimuli, and so the investigators expect to see, based on these previous studies, a substantial representation of the salient stimulus location in response patterns measured from feature-selective brain regions. Participants will also be scanned for an anatomical \& retinotopic mapping session, which will allow the investigators to identify brain regions for further analysis using well-established and standardized procedures. STATISTICAL DESIGN \& POWER The fMRI studies described in this study record employ an inverted encoding model (IEM) for spatial position to quantify stimulus representations in reconstructed spatial maps of the visual field based on activation patterns measured in retinotopic feature-selective ROIs. The investigators rigorously identify ROIs using independent retinotopic mapping and localizer techniques, and use a 'mapping' task to estimate a 'fixed' encoding model for use across all conditions in each Experiment reported. These design decisions ensure that the investigators can maximize their ability to detect effects of their manipulations of interest within individual participants and brain regions and maximize the statistical power. The investigators use a compromise between deep imaging of several experimental and stimulus conditions within individual participants and aggregation of data across a moderate sample of these deeply-imaged participants (n = 10; see below). This allows the investigators to attain high-quality, reproducible estimates of model-based stimulus representations across task and stimulus manipulations within individual participants and conduct statistical inference on these measurements across the study sample. fMRI analyses will be conducted within each participant's individual brain, and voxels are assigned 'region' labels according to independent criteria (functional retinotopic mapping). Accordingly, there are no comparisons that require precise alignment of brain tissue between participants, and no generation of group-averaged 'maps' of brain activation. As such, concerns about reproducibility of brain maps and associated statistical power concerns are irrelevant to this study design. The statistical design of the study is a repeated-measures design, whereby each participant is exposed to all manipulations in the study. The order of manipulations each participant experiences is randomized across participants. The investigators will employ nonparametric randomization tests for all statistical comparisons whereby they will conduct hypothesis testing (e.g., repeated-measures analysis of variance) using 'shuffled' data (misaligned condition labels relative to measured map activation on each trial) to generate a null distribution of test statistics under the null hypothesis of no effect of their independent variable(s). Once this procedure is repeated extensively (1,000 times) per test, the p-value can be estimated by comparing the test statistic computed using intact labels to this null distribution, and corrected for multiple comparisons as appropriate (e.g., via false discovery rate). Using permutation procedures to generate a null distribution minimizes reliance on parametric assumptions. Additionally, the experiments within the study are designed such that sufficient data will be acquired that data from each individual participant can be used to test the effects of interest. Accordingly, each participant can be considered independent 'replication' of each other participant. Previous studies adopting a similar methodology whereby IEM-based reconstructions of visual stimuli are compared between conditions have employed relatively small sample sizes (n = 8; n = 8; n = 7). Other studies using population receptive field models or location-specific functional localizer, which are in principle very similar to the approach employed here, have used smaller sample sizes (e.g., n = 6). Sample size \& statistical power: In this study, the investigators will acquire an intermediate sample size with extensive data per task condition (n = 10; 2 experimental fMRI sessions, each 1.5-2 hrs, for each participant; along with a 2-hr anatomical imaging and retinotopic mapping fMRI session). Of particular interest, one study used n = 6 participants to establish with a large effect size dz = 3.52 that V1 voxels tuned to a stimulus location where a salient stimulus was defined by feature contrast respond more strongly than when feature contrast is absent. In another study, similar effect sizes were reported by this group in a color-selective ROI known as hV4 (n = 6; dz = 1.06 and 1.80 for orientation- and motion-based contrast, respectively). Accordingly, assuming a conservative effect size of 0.90 (based on those reported previously), the investigators expect a sample size of n = 10 will allow the study to be well-powered (80%, α = 0.05) to detect a similar change in this Experiment (Experiment 1.1), which is most analogous to this study (one-tailed paired T-test). Additionally, the investigators used their pilot data (n = 3) to measure the effect size for the critical comparison between salience-related modulations between feature-selective regions to be dz = 3.10 for the salience-defining feature. These values are commensurate with those cited above, and further support the selection of sample size. If analyses of data acquired during further pilot testing \& experiment refinement suggest smaller effect sizes, the investigators will refine the power analyses and adjust the projected enrollment accordingly to ensure robust and reproducible results. Note that this power analysis relies on parametric assumptions which will not be required for the proposed analyses, which invoke randomization methods to compute empirical null distributions.