PECON LAB

NatPAC

Large-scale 7T Human Neuroimaging Data: Naturalistic Perception, Action, and Cognition (NatPAC) Dataset

Overview

Large-scale human neuroimaging datasets have been crucial for mapping brain and cognitive functions at the macroscopic level. This project extends beyond traditional big data projects by leveraging high-resolution 7T functional imaging (Siemens 7T Terra) to map individual cognitive landscapes.

Key strengths of the dataset include:

  • Comprehensive Coverage: Sensory, cognitive, and affective processes within individuals, using both structured and naturalistic tasks.
  • High Spatial Resolution: Whole-brain fMRI at 1.5 mm³ isotropic resolution provides exceptional detail for understanding cognitive processes.
  • Innovative Naturalistic Tasks: Designed to probe higher-order cognitive functions, including audiovisual narratives, free speech, and interactive video games.

The dataset supports investigations from low-level sensory perception through high-level cognitive functions and enables the development of novel analysis methods and computational models. Additionally, it provides a comprehensive, integrated resource that combines anatomical, functional, and behavioral measures, facilitating a wide range of research across neuroscience and artificial intelligence.

1. Anatomical Data

The dataset includes various high-resolution anatomical images, such as T1-weighted (T1w), T2-weighted (T2w) MRI images, diffusion-weighted imaging (DWI), Susceptibility-weighted imaging (SWI), angiogram and venogram.

2. Behavioral Experiments & Questionnaires

The NatPAC dataset includes 22 behavioral tasks and 40+ questionnaires, spanning basic sensory processing through higher-level cognitive and emotional functions.

3. Structured Tasks

The NatPAC dataset comprises 13 functional localizers that cover a wide range of brain regions—from object category areas to reward-related regions—supporting individualized functional mapping.

  • Sensory Processes: population receptive field (pRF), object categories, visual motion, motor
  • Cognitive Processes: sustained attention, working memory, language & math, theory of mind, reward-related tasks
  • Affective Processes: emotion, heat pain

4. Naturalistic Tasks

To probe neural mechanisms in real-world settings, NatPAC features naturalistic paradigms—including narrative movie viewing, free-speaking activities, interactive 3D video games. We collect imaging data concurrently with physiological and eye-tracking measures. [link]

  • Narrative Movie Viewing: The NatPAC includes multiple movie-viewing sessions that vary in social intensity and interpretive complexity to examine real-world cognition. We collect fMRI, physiological, and eye-tracking data during viewing to capture real-time affective and cognitive responses. Follow-up recall and behavioral sessions provide additional insight into individual interpretations. [link]
  • Free-speaking Activities: We elicit spontaneous speech to sample thought-related brain activity, prompting participants to express diverse ideas and experiences, capturing rich, multidimensional neural signals. [link]
  • Interactive 3D Video Games (Minecraft Environment): To investigate the neural mechanisms underlying perception, action, and cognition as a continuous, integrated process in naturalistic settings, we developed interactive video games within a Minecraft environment. Participants engage in dynamic social interactions [link], strategic planning involving hierarchically structured sub-goals, and real-time strategy adjustments while navigating the virtual world [link].

5. Collaborators

We collaborate with researchers within our center and with experts around the world. Current collaborators include Jack L. Gallant (UC Berkeley), Kendrick N. Kay (University of Minnesota), Luke J. Chang (Dartmouth College), Wim Vanduffel (KU Leuven), and Kamil Uludag (University of Toronto).

Contact Information