Seminar Papers

[Article] Estimation of respiratory rate and effort from a chest-worn accelerometer using constrained and recursive principal component analysis & Accelerometer-based estimation of respiratory rate using principal component analysis and autocorrelation

Estimation of respiratory rate and effort from a chest-worn accelerometer using constrained and recursive principal component analysis

Summary: This study proposes a constrained and recursive PCA method to robustly estimate respiratory effort and respiratory rate from a chest-worn 3-axis accelerometer under realistic sleeping conditions with varying sensor positions and body postures. The accelerometer signal is projected onto a gravity-based horizontal plane, and recursive PCA combined with STFT and a quality index is applied to extract respiratory effort and estimate respiratory rate, significantly reducing estimation error compared to conventional block-wise, unconstrained PCA. The method demonstrated a clear trade-off between coverage and accuracy, achieving agreement intervals below 1.5 breaths/min for high coverage settings and below 0.2 breaths/min for low coverage settings, indicating high robustness and flexibility for clinical and wearable applications.

Schipper, Fons, et al. “Estimation of respiratory rate and effort from a chest-worn accelerometer using constrained and recursive principal component analysis.” Physiological Measurement 42.4 (2021): 045004.

Accelerometer-based estimation of respiratory rate using principal component analysis and autocorrelation

Summary: This study proposed a novel PCA–autocorrelation method for estimating respiratory rate (RR) using a tri-axial accelerometer placed on the abdomen and validated it against a reference flow meter. Results from 25 healthy participants showed a very strong correlation (r = 0.99) and narrow limits of agreement (±1.9 bpm), outperforming single-axis approaches. The method demonstrates a low-cost, non-intrusive solution for continuous RR monitoring, with potential for future clinical validation.

Hostrup, Mads CF, et al. “Accelerometer-based estimation of respiratory rate using principal component analysis and autocorrelation.” Physiological Measurement 46.3 (2025): 035005.

[Article] An open resource for transdiagnostic research in pediatric mental health and learning disorders

Summary: Introduces the Healthy Brain Network (HBN), a large open biobank (target n≈10k) with deep phenotyping and multimodal data (EEG, MRI, eye-tracking, voice/video, genetics), enabling transdiagnostic pediatric mental-health research.

Alexander, Lindsay M., et al. “An open resource for transdiagnostic research in pediatric mental health and learning disorders.” Scientific data 4.1 (2017): 1-26.

[Article] MindLLM: A Subject-Agnostic and Versatile Model for fMRI-to-Text Decoding & Generative language reconstruction from brain recordings & CorText-AMA: brain-language fusion as a new tool for probing visually evoked brain responses

MindLLM: A Subject-Agnostic and Versatile Model for fMRI-to-Text Decoding

Summary: In this seminar, we will explore a novel fMRI-to-text decoding framework named MindLLM. It combines a neuroscience-informed, subject-agnostic fMRI encoder with an off-the-shelf large language model to translate brain activity into coherent text. It introduces Brain Instruction Tuning (BIT), which enriches the model’s capacity to extract and represent diverse semantic information from fMRI signals, enabling versatile decoding across different tasks and subjects. We will discuss how to implement these techniques in our study.

Qiu, Weikang, et al. “MindLLM: A Subject-Agnostic and Versatile Model for fMRI-to-Text Decoding.” arXiv preprint arXiv:2502.15786 (2025).

Generative language reconstruction from brain recordings

Summary: Using non-invasive fMRI, the authors map brain-decoded semantic representations into a large language model so it can autoregressively generate text aligned with the perceived stimulus—achieving direct brain-to-language generation without pre-constructed candidates and better alignment than selection-based baselines.

Ye, Ziyi, et al. “Generative language reconstruction from brain recordings.” Communications Biology 8.1 (2025): 346.

CorText-AMA: brain-language fusion as a new tool for probing visually evoked brain responses

Summary: CorText-AMA introduces an end-to-end brain–language framework that fuses fMRI signals with a large language model to caption and answer questions about natural scenes via an interactive chat interface, enabling targeted probing of what visual-cortex activity encodes and outperforming control models using functional alignment.

Bosch, Victoria, et al. “CorText-AMA: brain-language fusion as a new tool for probing visually evoked brain responses.”

[Article] TRIBE: TRImodal Brain Encoder for whole-brain fMRI response prediction

Summary: In this paper, they made a step towards an integrative model of the brain during naturalistic perception by training an encoding model on an unprecedently-large fMRI dataset of participants watching videos. Importantly, their model is the first encoding pipeline which is simultaneously nonlinear, multisubject and multimodal d’Ascoli, S., Rapin, J., Benchetrit, Y., Banville, H., & King, J. R. (2025). TRIBE: TRImodal Brain Encoder for whole-brain fMRI response prediction. arXiv preprint arXiv:2507.22229.

[Article] TRIBE: TRImodal Brain Encoder for whole-brain fMRI response prediction

Summary: In this paper, they made a step towards an integrative model of the brain during naturalistic perception by training an encoding model on an unprecedently-large fMRI dataset of participants watching videos. Importantly, their model is the first encoding pipeline which is simultaneously nonlinear, multisubject and multimodal TRIBE: TRImodal Brain Encoder for whole-brain fMRI response prediction

[Article] Neural correlates of device-based sleep characteristics in adolescents & Physical and mental health in adolescence: novel insights from a transdiagnostic examination of Fitbit data in the ABCD study & Impact of Environmental Noise and Sleep Health on Pediatric Hypertension Incidence: ABCD Study

Neural correlates of device-based sleep characteristics in adolescents

Summary: This study integrated wearable device-measured sleep characteristics (sleep onset time, sleep duration, heart rate, etc.) with multimodal brain imaging data using sCCA in 3,222 adolescents participating in the ABCD Study to identify two major sleep-brain axes: one in which late sleep onset and short sleep duration were associated with reduced cortical-subcortical connectivity, and another in which high sleep heart rate and short light sleep duration were associated with reduced brain volume and connectivity.

Ma, Qing, et al. “Neural correlates of device-based sleep characteristics in adolescents.” Cell Reports 44.5 (2025).

Physical and mental health in adolescence: novel insights from a transdiagnostic examination of Fitbit data in the ABCD study

Summary: This study analyzed cross-sectionally how resting heart rate, sedentary time, and moderate activity time measured by Fitbit wearables were associated with pleiotropic-like experiences (PLEs), internalizing, and externalizing symptoms in 5,007 adolescents aged 10–13 years from the ABCD cohort.

Damme, Katherine SF, et al. “Physical and mental health in adolescence: novel insights from a transdiagnostic examination of FitBit data in the ABCD study.” Translational psychiatry 14.1 (2024): 75.

Impact of Environmental Noise and Sleep Health on Pediatric Hypertension Incidence: ABCD Study

Summary: This study analyzed data from 3320 participants of the ABCD study. Hypertension was defined as average blood pressure >=95th percentile for age, sex and height. They revealed that adequate sleep significantly reduces the risk of hypertension in adolescents, independent of environmental noise exposure. These findings underscore the importance of promoting good sleep hygiene among youth to mitigate hypertension risk.

De Moraes, Augusto César F., et al. “Impact of Environmental Noise and Sleep Health on Pediatric Hypertension Incidence: ABCD Study.” Journal of the American Heart Association 13.22 (2024): e037503.

[Article] Humans have nasal respiratory fingerprints

Summary: This study shows that long-term nasal airflow patterns are unique to each individual, stable over months to years, and can identify people with near-biometric accuracy. These “respiratory fingerprints” also reflect physiological states, such as sleep and BMI, as well as psychological traits like depression, anxiety, and autistic tendencies. The findings highlight nasal airflow as a rich, brain-driven signal linking physiology, emotion, and cognition. Soroka, Timna, et al. “Humans have nasal respiratory fingerprints.” Current Biology (2025).

[Article] Attention to cardiac sensations enhances the heartbeat-evoked potential during exhalation

Summary: They recently found higher HEP amplitude during exhalation than during inhalation during a task that involved attention to cardiac sensations. This may have been due to reduced cardiac perception during inhalation and heightened perception during exhalation, mediated by attentional mechanisms. To investigate relationships between HEP, attention, and respiration, they introduced an experimental setup that included tasks related to cardiac and respiratory interoceptive and exteroceptive attention. Results revealed HEP amplitude increases during the interoceptive tasks over fronto-central electrodes. When respiratory phases were taken into account, HEP increases were primarily driven by heartbeats recorded during exhalation, specifically during the cardiac interoceptive task, while inhalation had minimal impact. Zaccaro, Andrea, et al. “Attention to cardiac sensations enhances the heartbeat-evoked potential during exhalation.” Iscience 27.4 (2024).

[Article] A temporal sequence of thalamic activity unfolds at transitions in behavioral arousal state

Summary: This study measured sub-second activity within thalamocortical networks and nine thalamic nuclei in the human brain during spontaneous transitions in behavioral arousal state, using ultra-high field fast fMRI. The research discovered a stereotyped sequence of activity across thalamic nuclei and the cingulate cortex that preceded behavioral arousal after a period of inactivity, followed by widespread deactivation. These thalamic dynamics were linked to whether participants subsequently fell back into unresponsiveness, with unified thalamic activation reflecting the maintenance of behavior. Setzer, B., Fultz, N.E., Gomez, D.E.P. et al. A temporal sequence of thalamic activity unfolds at transitions in behavioral arousal state. Nat Commun 13, 5442 (2022).