Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2014 Dec 9:1:140049.
doi: 10.1038/sdata.2014.49. eCollection 2014.

An open science resource for establishing reliability and reproducibility in functional connectomics

Xi-Nian Zuo  1 Jeffrey S Anderson  2 Pierre Bellec  3 Rasmus M Birn  4 Bharat B Biswal  5 Janusch Blautzik  6 John C S Breitner  7 Randy L Buckner  8 Vince D Calhoun  9 F Xavier Castellanos  10 Antao Chen  11 Bing Chen  12 Jiangtao Chen  11 Xu Chen  11 Stanley J Colcombe  13 William Courtney  9 R Cameron Craddock  14 Adriana Di Martino  15 Hao-Ming Dong  16 Xiaolan Fu  17 Qiyong Gong  18 Krzysztof J Gorgolewski  19 Ying Han  20 Ye He  16 Yong He  21 Erica Ho  14 Avram Holmes  22 Xiao-Hui Hou  16 Jeremy Huckins  23 Tianzi Jiang  24 Yi Jiang  25 William Kelley  23 Clare Kelly  15 Margaret King  9 Stephen M LaConte  26 Janet E Lainhart  4 Xu Lei  11 Hui-Jie Li  25 Kaiming Li  18 Kuncheng Li  27 Qixiang Lin  21 Dongqiang Liu  12 Jia Liu  21 Xun Liu  25 Yijun Liu  11 Guangming Lu  28 Jie Lu  27 Beatriz Luna  29 Jing Luo  30 Daniel Lurie  14 Ying Mao  31 Daniel S Margulies  19 Andrew R Mayer  9 Thomas Meindl  6 Mary E Meyerand  32 Weizhi Nan  16 Jared A Nielsen  2 David O'Connor  14 David Paulsen  29 Vivek Prabhakaran  33 Zhigang Qi  27 Jiang Qiu  11 Chunhong Shao  34 Zarrar Shehzad  14 Weijun Tang  35 Arno Villringer  36 Huiling Wang  37 Kai Wang  16 Dongtao Wei  11 Gao-Xia Wei  25 Xu-Chu Weng  12 Xuehai Wu  31 Ting Xu  38 Ning Yang  16 Zhi Yang  25 Yu-Feng Zang  12 Lei Zhang  16 Qinglin Zhang  11 Zhe Zhang  16 Zhiqiang Zhang  28 Ke Zhao  25 Zonglei Zhen  21 Yuan Zhou  25 Xing-Ting Zhu  16 Michael P Milham  14
Affiliations

An open science resource for establishing reliability and reproducibility in functional connectomics

Xi-Nian Zuo et al. Sci Data. .

Abstract

Efforts to identify meaningful functional imaging-based biomarkers are limited by the ability to reliably characterize inter-individual differences in human brain function. Although a growing number of connectomics-based measures are reported to have moderate to high test-retest reliability, the variability in data acquisition, experimental designs, and analytic methods precludes the ability to generalize results. The Consortium for Reliability and Reproducibility (CoRR) is working to address this challenge and establish test-retest reliability as a minimum standard for methods development in functional connectomics. Specifically, CoRR has aggregated 1,629 typical individuals' resting state fMRI (rfMRI) data (5,093 rfMRI scans) from 18 international sites, and is openly sharing them via the International Data-sharing Neuroimaging Initiative (INDI). To allow researchers to generate various estimates of reliability and reproducibility, a variety of data acquisition procedures and experimental designs are included. Similarly, to enable users to assess the impact of commonly encountered artifacts (for example, motion) on characterizations of inter-individual variation, datasets of varying quality are included.

PubMed Disclaimer

Conflict of interest statement

The authors declare no competing financial interests.

Figures

Figure 1
Figure 1. Summary map of brain coverage for rfMRI scans in CoRR (N=5,093).
The color indicates the coverage ratio of rfMRI scans.
Figure 2
Figure 2. Test-retest plots of in-scanner head motion during rfMRI.
Total 1019 subjects who have at least two rfMRI sessions are selected. The green line indicates the correlation between the two sessions within the lower motion datasets (mean FD<0.2 mm). The blue line indicates the correlation for the higher motion datasets (mean FD >0.2 mm).
Figure 3
Figure 3. Individual differences in fALFF and the temporal sampling rate (TR).
Median fALFF values across each individual whole brains are plotted against the corresponding TR for each site. Different colors indicate labels of different sites.
Figure 4
Figure 4. Test-retest plots of individual variation-related functional boundaries.
Detection of functional boundaries was achieved via examination of voxel-wise coefficients of variation (CV) for fALFF, PCC, ReHo and VMHC maps. For the purpose of visualization, coefficients of variation were rank-ordered, whereby the relative degree of variation across participants at a given voxel, rather than the actual value, was plotted to better contrast brain regions. Ranking coefficients of variation (R-CV) efficiently identified regions of greatest inter-individual variability, thus delineating putative functional boundaries.

Similar articles

Cited by

  • Tracking brain arousal fluctuations with fMRI.
    Chang C, Leopold DA, Schölvinck ML, Mandelkow H, Picchioni D, Liu X, Ye FQ, Turchi JN, Duyn JH. Chang C, et al. Proc Natl Acad Sci U S A. 2016 Apr 19;113(16):4518-23. doi: 10.1073/pnas.1520613113. Epub 2016 Apr 5. Proc Natl Acad Sci U S A. 2016. PMID: 27051064 Free PMC article.
  • Postoperative cerebellar mutism syndrome is an acquired autism-like network disturbance.
    Suresh H, Morgan BR, Mithani K, Warsi NM, Yan H, Germann J, Boutet A, Loh A, Gouveia FV, Young J, Quon J, Morgado F, Lerch J, Lozano AM, Al-Fatly B, Kühn AA, Laughlin S, Dewan MC, Mabbott D, Gorodetsky C, Bartels U, Huang A, Tabori U, Rutka JT, Drake JM, Kulkarni AV, Dirks P, Taylor MD, Ramaswamy V, Ibrahim GM. Suresh H, et al. Neuro Oncol. 2024 May 3;26(5):950-964. doi: 10.1093/neuonc/noad230. Neuro Oncol. 2024. PMID: 38079480 Free PMC article.
  • The time-evolving epileptic brain network: concepts, definitions, accomplishments, perspectives.
    Bröhl T, Rings T, Pukropski J, von Wrede R, Lehnertz K. Bröhl T, et al. Front Netw Physiol. 2024 Jan 16;3:1338864. doi: 10.3389/fnetp.2023.1338864. eCollection 2023. Front Netw Physiol. 2024. PMID: 38293249 Free PMC article. Review.
  • A longitudinal resource for population neuroscience of school-age children and adolescents in China.
    Fan XR, Wang YS, Chang D, Yang N, Rong MJ, Zhang Z, He Y, Hou X, Zhou Q, Gong ZQ, Cao LZ, Dong HM, Nie JJ, Chen LZ, Zhang Q, Zhang JX, Zhang L, Li HJ, Bao M, Chen A, Chen J, Chen X, Ding J, Dong X, Du Y, Feng C, Feng T, Fu X, Ge LK, Hong B, Hu X, Huang W, Jiang C, Li L, Li Q, Li S, Liu X, Mo F, Qiu J, Su XQ, Wei GX, Wu Y, Xia H, Yan CG, Yan ZX, Yang X, Zhang W, Zhao K, Zhu L; Chinese Color Nest Consortium (CCNC); Lifespan Brain Chart Consortium (LBCC); Zuo XN. Fan XR, et al. Sci Data. 2023 Aug 21;10(1):545. doi: 10.1038/s41597-023-02377-8. Sci Data. 2023. PMID: 37604823 Free PMC article.
  • Cross-paradigm connectivity: reliability, stability, and utility.
    Cao H, Chen OY, McEwen SC, Forsyth JK, Gee DG, Bearden CE, Addington J, Goodyear B, Cadenhead KS, Mirzakhanian H, Cornblatt BA, Carrión RE, Mathalon DH, McGlashan TH, Perkins DO, Belger A, Thermenos H, Tsuang MT, van Erp TGM, Walker EF, Hamann S, Anticevic A, Woods SW, Cannon TD. Cao H, et al. Brain Imaging Behav. 2021 Apr;15(2):614-629. doi: 10.1007/s11682-020-00272-z. Brain Imaging Behav. 2021. PMID: 32361945 Free PMC article.

References

Data Citations

    1. Liu X., Nan W. Z., Wang K. 2014. Functional Connectomes Project International Neuroimaging Data-Sharing Initiative. http://dx.doi.org/10.15387/fcp_indi.corr.ipcas4 - DOI
    1. Zuo X. N. 2014. Functional Connectomes Project International Neuroimaging Data-Sharing Initiative. http://dx.doi.org/10.15387/fcp_indi.corr.ipcas7 - DOI
    1. Castellanos F. X., Di Martino A., Kelly C. 2014. Functional Connectomes Project International Neuroimaging Data-Sharing Initiative. http://dx.doi.org/10.15387/fcp_indi.corr.nyu1 - DOI
    1. Chen A. T., Lei X. 2014. Functional Connectomes Project International Neuroimaging Data-Sharing Initiative. http://dx.doi.org/10.15387/fcp_indi.corr.swu3 - DOI
    1. Chen A. T., Chen J. T. 2014. Functional Connectomes Project International Neuroimaging Data-Sharing Initiative. http://dx.doi.org/10.15387/fcp_indi.corr.swu2 - DOI

References

    1. Alivisatos A. P. et al. The brain activity map project and the challenge of functional connectomics. Neuron 74, 970–974 (2012). - PMC - PubMed
    1. Seung H. S. Neuroscience: Towards functional connectomics. Nature 471, 170–172 (2011). - PubMed
    1. Smith S. M. et al. Functional connectomics from resting-state fMRI. Trends Cogn. Sci. 17, 666–682 (2013). - PMC - PubMed
    1. Buckner R. L., Krienen F. M. & Yeo B. T. Opportunities and limitations of intrinsic functional connectivity MRI. Nat. Neurosci. 16, 832–837 (2013). - PubMed
    1. Sporns O. Contributions and challenges for network models in cognitive neuroscience. Nat. Neurosci. 17, 652–660 (2014). - PubMed

Publication types

LinkOut - more resources