Loading next page...
/lp/elsevier/quantitative-assessment-of-structural-image-quality-WYbjlFR2vH
- Publisher
- Elsevier
- Copyright
- Copyright © 2017 Elsevier Inc.
- ISSN
- 1053-8119
- eISSN
- 1095-9572
- D.O.I.
- 10.1016/j.neuroimage.2017.12.059
- Publisher site
- See Article on Publisher Site
Abstract
Data quality is increasingly recognized as one of the most important confounding factors in brain imaging research. It is particularly important for studies of brain development, where age is systematically related to in-scanner motion and data quality. Prior work has demonstrated that in-scanner head motion biases estimates of structural neuroimaging measures. However, objective measures of data quality are not available for most structural brain images. Here we sought to identify quantitative measures of data quality for T1-weighted volumes, describe how these measures relate to cortical thickness, and delineate how this in turn may bias inference regarding associations with age in youth. Three highly-trained raters provided manual ratings of 1840 raw T1-weighted volumes. These images included a training set of 1065 images from Philadelphia Neurodevelopmental Cohort (PNC), a test set of 533 images from the PNC, as well as an external test set of 242 adults acquired on a different scanner. Manual ratings were compared to automated quality measures provided by the Preprocessed Connectomes Project's Quality Assurance Protocol (QAP), as well as FreeSurfer's Euler number, which summarizes the topological complexity of the reconstructed cortical surface. Results revealed that the Euler number was consistently correlated with manual ratings across samples. Furthermore, the Euler number could be used to identify images scored “unusable” by human raters with a high degree of accuracy (AUC: 0.98–0.99), and out-performed proxy measures from functional timeseries acquired in the same scanning session. The Euler number also was significantly related to cortical thickness in a regionally heterogeneous pattern that was consistent across datasets and replicated prior results. Finally, data quality both inflated and obscured associations with age during adolescence. Taken together, these results indicate that reliable measures of data quality can be automatically derived from T1-weighted volumes, and that failing to control for data quality can systematically bias the results of studies of brain maturation.
Journal
Neuroimage – Elsevier
Published: Apr 1, 2018
Recommended Articles
Loading...
References
-
Subtle in-scanner motion biases automated measurement of brain anatomy from in vivo MRIAlexander-Bloch, A.; Clasen, L.; Stockman, M.; Ronan, L.; Lalonde, F.; Giedd, J.; Raznahan, A.
-
Automatic correction of motion artifacts in magnetic resonance images using an entropy focus criterionAtkinson, D.; Hill, D.L.; Stoyle, P.N.; Summers, P.E.; Keevil, S.F.
-
ANTsR: ANTs in R: Quantification Tools for Biomedical ImagesAvants, B.B.; Kandel, B.M.; Duda, J.T.; Cook, P.A.; Tustison, N.J.; Shrinidhi, K.
-
MR artifacts: a reviewBellon, E.; Haacke, E.; Coleman, P.; Sacco, D.; Steiger, D.; Gangarosa, R.
-
Quantitative and qualitative assessment of structural magnetic resonance imaging data in a two-center studyChalavi, S.; Simmons, A.; Dijkstra, H.; Barker, G.J.; Reinders, A.A.T.S.
-
Exploration of scanning effects in multi-site structural MRI studiesChen, J.; Liu, J.; Calhoun, V.D.; Arias-Vasquez, A.; Zwiers, M.P.; Gupta, C.N.; Franke, B.; Turner, J.A.
-
Benchmarking of Participant-level Confound Regression Strategies for the Control of Motion Artifact in Studies of Functional ConnectivityCiric, R.; Wolf, D.H.; Power, J.D.; Roalf, D.R.; Baum, G.; Ruparel, K.; Shinohara, R.T.; Elliott, M.A.; Eickhoff, S.B.; Davatzikos, C.; Gur, R.C.; Gur, R.E.; Bassett, D.S.; Satterthwaite, T.D.
-
Cortical surface-based analysis. I. Segmentation and surface reconstructionDale, A.M.; Fischl, B.; Sereno, M.I.
-
Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approachDeLong, E.R.; DeLong, D.M.; Clarke-Pearson, D.L.
-
An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interestDesikan, R.S.; Ségonne, F.; Fischl, B.; Quinn, B.T.; Dickerson, B.C.; Blacker, D.; Buckner, R.L.; Dale, A.M.; Maguire, R.P.; Hyman, B.T.; Albert, M.S.; Killiany, R.J.
-
FreeSurferFischl, B.
-
Measuring the thickness of the human cerebral cortex from magnetic resonance imagesFischl, B.; Dale, A.M.
-
Initial development and preliminary validation of a new negative symptom measure: the clinical assessment interview for negative symptoms (CAINS)Forbes, C.; Blanchard, J.J.; Bennett, M.; Horan, W.P.; Kring, A.; Gur, R.
-
Reducing inter-scanner variability of activation in a multicenter fMRI study: role of smoothness equalizationFriedman, L.; Glover, G.H.; Krenz, D.; Magnotta, V.
-
Movement-Related effects in fMRI time-seriesFriston, K.J.; Williams, S.; Howard, R.; Frackowiak, R.S.J.; Turner, R.
-
Age-related effects and sex differences in gray matter density, volume, mass, and cortical thickness from childhood to young adulthoodGennatas, E.D.; Avants, B.B.; Wolf, D.H.; Satterthwaite, T.D.; Ruparel, K.; Ciric, R.; Hakonarson, H.; Gur, R.E.; Gur, R.C.
-
Structural magnetic resonance imaging of the adolescent brainGiedd, J.N.
-
Brain development during childhood and adolescence: a longitudinal MRI studyGiedd, J.N.; Blumenthal, J.; Jeffries, N.O.; Castellanos, F.X.; Liu, H.; Zijdenbos, A.; Paus, T.; Evans, A.C.; Rapoport, J.L.
-
Dynamic mapping of human cortical development during childhood through early adulthoodGogtay, N.; Giedd, J.N.; Lusk, L.; Hayashi, K.M.; Greenstein, D.; Vaituzis, A.C.; Nugent, T.F.; Herman, D.H.; Clasen, L.S.; Toga, A.W.; Rapoport, J.L.; Thompson, P.M.
-
Generation and evaluation of a cortical area parcellation from resting-state correlationsGordon, E.M.; Laumann, T.O.; Adeyemo, B.; Huckins, J.F.; Kelley, W.M.; Petersen, S.E.
-
Improved optimization for the robust and accurate linear registration and motion correction of brain imagesJenkinson, M.; Bannister, P.; Brady, M.; Smith, S.
-
Comparing measures of sample skewness and kurtosisJoanes, D.N.; Gill, C.A.
-
Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): initial reliability and validity dataKaufman, J.; Birmaher, B.; Brent, D.; Rao, U.; Flynn, C.; Moreci, P.; Williamson, D.; Ryan, N.
-
Caret: Classification and Regression TrainingKuhn, M.; Weston, S.; Williams, A.; Keefer, C.; Engelhardt, A.; Cooper, T.; Mayer, Z.; Kenkel, B.; Benesty, M.; Lescarbeau, R.; Ziem, A.; Scrucca, L.; Tang, Y.; Candan, C.; Hunt, T.
-
A novel quantitative cross-validation of different cortical surface reconstruction algorithms using MRI phantomLee, J.K.; Lee, J.-M.; Kim, J.S.; Kim, I.Y.; Evans, A.C.; Kim, S.I.
-
Measurement of signal-to-noise and contrast-to-noise in the fBIRN multicenter imaging studyMagnotta, V.A.; Friedman, L.
-
Human Connectome Project Informatics: quality control, database services, and data visualizationMarcus, D.S.; Harms, M.P.; Snyder, A.Z.; Jenkinson, M.; Wilson, J.A.; Glasser, M.F.; Barch, D.M.; Archie, K.A.; Burgess, G.C.; Ramaratnam, M.; Hodge, M.; Horton, W.; Herrick, R.; Olsen, T.; McKay, M.; House, M.; Hileman, M.; Reid, E.; Harwell, J.; Coalson, T.; Schindler, J.; Elam, J.S.; Curtiss, S.W.; Van Essen, D.C.
-
Automatic quality assessment in structural brain magnetic resonance imagingMortamet, B.; Bernstein, M.A.; Jack, C.R.; Gunter, J.L.; Ward, C.; Britson, P.J.; Meuli, R.; Thiran, J.-P.; Krueger, G.
-
Motion and morphometry in clinical and nonclinical populationsPardoe, H.R.; Kucharsky Hiess, R.; Kuzniecky, R.
-
Automated quality assessment of structural magnetic resonance brain images based on a supervised machine learning algorithmPizarro, R.A.; Cheng, X.; Barnett, A.; Lemaitre, H.; Verchinski, B.A.; Goldman, A.L.; Xiao, E.; Luo, Q.; Berman, K.F.; Callicott, J.H.; Weinberger, D.R.; Mattay, V.S.
-
Spurious but systematic correlations in functional connectivity MRI networks arise from subject motionPower, J.D.; Barnes, K.A.; Snyder, A.Z.; Schlaggar, B.L.; Petersen, S.E.
-
Recent progress and outstanding issues in motion correction in resting state fMRIPower, J.D.; Schlaggar, B.L.; Petersen, S.E.
-
Head motion during MRI acquisition reduces gray matter volume and thickness estimatesReuter, M.; Tisdall, M.D.; Qureshi, A.; Buckner, R.L.; van der Kouwe, A.J.W.; Fischl, B.
-
Psych: Procedures for Psychological, Psychometric, and Personality ResearchRevelle, W.
-
The impact of quality assurance assessment on diffusion tensor imaging outcomes in a large-scale population-based cohortRoalf, D.R.; Quarmley, M.; Elliott, M.A.; Satterthwaite, T.D.; Vandekar, S.N.; Ruparel, K.; Gennatas, E.D.; Calkins, M.E.; Moore, T.M.; Hopson, R.; Prabhakaran, K.; Jackson, C.T.; Verma, R.; Hakonarson, H.; Gur, R.C.; Gur, R.E.
-
Heritability of subcortical and limbic brain volume and shape in multiplex-multigenerational families with schizophreniaRoalf, D.R.; Vandekar, S.N.; Almasy, L.; Ruparel, K.; Satterthwaite, T.D.; Elliott, M.A.; Podell, J.; Gallagher, S.; Jackson, C.T.; Prasad, K.; Wood, J.; Pogue-Geile, M.F.; Nimgaonkar, V.L.; Gur, R.C.; Gur, R.E.
-
The Philadelphia Neurodevelopmental Cohort: a publicly available resource for the study of normal and abnormal brain development in youthSatterthwaite, T.D.; Connolly, J.J.; Ruparel, K.; Calkins, M.E.; Jackson, C.; Elliott, M.A.; Roalf, D.R.; Hopson, R.; Prabhakaran, K.; Behr, M.; Qiu, H.; Mentch, F.D.; Chiavacci, R.; Sleiman, P.M.A.; Gur, R.C.; Hakonarson, H.; Gur, R.E.
-
Neuroimaging of the Philadelphia neurodevelopmental cohortSatterthwaite, T.D.; Elliott, M.A.; Ruparel, K.; Loughead, J.; Prabhakaran, K.; Calkins, M.E.; Hopson, R.; Jackson, C.; Keefe, J.; Riley, M.; Mentch, F.D.; Sleiman, P.; Verma, R.; Davatzikos, C.; Hakonarson, H.; Gur, R.C.; Gur, R.E.
-
Impact of in-scanner head motion on multiple measures of functional connectivity: relevance for studies of neurodevelopment in youthSatterthwaite, T.D.; Wolf, D.H.; Loughead, J.; Ruparel, K.; Elliott, M.A.; Hakon, H.; Gur, R.C.; Gur, R.E.
-
Motion-related artifacts in structural brain images revealed with independent estimates of in-scanner head motionSavalia, N.K.; Agres, P.F.; Chan, M.Y.; Feczko, E.J.; Kennedy, K.M.; Wig, G.S.
-
Neurodevelopmental trajectories of the human cerebral cortexShaw, P.; Kabani, N.J.; Lerch, J.P.; Eckstrand, K.; Lenroot, R.; Gogtay, N.; Greenstein, D.; Clasen, L.; Evans, A.; Rapoport, J.L.; Giedd, J.N.; Wise, S.P.
-
The preprocessed Connectomes Project quality assessment protocol - a resource for measuring the quality of MRI dataShehzad, Z.; Giavasis, S.; Li, Q.; Benhajali, Y.; Yan, C.; Yang, Z.; Milham, M.; Bellec, P.; Craddock, C.
-
Data quality influences observed links between functional connectivity and behaviorSiegel, J.S.; Mitra, A.; Laumann, T.O.; Seitzman, B.A.; Raichle, M.; Corbetta, M.; Snyder, A.Z.
-
Towards automated analysis of Connectomes: the configurable pipeline for the analysis of Connectomes (C-PAC)Sikka, S.; Cheung, B.; Khanuja, R.; Ghosh, S.; Yan, C.; Li, Q.; Vogelstein, J.; Burns, R.; Colcombe, S.; Craddock, C.; Mennes, M.; Kelly, C.; Dimartino, A.; Castellanos, F.; Milham, M.
-
MRI artifacts and correction strategiesSmith, T.B.; Nayak, K.S.
-
Asymptotic confidence intervals for indirect effects in structural equation modelsSobel, M.E.
-
Patterns of coordinated cortical remodeling during adolescence and their associations with functional specialization and evolutionary expansionSotiras, A.; Toledo, J.B.; Gur, R.E.; Gur, R.C.; Satterthwaite, T.D.; Davatzikos, C.
-
Mapping cortical change across the human life spanSowell, E.R.; Peterson, B.S.; Thompson, P.M.; Welcome, S.E.; Henkenius, A.L.; Toga, A.W.
-
Longitudinal mapping of cortical thickness and brain growth in normal childrenSowell, E.R.; Thompson, P.M.; Leonard, C.M.; Welcome, S.E.; Kan, E.; Toga, A.W.
-
Mapping continued brain growth and gray matter density reduction in dorsal frontal cortex: inverse relationships during postadolescent brain maturationSowell, E.R.; Thompson, P.M.; Tessner, K.D.; Toga, A.W.
-
Multisite Validation of Image Analysis Methods: Assessing Intra- and Intersite VariabilityStyner, M.A.; Charles, H.C.; Park, J.; Gerig, G.
-
Brain maturation in adolescence and young adulthood: regional age-related changes in cortical thickness and white matter volume and microstructureTamnes, C.K.; Ostby, Y.; Fjell, A.M.; Westlye, L.T.; Due-Tønnessen, P.; Walhovd, K.B.
-
Volumetric navigators for prospective motion correction and selective reacquisition in neuroanatomical MRITisdall, M.D.; Hess, A.T.; Reuter, M.; Meintjes, E.M.; Fischl, B.; van der Kouwe, A.J.W.
-
Prospective motion correction with volumetric navigators (vNavs) reduces the bias and variance in brain morphometry induced by subject motionTisdall, M.D.; Reuter, M.; Qureshi, A.; Buckner, R.L.; Fischl, B.; van der Kouwe, A.J.W.
-
The influence of head motion on intrinsic functional connectivity MRIVan Dijk, K.R.A.; Sabuncu, M.R.; Buckner, R.L.
-
Topologically dissociable patterns of development of the human cerebral cortexVandekar, S.N.; Shinohara, R.T.; Raznahan, A.; Roalf, D.R.; Ross, M.; DeLeo, N.; Ruparel, K.; Verma, R.; Wolf, D.H.; Gur, R.C.; Gur, R.E.; Satterthwaite, T.D.
-
Bda: Density Estimation for Grouped DataWang, B.
-
No-Reference image quality metrics for structural MRIWoodard, J.P.; Carley-Spencer, M.P.
-
A Connectome Computation System for discovery science of brainXu, T.; Yang, Z.; Jiang, L.; Xing, X.-X.; Zuo, X.-N.
-
A comprehensive assessment of regional variation in the impact of head micromovements on functional connectomicsYan, C.-G.; Cheung, B.; Kelly, C.; Colcombe, S.; Craddock, R.C.; Di Martino, A.; Li, Q.; Zuo, X.-N.; Castellanos, F.X.; Milham, M.P.
-
DPABI: data processing & analysis for (Resting-State) brain imagingYan, C.-G.; Wang, X.-D.; Zuo, X.-N.; Zang, Y.-F.
-
Spurious group differences due to head motion in a diffusion MRI studyYendiki, A.; Koldewyn, K.; Kakunoori, S.; Kanwisher, N.; Fischl, B.
-
The organization of the human cerebral cortex estimated by intrinsic functional connectivityYeo, B.T.T.; Krienen, F.M.; Sepulcre, J.; Sabuncu, M.R.; Lashkari, D.; Hollinshead, M.; Roffman, J.L.; Smoller, J.W.; Zöllei, L.; Polimeni, J.R.; Fischl, B.; Liu, H.; Buckner, R.L.
-
Motion artifacts in MRI: a complex problem with many partial solutionsZaitsev, M.; Maclaren, J.; Herbst, M.
-
Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithmZhang, Y.; Brady, M.; Smith, S.
-
Human connectomics across the life spanZuo, X.-N.; He, Y.; Betzel, R.F.; Colcombe, S.; Sporns, O.; Milham, M.P.
-
Test-retest reliabilities of resting-state FMRI measurements in human brain functional connectomics: a systems neuroscience perspectiveZuo, X.-N.; Xing, X.-X.
@Phil_Robichaud
@deepthiw
@JoseServera