Quantitative assessment of structural image quality

Quantitative assessment of structural image quality Data quality is increasingly recognized as one of the most important confounding factors in brain imaging research. It is particularly important for studies of brain development, where age is systematically related to in-scanner motion and data quality. Prior work has demonstrated that in-scanner head motion biases estimates of structural neuroimaging measures. However, objective measures of data quality are not available for most structural brain images. Here we sought to identify quantitative measures of data quality for T1-weighted volumes, describe how these measures relate to cortical thickness, and delineate how this in turn may bias inference regarding associations with age in youth. Three highly-trained raters provided manual ratings of 1840 raw T1-weighted volumes. These images included a training set of 1065 images from Philadelphia Neurodevelopmental Cohort (PNC), a test set of 533 images from the PNC, as well as an external test set of 242 adults acquired on a different scanner. Manual ratings were compared to automated quality measures provided by the Preprocessed Connectomes Project's Quality Assurance Protocol (QAP), as well as FreeSurfer's Euler number, which summarizes the topological complexity of the reconstructed cortical surface. Results revealed that the Euler number was consistently correlated with manual ratings across samples. Furthermore, the Euler number could be used to identify images scored “unusable” by human raters with a high degree of accuracy (AUC: 0.98–0.99), and out-performed proxy measures from functional timeseries acquired in the same scanning session. The Euler number also was significantly related to cortical thickness in a regionally heterogeneous pattern that was consistent across datasets and replicated prior results. Finally, data quality both inflated and obscured associations with age during adolescence. Taken together, these results indicate that reliable measures of data quality can be automatically derived from T1-weighted volumes, and that failing to control for data quality can systematically bias the results of studies of brain maturation. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Neuroimage Elsevier

Quantitative assessment of structural image quality

12 pages
Read Article

Loading next page...
 
/lp/elsevier/quantitative-assessment-of-structural-image-quality-WYbjlFR2vH
Publisher
Elsevier
Copyright
Copyright © 2017 Elsevier Inc.
ISSN
1053-8119
eISSN
1095-9572
D.O.I.
10.1016/j.neuroimage.2017.12.059
Publisher site
See Article on Publisher Site

Abstract

Data quality is increasingly recognized as one of the most important confounding factors in brain imaging research. It is particularly important for studies of brain development, where age is systematically related to in-scanner motion and data quality. Prior work has demonstrated that in-scanner head motion biases estimates of structural neuroimaging measures. However, objective measures of data quality are not available for most structural brain images. Here we sought to identify quantitative measures of data quality for T1-weighted volumes, describe how these measures relate to cortical thickness, and delineate how this in turn may bias inference regarding associations with age in youth. Three highly-trained raters provided manual ratings of 1840 raw T1-weighted volumes. These images included a training set of 1065 images from Philadelphia Neurodevelopmental Cohort (PNC), a test set of 533 images from the PNC, as well as an external test set of 242 adults acquired on a different scanner. Manual ratings were compared to automated quality measures provided by the Preprocessed Connectomes Project's Quality Assurance Protocol (QAP), as well as FreeSurfer's Euler number, which summarizes the topological complexity of the reconstructed cortical surface. Results revealed that the Euler number was consistently correlated with manual ratings across samples. Furthermore, the Euler number could be used to identify images scored “unusable” by human raters with a high degree of accuracy (AUC: 0.98–0.99), and out-performed proxy measures from functional timeseries acquired in the same scanning session. The Euler number also was significantly related to cortical thickness in a regionally heterogeneous pattern that was consistent across datasets and replicated prior results. Finally, data quality both inflated and obscured associations with age during adolescence. Taken together, these results indicate that reliable measures of data quality can be automatically derived from T1-weighted volumes, and that failing to control for data quality can systematically bias the results of studies of brain maturation.

Journal

Neuroimage – Elsevier

Published: Apr 1, 2018

References

  • Subtle in-scanner motion biases automated measurement of brain anatomy from in vivo MRI
    Alexander-Bloch, A.; Clasen, L.; Stockman, M.; Ronan, L.; Lalonde, F.; Giedd, J.; Raznahan, A.
  • Automatic correction of motion artifacts in magnetic resonance images using an entropy focus criterion
    Atkinson, D.; Hill, D.L.; Stoyle, P.N.; Summers, P.E.; Keevil, S.F.
  • ANTsR: ANTs in R: Quantification Tools for Biomedical Images
    Avants, B.B.; Kandel, B.M.; Duda, J.T.; Cook, P.A.; Tustison, N.J.; Shrinidhi, K.
  • MR artifacts: a review
    Bellon, E.; Haacke, E.; Coleman, P.; Sacco, D.; Steiger, D.; Gangarosa, R.
  • Quantitative and qualitative assessment of structural magnetic resonance imaging data in a two-center study
    Chalavi, S.; Simmons, A.; Dijkstra, H.; Barker, G.J.; Reinders, A.A.T.S.
  • Exploration of scanning effects in multi-site structural MRI studies
    Chen, J.; Liu, J.; Calhoun, V.D.; Arias-Vasquez, A.; Zwiers, M.P.; Gupta, C.N.; Franke, B.; Turner, J.A.
  • Benchmarking of Participant-level Confound Regression Strategies for the Control of Motion Artifact in Studies of Functional Connectivity
    Ciric, R.; Wolf, D.H.; Power, J.D.; Roalf, D.R.; Baum, G.; Ruparel, K.; Shinohara, R.T.; Elliott, M.A.; Eickhoff, S.B.; Davatzikos, C.; Gur, R.C.; Gur, R.E.; Bassett, D.S.; Satterthwaite, T.D.
  • Cortical surface-based analysis. I. Segmentation and surface reconstruction
    Dale, A.M.; Fischl, B.; Sereno, M.I.
  • Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach
    DeLong, E.R.; DeLong, D.M.; Clarke-Pearson, D.L.
  • An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest
    Desikan, R.S.; Ségonne, F.; Fischl, B.; Quinn, B.T.; Dickerson, B.C.; Blacker, D.; Buckner, R.L.; Dale, A.M.; Maguire, R.P.; Hyman, B.T.; Albert, M.S.; Killiany, R.J.
  • FreeSurfer
    Fischl, B.
  • Measuring the thickness of the human cerebral cortex from magnetic resonance images
    Fischl, B.; Dale, A.M.
  • Initial development and preliminary validation of a new negative symptom measure: the clinical assessment interview for negative symptoms (CAINS)
    Forbes, C.; Blanchard, J.J.; Bennett, M.; Horan, W.P.; Kring, A.; Gur, R.
  • Reducing inter-scanner variability of activation in a multicenter fMRI study: role of smoothness equalization
    Friedman, L.; Glover, G.H.; Krenz, D.; Magnotta, V.
  • Movement-Related effects in fMRI time-series
    Friston, K.J.; Williams, S.; Howard, R.; Frackowiak, R.S.J.; Turner, R.
  • Age-related effects and sex differences in gray matter density, volume, mass, and cortical thickness from childhood to young adulthood
    Gennatas, E.D.; Avants, B.B.; Wolf, D.H.; Satterthwaite, T.D.; Ruparel, K.; Ciric, R.; Hakonarson, H.; Gur, R.E.; Gur, R.C.
  • Structural magnetic resonance imaging of the adolescent brain
    Giedd, J.N.
  • Brain development during childhood and adolescence: a longitudinal MRI study
    Giedd, J.N.; Blumenthal, J.; Jeffries, N.O.; Castellanos, F.X.; Liu, H.; Zijdenbos, A.; Paus, T.; Evans, A.C.; Rapoport, J.L.
  • Dynamic mapping of human cortical development during childhood through early adulthood
    Gogtay, N.; Giedd, J.N.; Lusk, L.; Hayashi, K.M.; Greenstein, D.; Vaituzis, A.C.; Nugent, T.F.; Herman, D.H.; Clasen, L.S.; Toga, A.W.; Rapoport, J.L.; Thompson, P.M.
  • Generation and evaluation of a cortical area parcellation from resting-state correlations
    Gordon, E.M.; Laumann, T.O.; Adeyemo, B.; Huckins, J.F.; Kelley, W.M.; Petersen, S.E.
  • Improved optimization for the robust and accurate linear registration and motion correction of brain images
    Jenkinson, M.; Bannister, P.; Brady, M.; Smith, S.
  • Comparing measures of sample skewness and kurtosis
    Joanes, D.N.; Gill, C.A.
  • Schedule for affective disorders and schizophrenia for school-age children-present and lifetime version (K-SADS-PL): initial reliability and validity data
    Kaufman, J.; Birmaher, B.; Brent, D.; Rao, U.; Flynn, C.; Moreci, P.; Williamson, D.; Ryan, N.
  • Caret: Classification and Regression Training
    Kuhn, M.; Weston, S.; Williams, A.; Keefer, C.; Engelhardt, A.; Cooper, T.; Mayer, Z.; Kenkel, B.; Benesty, M.; Lescarbeau, R.; Ziem, A.; Scrucca, L.; Tang, Y.; Candan, C.; Hunt, T.
  • A novel quantitative cross-validation of different cortical surface reconstruction algorithms using MRI phantom
    Lee, J.K.; Lee, J.-M.; Kim, J.S.; Kim, I.Y.; Evans, A.C.; Kim, S.I.
  • Measurement of signal-to-noise and contrast-to-noise in the fBIRN multicenter imaging study
    Magnotta, V.A.; Friedman, L.
  • Human Connectome Project Informatics: quality control, database services, and data visualization
    Marcus, D.S.; Harms, M.P.; Snyder, A.Z.; Jenkinson, M.; Wilson, J.A.; Glasser, M.F.; Barch, D.M.; Archie, K.A.; Burgess, G.C.; Ramaratnam, M.; Hodge, M.; Horton, W.; Herrick, R.; Olsen, T.; McKay, M.; House, M.; Hileman, M.; Reid, E.; Harwell, J.; Coalson, T.; Schindler, J.; Elam, J.S.; Curtiss, S.W.; Van Essen, D.C.
  • Automatic quality assessment in structural brain magnetic resonance imaging
    Mortamet, B.; Bernstein, M.A.; Jack, C.R.; Gunter, J.L.; Ward, C.; Britson, P.J.; Meuli, R.; Thiran, J.-P.; Krueger, G.
  • Motion and morphometry in clinical and nonclinical populations
    Pardoe, H.R.; Kucharsky Hiess, R.; Kuzniecky, R.
  • Automated quality assessment of structural magnetic resonance brain images based on a supervised machine learning algorithm
    Pizarro, R.A.; Cheng, X.; Barnett, A.; Lemaitre, H.; Verchinski, B.A.; Goldman, A.L.; Xiao, E.; Luo, Q.; Berman, K.F.; Callicott, J.H.; Weinberger, D.R.; Mattay, V.S.
  • Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion
    Power, J.D.; Barnes, K.A.; Snyder, A.Z.; Schlaggar, B.L.; Petersen, S.E.
  • Recent progress and outstanding issues in motion correction in resting state fMRI
    Power, J.D.; Schlaggar, B.L.; Petersen, S.E.
  • Head motion during MRI acquisition reduces gray matter volume and thickness estimates
    Reuter, M.; Tisdall, M.D.; Qureshi, A.; Buckner, R.L.; van der Kouwe, A.J.W.; Fischl, B.
  • Psych: Procedures for Psychological, Psychometric, and Personality Research
    Revelle, W.
  • The impact of quality assurance assessment on diffusion tensor imaging outcomes in a large-scale population-based cohort
    Roalf, D.R.; Quarmley, M.; Elliott, M.A.; Satterthwaite, T.D.; Vandekar, S.N.; Ruparel, K.; Gennatas, E.D.; Calkins, M.E.; Moore, T.M.; Hopson, R.; Prabhakaran, K.; Jackson, C.T.; Verma, R.; Hakonarson, H.; Gur, R.C.; Gur, R.E.
  • Heritability of subcortical and limbic brain volume and shape in multiplex-multigenerational families with schizophrenia
    Roalf, D.R.; Vandekar, S.N.; Almasy, L.; Ruparel, K.; Satterthwaite, T.D.; Elliott, M.A.; Podell, J.; Gallagher, S.; Jackson, C.T.; Prasad, K.; Wood, J.; Pogue-Geile, M.F.; Nimgaonkar, V.L.; Gur, R.C.; Gur, R.E.
  • The Philadelphia Neurodevelopmental Cohort: a publicly available resource for the study of normal and abnormal brain development in youth
    Satterthwaite, T.D.; Connolly, J.J.; Ruparel, K.; Calkins, M.E.; Jackson, C.; Elliott, M.A.; Roalf, D.R.; Hopson, R.; Prabhakaran, K.; Behr, M.; Qiu, H.; Mentch, F.D.; Chiavacci, R.; Sleiman, P.M.A.; Gur, R.C.; Hakonarson, H.; Gur, R.E.
  • Neuroimaging of the Philadelphia neurodevelopmental cohort
    Satterthwaite, T.D.; Elliott, M.A.; Ruparel, K.; Loughead, J.; Prabhakaran, K.; Calkins, M.E.; Hopson, R.; Jackson, C.; Keefe, J.; Riley, M.; Mentch, F.D.; Sleiman, P.; Verma, R.; Davatzikos, C.; Hakonarson, H.; Gur, R.C.; Gur, R.E.
  • Impact of in-scanner head motion on multiple measures of functional connectivity: relevance for studies of neurodevelopment in youth
    Satterthwaite, T.D.; Wolf, D.H.; Loughead, J.; Ruparel, K.; Elliott, M.A.; Hakon, H.; Gur, R.C.; Gur, R.E.
  • Motion-related artifacts in structural brain images revealed with independent estimates of in-scanner head motion
    Savalia, N.K.; Agres, P.F.; Chan, M.Y.; Feczko, E.J.; Kennedy, K.M.; Wig, G.S.
  • Neurodevelopmental trajectories of the human cerebral cortex
    Shaw, P.; Kabani, N.J.; Lerch, J.P.; Eckstrand, K.; Lenroot, R.; Gogtay, N.; Greenstein, D.; Clasen, L.; Evans, A.; Rapoport, J.L.; Giedd, J.N.; Wise, S.P.
  • The preprocessed Connectomes Project quality assessment protocol - a resource for measuring the quality of MRI data
    Shehzad, Z.; Giavasis, S.; Li, Q.; Benhajali, Y.; Yan, C.; Yang, Z.; Milham, M.; Bellec, P.; Craddock, C.
  • Data quality influences observed links between functional connectivity and behavior
    Siegel, J.S.; Mitra, A.; Laumann, T.O.; Seitzman, B.A.; Raichle, M.; Corbetta, M.; Snyder, A.Z.
  • Towards automated analysis of Connectomes: the configurable pipeline for the analysis of Connectomes (C-PAC)
    Sikka, S.; Cheung, B.; Khanuja, R.; Ghosh, S.; Yan, C.; Li, Q.; Vogelstein, J.; Burns, R.; Colcombe, S.; Craddock, C.; Mennes, M.; Kelly, C.; Dimartino, A.; Castellanos, F.; Milham, M.
  • MRI artifacts and correction strategies
    Smith, T.B.; Nayak, K.S.
  • Asymptotic confidence intervals for indirect effects in structural equation models
    Sobel, M.E.
  • Patterns of coordinated cortical remodeling during adolescence and their associations with functional specialization and evolutionary expansion
    Sotiras, A.; Toledo, J.B.; Gur, R.E.; Gur, R.C.; Satterthwaite, T.D.; Davatzikos, C.
  • Mapping cortical change across the human life span
    Sowell, E.R.; Peterson, B.S.; Thompson, P.M.; Welcome, S.E.; Henkenius, A.L.; Toga, A.W.
  • Longitudinal mapping of cortical thickness and brain growth in normal children
    Sowell, E.R.; Thompson, P.M.; Leonard, C.M.; Welcome, S.E.; Kan, E.; Toga, A.W.
  • Mapping continued brain growth and gray matter density reduction in dorsal frontal cortex: inverse relationships during postadolescent brain maturation
    Sowell, E.R.; Thompson, P.M.; Tessner, K.D.; Toga, A.W.
  • Multisite Validation of Image Analysis Methods: Assessing Intra- and Intersite Variability
    Styner, M.A.; Charles, H.C.; Park, J.; Gerig, G.
  • Brain maturation in adolescence and young adulthood: regional age-related changes in cortical thickness and white matter volume and microstructure
    Tamnes, C.K.; Ostby, Y.; Fjell, A.M.; Westlye, L.T.; Due-Tønnessen, P.; Walhovd, K.B.
  • Volumetric navigators for prospective motion correction and selective reacquisition in neuroanatomical MRI
    Tisdall, M.D.; Hess, A.T.; Reuter, M.; Meintjes, E.M.; Fischl, B.; van der Kouwe, A.J.W.
  • Prospective motion correction with volumetric navigators (vNavs) reduces the bias and variance in brain morphometry induced by subject motion
    Tisdall, M.D.; Reuter, M.; Qureshi, A.; Buckner, R.L.; Fischl, B.; van der Kouwe, A.J.W.
  • The influence of head motion on intrinsic functional connectivity MRI
    Van Dijk, K.R.A.; Sabuncu, M.R.; Buckner, R.L.
  • Topologically dissociable patterns of development of the human cerebral cortex
    Vandekar, S.N.; Shinohara, R.T.; Raznahan, A.; Roalf, D.R.; Ross, M.; DeLeo, N.; Ruparel, K.; Verma, R.; Wolf, D.H.; Gur, R.C.; Gur, R.E.; Satterthwaite, T.D.
  • Bda: Density Estimation for Grouped Data
    Wang, B.
  • No-Reference image quality metrics for structural MRI
    Woodard, J.P.; Carley-Spencer, M.P.
  • A Connectome Computation System for discovery science of brain
    Xu, T.; Yang, Z.; Jiang, L.; Xing, X.-X.; Zuo, X.-N.
  • A comprehensive assessment of regional variation in the impact of head micromovements on functional connectomics
    Yan, C.-G.; Cheung, B.; Kelly, C.; Colcombe, S.; Craddock, R.C.; Di Martino, A.; Li, Q.; Zuo, X.-N.; Castellanos, F.X.; Milham, M.P.
  • DPABI: data processing & analysis for (Resting-State) brain imaging
    Yan, C.-G.; Wang, X.-D.; Zuo, X.-N.; Zang, Y.-F.
  • Spurious group differences due to head motion in a diffusion MRI study
    Yendiki, A.; Koldewyn, K.; Kakunoori, S.; Kanwisher, N.; Fischl, B.
  • The organization of the human cerebral cortex estimated by intrinsic functional connectivity
    Yeo, B.T.T.; Krienen, F.M.; Sepulcre, J.; Sabuncu, M.R.; Lashkari, D.; Hollinshead, M.; Roffman, J.L.; Smoller, J.W.; Zöllei, L.; Polimeni, J.R.; Fischl, B.; Liu, H.; Buckner, R.L.
  • Motion artifacts in MRI: a complex problem with many partial solutions
    Zaitsev, M.; Maclaren, J.; Herbst, M.
  • Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm
    Zhang, Y.; Brady, M.; Smith, S.
  • Human connectomics across the life span
    Zuo, X.-N.; He, Y.; Betzel, R.F.; Colcombe, S.; Sporns, O.; Milham, M.P.
  • Test-retest reliabilities of resting-state FMRI measurements in human brain functional connectomics: a systems neuroscience perspective
    Zuo, X.-N.; Xing, X.-X.

You’re reading a free preview. Subscribe to read the entire article.

Try 2 weeks free now

DeepDyve is your
personal research library

It’s your single place to instantly
discover and read the research
that matters to you.

Enjoy affordable access to
over 18 million articles from more than
15,000 peer-reviewed journals.

All for just $49/month

Explore the DeepDyve Library

or browse the journals available

Search

Query the DeepDyve database, plus search all of PubMed and Google Scholar seamlessly

Organize

Save any article or search result from DeepDyve, PubMed, and Google Scholar... all in one place.

Access

Get unlimited, online access to over 18 million full-text articles from more than 15,000 scientific journals.

Your journals are on DeepDyve

Read from thousands of the leading scholarly journals from SpringerNature, Elsevier, Wiley-Blackwell, Oxford University Press and more.

All the latest content is available, no embargo periods.

See the journals in your area

DeepDyve

Freelancer

DeepDyve

Pro

Price

FREE

$49/month
$360/year

Save searches from
Google Scholar,
PubMed

Create lists to
organize your research

Export lists, citations

Read DeepDyve articles

Abstract access only

Unlimited access to over
18 million full-text articles

Print

20 pages / month

PDF Discount

20% off

Sign up
for free
Start 14 day
Free Trial