Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Data Quality Control Based on Self-Consistency

Data Quality Control Based on Self-Consistency Conducting meteorological measurements, one is always confronted with a wide variety of different types of errors and with the decision of how to correct data for further use, if necessary. The selection of an adequate quality control (QC) procedure out of a wide range of methodologies depends on the properties of the observed parameter such as spatial or temporal consistency. But the intended data application (e.g., model-independent data analysis) or the availability of prior knowledge also has to be taken into account. The herein-presented self-consistent and model-independent QC process makes use of the spatial and temporal consistency of meteorological parameters. It is applicable to measurements featuring a high degree of autocorrelation with regard to the resolution of the observational network in space and time. The presented QC procedure can mathematically be expressed as an optimization problem minimizing the curvature of the analyzed field. This results in a matrix equation that can be solved without needing to converge iterations. Based on the resulting deviations and, if applied, on their impacts on the cost function, station values are accepted, corrected, or identified as outliers and hence dismissed. Furthermore, it is pointed out that this method is able to handle complicated station distributions, such as clustered stations or inhomogeneous station densities. This QC method is not only an appropriate tool for case studies but also for model validation and has been proving itself as a preprocessing tool for operational meso- and micrometeorological analyses. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png Monthly Weather Review American Meteorological Society

Data Quality Control Based on Self-Consistency

Download PDF
18 pages

Loading next page...
 
/lp/american-meteorological-society/data-quality-control-based-on-self-consistency-ymq50DI7Ia

References

References for this paper are not available at this time. We will be adding them shortly, thank you for your patience.

Publisher
American Meteorological Society
Copyright
Copyright © 2010 American Meteorological Society
ISSN
1520-0493
DOI
10.1175/MWR-D-10-05024.1
Publisher site
See Article on Publisher Site

Abstract

Conducting meteorological measurements, one is always confronted with a wide variety of different types of errors and with the decision of how to correct data for further use, if necessary. The selection of an adequate quality control (QC) procedure out of a wide range of methodologies depends on the properties of the observed parameter such as spatial or temporal consistency. But the intended data application (e.g., model-independent data analysis) or the availability of prior knowledge also has to be taken into account. The herein-presented self-consistent and model-independent QC process makes use of the spatial and temporal consistency of meteorological parameters. It is applicable to measurements featuring a high degree of autocorrelation with regard to the resolution of the observational network in space and time. The presented QC procedure can mathematically be expressed as an optimization problem minimizing the curvature of the analyzed field. This results in a matrix equation that can be solved without needing to converge iterations. Based on the resulting deviations and, if applied, on their impacts on the cost function, station values are accepted, corrected, or identified as outliers and hence dismissed. Furthermore, it is pointed out that this method is able to handle complicated station distributions, such as clustered stations or inhomogeneous station densities. This QC method is not only an appropriate tool for case studies but also for model validation and has been proving itself as a preprocessing tool for operational meso- and micrometeorological analyses.

Journal

Monthly Weather Review – American Meteorological Society

Published: Oct 27, 2010

References

  • Variational quality control
    Andersson
  • Quality control for the navy operational atmospheric database
    Baker
  • The Quickhull algorithm for convex hulls
    Barber
  • A technique for maximizing details in numerical weather map analysis
    Barnes
  • Quality control of daily meteorological data in China, 1951–2000: A new dataset
    Feng
  • The impact of unique meteorological phenomena detected by the Oklahoma mesonet and ARS micronet on automated quality control
    Fiebrich
  • Complex quality control of meteorological observations
    Gandin
  • Sensitivity analysis of quality assurance using the spatial regression approach—A case study of the maximum/minimum air temperature
    Hubbard
  • Bayesian quality control using multivariate normal distributions
    Ingleby
  • Forecast Verification: A Practitioner’s Guide in Atmospheric Science
    Jolliffe
  • A global three-dimensional multivariate statistical interpolation scheme
    Lorenc
  • Objective quality control of observations using Bayesian methods: Theory, and a practical implementation
    Lorenc
  • VERA - a high resolution analysis scheme for the atmosphere over complex terrain
    Pöttschacher
  • A deterministic approach to the validation of historical daily temperature and precipitation data from the cooperative network
    Reek
  • Quality assurance procedures in the Oklahoma mesonetwork
    Shafer
  • A transparent method for the analysis and quality evaluation of irregularly distributed and noisy observational data
    Steinacker
  • A mesoscale data analysis and downscaling method over complex terrain
    Steinacker
  • A quality control program for surface mesometeorological data
    Wade
  • Statistical Methods in the Atmospheric Sciences
    Wilks
  • Guide to Meteorological Instruments and Methods of Observation
    WMO