ASTM-D6589 2010

$44.96

D6589-05(2010)e1 Standard Guide for Statistical Evaluation of Atmospheric Dispersion Model Performance

Published By	Publication Date	Number of Pages
ASTM	2010	17

Guaranteed Safe Checkout

Categories: 13.040.20 - Ambient atmospheres, ASTM

If you have any questions, feel free to reach out to our online customer service team by clicking on the bottom right corner. We’re here to assist you 24/7.
Email:[email protected]

Description

1.1 This guide provides techniques that are useful for the comparison of modeled air concentrations with observed field data. Such comparisons provide a means for assessing a model’s performance, for example, bias and precision or uncertainty, relative to other candidate models. Methodologies for such comparisons are yet evolving; hence, modifications will occur in the statistical tests and procedures and data analysis as work progresses in this area. Until the interested parties agree upon standard testing protocols, differences in approach will occur. This guide describes a framework, or philosophical context, within which one determines whether a model’s performance is significantly different from other candidate models. It is suggested that the first step should be to determine which model’s estimates are closest on average to the observations, and the second step would then test whether the differences seen in the performance of the other models are significantly different from the model chosen in the first step. An example procedure is provided in Appendix X1 to illustrate an existing approach for a particular evaluation goal. This example is not intended to inhibit alternative approaches or techniques that will produce equivalent or superior results. As discussed in Section 6, statistical evaluation of model performance is viewed as part of a larger process that collectively is referred to as model evaluation.

1.2 This guide has been designed with flexibility to allow expansion to address various characterizations of atmospheric dispersion, which might involve dose or concentration fluctuations, to allow development of application-specific evaluation schemes, and to allow use of various statistical comparison metrics. No assumptions are made regarding the manner in which the models characterize the dispersion.

1.3 The focus of this guide is on end results, that is, the accuracy of model predictions and the discernment of whether differences seen between models are significant, rather than operational details such as the ease of model implementation or the time required for model calculations to be performed.

1.4 This guide offers an organized collection of information or a series of options and does not recommend a specific course of action. This guide cannot replace education or experience and should be used in conjunction with professional judgment. Not all aspects of this guide may be applicable in all circumstances. This guide is not intended to represent or replace the standard of care by which the adequacy of a given professional service must be judged, nor should it be applied without consideration of a project’s many unique aspects. The word Standard in the title of this guide means only that the document has been approved through the ASTM consensus process.

1.5 This standard does not purport to address all of the safety concerns, if any, associated with its use. It is the responsibility of the user of this standard to establish appropriate safety and health practices and to determine the applicability of regulatory limitations prior to use.

PDF Catalog

PDF Pages	PDF Title
1	Scope Referenced Documents Terminology
2	Summary of Guide Significance and Use Model Evaluation
3	A Framework for Model Evaluations
5	Statistical Comparison Metrics and Methods
6	Considerations in Performing Statistical Evaluations
7	FIG. 1
8	Statistical Procedures and Data Analysis
11	Summarizing Model Performance
12	Conclusions Keywords X1. EXAMPLE PRACTICE FOR STATISTICAL PERFORMANCE EVALUATION OF THE CHARACTERIZATION OF THE AVERAGE CENTERLINE CONCENTRATION VALUES BY LOCAL-SCALE DISPERSION MODELS FOR DISPERSION FROM AN ISOLATED POINT SOURCE X1.1 X1.2 Evaluation Goal
13	X1.3 Evaluation Procedure for Sorting Data into Regimes (Pseudo-Ensembles) X1.4 Evaluation Procedures for Combining Data Within a Regime for Analysis X1.5 Evaluation Procedure for Determining Which Recep-tors Provide Observations of Centerline Concentration Values
14	X1.6 Evaluation Procedure for Sampling of Observed Cen-terline Concentration Values During Bootstrap Resampling X2. GUIDANCE ON PROGRAMING LOGIC OF EXAMPLE PRACTICE X2.1 X2.2 Begin Loop on B Bootstrap Samples (say B = 500) X2.3 Begin Loop on K Regimes
15	X2.4 End Loop on Regimes X2.5 End Loop on Bootstrap Sampling X2.6 Notes on Considerations in Performance Evaluation Procedure X3. GUIDANCE ON PROGRAMMING LOGIC FOR DETERMINATION OF BEST PERFORMING MODELS X3.1 Determine Base Case Model X3.2 Determine Set of Best Performing Models
16	X3.3 REFERENCES

Additional information

Standard Title	D6589-05(2010)e1 Standard Guide for Statistical Evaluation of Atmospheric Dispersion Model Performance
Published Code	ASTM
Publication Date	2010
Pages Count	17
ICS Codes	13.040.20 - Ambient atmospheres

Preview PDF


PDF Format	Searchable	Printable	Preview Now

ASTM-D6589 2010

PDF Catalog

Related products