ASTM D2777-21
Standard Practice for Determination of Precision and Bias of Applicable Test Methods of Committee D19 on Water

Standard No.

ASTM D2777-21

Release Date

2021

Published By

American Society for Testing and Materials (ASTM)

Latest

ASTM D2777-21

Scope

1.1 This practice establishes uniform standards for estimating and expressing the precision and bias of applicable test methods for Committee D19 on Water. Statements of precision and bias in test methods are required by the Form and Style for ASTM Standards, “Section A21. Precision and Bias (Mandatory).” In principle, all test methods are covered by this practice. However, the variability equations provided in this standard are applicable only to test methods that yield continuous function values. 1.2 Except as specified in 1.4, 1.5, and 1.6, this practice requires the task group proposing a new test method to carry out a collaborative study from which statements for precision (overall and single-operator standard-deviation estimates) and bias can be developed. This practice provides general guidance to task groups in planning and conducting such determinations of precision and bias. 1.3 This practice requires that a task group making a substantive revision to a test method also perform a limitedscale collaborative study (known as a — comparability study) to evaluate the effect of the revision on the precision and bias statement. This practice provides guidance to task groups for conducting such limited-scale collaborative studies. Examples of substantive modifications may include, but are not limited to, changes in mandatory or allowable instrumentation, reagents, reaction times, etc. 1.3.1 Changes to applicable water matrices in the Scope of a method may constitute a substantive modification under this provision. Only matrices that have been evaluated in an approved collaborative study may be listed in the Scope of a method. It is recognized that the term “matrix” is generally vague. Terms specifying matrix types can cover significantly different chemical constituents, unless the matrix is synthesized to be of a standardized makeup. Substitute Wastewater (Practice D5905) is one such defined matrix. For purposes of this practice, the importance of this requirement is to assist the user of a D19 standard in determining the applicability of the method to their samples. Evaluated matrices should be described with as much detail as possible to minimize misapplication. 1.3.2 A method’s concentration-range extension that is deemed to merit additional collaborative testing (even without a method modification that would otherwise be considered substantive) shall require a full collaborative study, as described in 7.1 through 7.5, but only at concentrations representative of the extended range. Note that such a collaborative study could involve as little as a single concentration study in a single reproducible matrix. 1.3.3 Whether a revision to a test method includes substantive modification shall be determined by consensus of the Committee. 1.4 If a full-scale collaborative study is not technically feasible, because of the nature of the test method or instability of samples, the most complete collaborative study that is technically feasible shall be conducted to provide the best possible limited basis for estimating the overall and singleoperator standard deviations. In some situations, an intermediate collaborative study as described in Guide D7847 may provide an appropriate approach. It is recognized that there may be circumstances when even a limited collaborative study is not feasible. Any collaborative study plan that does not meet all the requirements spelled out in this practice will require a review and recommendation by the Results Advisor and an approval by the D19 Technical Operations Section of the Executive Subcommittee. 1.4.1 Examples of acceptable studies are the local-area intermediate studies conducted by Subcommittee D19.24 on microbiological methods because of inherent sample perishability. Such intermediate collaborative studies meet the same degrees of freedom and participant requirements as full collaborative studies. They involve six or more completely independent local-area analysts who can begin analysis of uniform samples at an agreed upon time. Guide D7847 can provide guidance to the task group, the Results Advisor, and the Technical Operations Section of the Executive Subcommittee of Committee D19 on the appropriate design of an 1 This practice is under the jurisdiction of ASTM Committee D19 on Water and is the direct responsibility of Subcommittee D19.02 on Quality Systems, Specification, and Statistics. Current edition approved Dec. 15, 2021. Published June 2022. Originally approved in 1969. Last previous edition approved in 2013 as D2777 – 13. DOI: 10.1520/D2777-21. Copyright © ASTM International, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959. United States This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee. 1 acceptable intermediate collaborative study for test methods that measure highly perishable parameters. 1.4.2 If providing homogenous samples with a sufficiently stable analyte concentration is not feasible under any circumstances, a statement of single-operator precision may meet the requirements of this practice. Whenever possible, this statement should be developed from data generated by multiple independent operators, each doing replicate analyses on independent samples (of a specific matrix type), which generally fall within specified concentration ranges (see 7.2.5.2 (3)). 1.5 A collaborative study that satisfied the requirements of the version of this practice in force when the study was conducted will continue to be considered an adequate basis for the precision-and-bias statement required in each test method. If the study does not satisfy the current minimum requirements for a collaborative study, a statement listing the study’s deficiencies and a reference to this paragraph shall be included in the precision-and-bias statement as the basis for an exemption from the current requirements. 1.6 Committee D19, through a Main Committee ballot, may approve publication of a “Preliminary” Standard Method for a period not to exceed 5 years. Preliminary Standards must contain a minimum of a single-operator precision-and-bias statement and a Quality Control section based on the single operator data. Publication of a Preliminary Standard is conditional on the approval of a full D2777 collaborative study design for the standard. Precision-and-bias statements authorized by this paragraph shall include the date of approval by Committee D19. 1.7 Per Section A21.2.3 of the ASTM Form and Style Manual the committee may delay an interlaboratory study for a new method and include a temporary statement in the Precision and Bias Section that addresses only single operator precision (“repeatability”). This statement is valid for five years from the initial publication date. In this case, a single laboratory study shall be conducted in accordance with 7.6. 1.8 In Section 12, this practice shows exemplary precisionand-bias-statement formats for: (1) test methods yielding a numerical measure, (2) test methods yielding a non-numerical report of success or failure based on criteria specified in the procedure, and (3) test methods specifying that procedures in another ASTM test method are to be used with only insignificant modifications. 1.9 All studies, even those exempt from some requirements under previous sections, shall receive approval from the Results Advisor before being conducted (see Section 8) and after completion (see Section 13). 1.10 This practice satisfies the QC requirements of Practice D5847. 1.11 It is the intent of this practice that task groups make every effort to retain all the data from their collaborative studies. Values should not be eliminated unless solid evidence exists for their exclusion. The Results Advisor should work closely with the task groups to effect this goal. 1.12 This international standard was developed in accordance with internationally recognized principles on standardization established in the Decision on Principles for the Development of International Standards, Guides and Recommendations issued by the World Trade Organization Technical Barriers to Trade (TBT) Committee.

ASTM D2777-21 Referenced Document

• ASTM D1129 Standard Terminology Relating to Water
• ASTM D1141 Standard Practice for the Preparation of Substitute Ocean Water
• ASTM D1193 Standard Specification for Reagent Water
• ASTM D4375 Standard Practice for Basic Statistics in Committee D-19 on Water
• ASTM D5790 Standard Test Method for Measurement of Purgeable Organic Compounds in Water by Capillary Column Gas Chromatography/Mass Spectrometry
• ASTM D5847 Standard Practice for Writing Quality Control Specifications for Standard Test Methods for Water Analysis
• ASTM D5905 Standard Practice for the Preparation of Substitute Wastewater
• ASTM D6091 Standard Practice for 99 %/95 % Interlaboratory Detection Estimate (IDE) for Analytical Methods with Negligible Calibration Error
• ASTM D6512 Standard Practice for Interlaboratory Quantitation Estimate*， 2024-04-21 Update
• ASTM D7847 Standard Guide for Interlaboratory Studies for Microbiological Test Methods*， 2022-07-01 Update
• ASTM E1169 Standard Guide for Conducting Ruggedness Tests
• ASTM E177 Standard Practice for Use of the Terms Precision and Bias in ASTM Test Methods
• ASTM E178 Standard Practice for Dealing With Outlying Observations
• ASTM E456 Standard Terminology for Relating to Quality and Statistics
• ASTM E691 Standard Practice for Conducting an Interlaboratory Study to Determine the Precision of a Test Method

ASTM D2777-21 history

• 2021 ASTM D2777-21 Standard Practice for Determination of Precision and Bias of Applicable Test Methods of Committee D19 on Water
• 2013 ASTM D2777-13 Standard Practice for Determination of Precision and Bias of Applicable Test Methods of Committee D19 on Water
• 2012 ASTM D2777-12 Standard Practice for Determination of Precision and Bias of Applicable Test Methods of Committee D19 on Water
• 2008 ASTM D2777-08e1 Standard Practice for Determination of Precision and Bias of Applicable Test Methods of Committee D19 on Water
• 2008 ASTM D2777-08 Standard Practice for Determination of Precision and Bias of Applicable Test Methods of Committee D19 on Water
• 2006 ASTM D2777-06 Standard Practice for Determination of Precision and Bias of Applicable Test Methods of Committee D19 on Water
• 2003 ASTM D2777-03 Standard Practice for Determination of Precision and Bias of Applicable Methods of Committee D-19 on Water
• 1998 ASTM D2777-98 Standard Practice for Determination of Precision and Bias of Applicable Methods of Committee D-19 on Water