测绘学报

• 学术论文 • 上一篇    下一篇

粗差探测与识别统计检验量的比较分析

郭建锋,赵俊   

  1. 信息工程大学
  • 收稿日期:2010-12-31 修回日期:2011-06-03 出版日期:2012-02-25 发布日期:2012-02-25
  • 通讯作者: 郭建锋

Comparative Analysis of Statistical Tests Used for Detection and Identification of Outliers

  • Received:2010-12-31 Revised:2011-06-03 Online:2012-02-25 Published:2012-02-25

摘要: 最小二乘(LS)估计抵御粗差影响的能力非常差,即LS估计对粗差非常敏感。在粗差的探测与识别理论体系中,通常采用正态检验、学生氏 t检验,以及tau检验等,本文对此进行了比较分析。标准化局部敏感度指标与标准化LS残差均可用来做正态检验,但研究表明,当观测量相关时,前者的检验功效大于后者。先验单位权方差因子未知时,可依据内部学生化残差及外部学生化残差分别进行 检验和学生氏 检验。与此对照,我们构造了内部学生化敏感度指标及外部学生化敏感度指标以代替标准化敏感度指标。由于tau 检验理论本身存在固有缺陷,而学生氏t检验或将造成“纳伪”错误的增加。为此,较为稳妥的方案是仍然采用正态检验,但将标准化局部敏感度指标中的单位权中误差以其抗差LMS估计代替。

Abstract: The least-squares (LS) adjustment approach is very susceptive to outliers. A comparative analysis of statistical tests used for detection and identification of outliers, including Gaussian normal test, Tau test and Student’s t-test, were addressed in details. Both the standardized local sensitivity indicator and the standardized LS residual can be served as Gaussian normal test statistics for outlier detection. However, the former is superior to the latter one for correlated observations in the sense of detection power. When the variance factor is not known, the internally Studentized residual and externally Studentized residual can be employed to perform Tau test and Student’s t-test, respectively. In a parallel manner, the internally Studentized local sensitivity indicator and externally Studentized local sensitivity indicator were constructed and investigated. Since the probability of not rejecting the null hypothesis when it is false (type Ⅱ error) may be too high by using Student’s t-test, and since the Tau test has a limitation in itself, both of them are not appropriate statistical tests. To circumvent this difficulty, the standard deviation involved in the standardized local sensitivity indicator can be replaced by its normalized robust least median of squares estimator, and then perform the Gaussian normal test for detection and identification of outlying observations.