Abnormal data detection and process by using BDS satellite offset semiparametric adjustment model

doi:10.11947/j.AGCS.2020.20180384

Abstract

Abstract: In view of the high frequency of abnormal data such as clock jump, gross error and so on in the BeiDou satellite clock offset data, this paper introduces the semiparametric adjustment model to the processing of the clock offset data of BDS. First of all, when considering the system error, we improved the common clock offset model. Secondly, when considering the abnormal data and the system error comprehensively, we use the compensation of principle of least squares and the extreme value solving method, the relation expression of estimated value of the parameters and non-parameters before and after the separation of the abnormal data and the corrected values of the corresponding observation values is derived in detail, and separation of the fixed value of the abnormal data, the parameter solution and the system error is realized. On this basis, the Cook distance is introduced, the Cook distance of parameter components and nonparametric components and the mixed Cook distance are presented to determine the location of the abnormal value. And the selection method of some parameters and the corresponding treatment measures are presented to achieve the location and fixed value of the anomaly data of the satellite clock offset and the separation of some system errors. Finally, the comparison is conducted by the method adopted in this paper and common method using the precision clock offset data of the BeiDou satellite, which has a sampling interval of 5 min from the GNSS center of Wuhan University. The experimental results show that the proposed method can effectively identify abnormal value in the satellite clock and deal with it, and effectively overcome the deficiency of the anomaly detection method based on the empirical threshold difference, and this method has a good detection effect for the abnormal clock offset data of smaller magnitude. To a certain extent, it has enriched the existing BDS clock offset data quality control method.

Key words: BDS, satellite clock offset, anomaly data detection, semiparametric adjustment model, Cook distance

CLC Number:

P228

LI Wentao, YAN Xiong, XIA Lei, REN Qingyang, CHEN Jie, PAN Xiong. Abnormal data detection and process by using BDS satellite offset semiparametric adjustment model[J]. Acta Geodaetica et Cartographica Sinica, 2020, 49(1): 55-64.

References

[1] QING Yun, LOU Yidong, DAI Xiaolei, et al. Benefits of satellite clock modeling in BDS and Galileo orbit determination[J]. Advances in Space Research, 2017, 60(12):2550-2560.
[2] HUANG Guanwen, CUI Bobin, ZHANG Qin, et al. An improved predicted model for BDS ultra-rapid satellite clock offsets[J]. Remote Sensing, 2018, 10(1):60-67.
[3] 郭海荣. 导航卫星原子钟时频特性分析理论与方法研究[D]. 郑州:信息工程大学, 2006. GUO Hairong. Study on the analysis theories and algorithms of the time and frequency characterization for atomic clocks of navigation satellite[D]. Zhengzhou:Information Engineering University, 2006.
[4] 黄观文. GNSS星载原子钟质量评价及精密钟差算法研究[D]. 西安:长安大学, 2012. HUANG Guanwen. Research on algorithms of precise clock offset and quality evaluation of GNSS satellite clock[D]. Xi'an:Chang'an University, 2012.
[5] 黄观文, 崔博斌, 张勤, 等. 附加周期和神经网络补偿的实时钟差预报模型[J]. 宇航学报, 2018, 39(1):83-88. HUANG Guanwen, CUI Bobin, ZHANG Qin, et al. Real-time clock offset prediction model with periodic and neural network corrections[J]. Journal of Astronautics, 2018, 39(1):83-88.
[6] 王宇谱, 吕志平, 王宁. BDS星载原子钟长期性能分析[J]. 测绘学报, 2017, 46(2):157-169. DOI:10.11947/j.AGCS.2017.20160369. WANG Yupu, LÜ Zhiping, WANG Ning. The long-term performance analysis for on-board atomic clocks of BDS[J]. Acta Geodaetica et Cartographica Sinica, 2017, 46(2):157-169. DOI:10.11947/j.AGCS.2017.20160369.
[7] 孙大双, 王宇谱, 万琪, 等. 北斗在轨卫星钟产品质量分析[J]. 测绘科学技术学报, 2017, 34(3):251-257. SUN Dashuang, WANG Yupu, WAN Qi, et al. On-orbit BeiDou satellite clock products quality analysis[J]. Journal of Geomatics Science and Technology, 2017, 34(3):251-257.
[8] 黄观文, 余航, 郭海荣, 等. 北斗在轨卫星钟中长期钟差特性分析[J]. 武汉大学学报(信息科学版), 2017, 42(7):982-988. HUANG Guanwen, YU Hang, GUO Hairong, et al. Analysis of the mid-long term characterization for BDS on-orbit satellite clocks[J]. Geomatics and Information Science of Wuhan University, 2017, 42(7):982-988.
[9] 田婕, 黄观文, 王利, 等. 一种北斗二代卫星钟差的数据质量控制方法[J]. 大地测量与地球动力学, 2017, 37(2):215-220. TIAN Jie, HUANG Guanwen, WANG Li, et al. A data quality control method for the BeiDou-2 satellite clock bias[J]. Journal of Geodesy and Geodynamics, 2017, 37(2):215-220.
[10] 王宇谱. GNSS星载原子钟性能分析与卫星钟差建模预报研究[D]. 郑州:信息工程大学, 2017. WANG Yupu. Research on modeling and prediction of the satellite clock bias and performance evaluation of GNSS satellite clocks[D]. Zhengzhou:Information Engineering University, 2017.
[11] 张倩倩, 韩松辉, 杜兰, 等. 星地时间同步钟差异常处理的Bayesian方法[J]. 武汉大学学报(信息科学版), 2016, 41(6):772-777. ZHANG Qianqian, HAN Songhui, DU Lan, et al. Bayesian methods for outliers detection and estimation in clock offset measurements of satellite-ground time transfer[J]. Geomatics and Information Science of Wuhan University, 2016, 41(6):772-777.
[12] 周佩元, 杜兰, 路余, 等. 多星定轨条件下北斗卫星钟差的周期性变化[J]. 测绘学报, 2015, 44(12):1299-1306. DOI:10.11947/j.AGCS.2015.20150183. ZHOU Peiyuan, DU Lan, LU Yu, et al. Periodic variations of BeiDou satellite clock offsets derived from multi-satellite orbit determination[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(12):1299-1306. DOI:10.11947/j.AGCS.2015.20150183.
[13] 王宇谱, 吕志平, 王宁, 等. 顾及卫星钟随机特性的抗差最小二乘配置钟差预报算法[J]. 测绘学报, 2016, 45(6):646-655. DOI:10.11947/j.AGCS.2016.20150569. WANG Yupu, LÜ Zhiping, WANG Ning, et al. Prediction of navigation satellite clock bias considering clock's stochastic variation behavior with robust least square collocation[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(6):646-655. DOI:10.11947/j.AGCS.2016.20150569.
[14] 王宇谱, 张胜利, 徐金锋, 等. 改进中位数方法的BDS卫星钟差数据预处理策略[J]. 测绘科学, 2019, 44(2):109-115, 127. WANG Yupu, ZHANG Shengli, XU Jinfeng, et al. Data preprocessing strategy for BDS satellite clock bias data based on an improved median absolute deviation method[J]. Science of Surveying and Mapping, 2019, 44(2):109-115, 127.
[15] 吴静. 利用中位数的GPS卫星钟跳探测方法[J]. 测绘科学, 2015, 40(6):36-41. WU Jing. Study on detection of GPS clock jump using median absolute deviation[J]. Science of Surveying and Mapping, 2015, 40(6):36-41.
[16] 丁士俊. 测量数据的建模与半参数估计[D]. 武汉:武汉大学, 2005. DING Shijun. Survey data modeling and semiparametric estimating[D]. Wuhan:Wuhan University, 2005.
[17] COOK R D. Detection of influential observation in linear regression[J]. Technometrics, 1977, 19(1):15-18.
[18] COOK R D, WEISBERG S. Characterizations of an empirical influence function for detecting influential cases in regression[J]. Technometrics, 1980, 22(4):495-508.
[19] COOK R D, WEISBERG S. Residual and influence in regression[M]. New York:Chapman and Hall, 1982.
[20] 丁士俊, 陶本藻. 半参数模型的统计诊断量与粗差检验[J]. 大地测量与地球动力学, 2005, 25(3):24-28. DING Shijun, TAO Benzao. Measures of statistical diagnosis and gross test for semiparametric model[J]. Journal of Geodesy and Geodynamics, 2005, 25(3):24-28.
[21] 潘雄, 吕玉婷, 汪耀, 等. 基于半参数平差模型的粗差定位与定值研究[J]. 武汉大学学报(信息科学版), 2016, 41(11):1421-1426. PAN Xiong, LÜ Yuting, WANG Yao, et al. Research of the location and valuation of gross error based on semi-parametric adjustment model[J]. Geomatics and Information Science of Wuhan University, 2016, 41(11):1421-1426.
[22] 洪樱, 欧吉坤, 彭碧波. GPS卫星精密星历和钟差三种内插方法的比较[J]. 武汉大学学报(信息科学版), 2006, 31(6):516-518, 556. HONG Ying, OU Jikun, PENG Bibo. Three interpolation methods for precise ephemeris and clock offset of GPS satellite[J]. Geomatics and Information Science of Wuhan University, 2006, 31(6):516-518, 556.
[23] 胡宏昌. 半参数模型的估计方法及其应用[D]. 武汉:武汉大学, 2004. HU Hongchang. Estimation methods and their applications in semiparametric model[D]. Wuhan:Wuhan University, 2004.
[24] 潘雄. 半参数模型的估计理论及其应用[D]. 武汉:武汉大学, 2005. PAN Xiong. The estimation theory and application of semi-parametric model[D]. Wuhan:Wuhan University, 2005.
[25] 张松林. 非线性半参数模型最小二乘估计理论及应用研究[D]. 武汉:武汉大学, 2003. ZHANG Songlin. The theoretical and application research on nonlinear semiparametric model[D]. Wuhan:Wuhan University, 2003.