An Association Rules-Based Method for Outliers Cleaning of Measurement Data in the Distribution Network release_hpdeiidhjnezpj4ygfitpvlone

by Hua Kuang, Risheng Qin, Mi He, Xin He, Ruimin Duan, Cheng Guo, Xian Meng

Published in Frontiers in Energy Research by Frontiers Media SA.

2021  

Abstract

For any power system, the reliability of measurement data is essential in operation, management and also in planning. However, it is inevitable that the measurement data are prone to outliers, which may impact the results of data-based applications. In order to improve the data quality, the outliers cleaning method for measurement data in the distribution network is studied in this paper. The method is based on a set of association rules (AR) that are automatically generated form historical measurement data. First, the association rules are mining in conjunction with the density-based spatial clustering of application with noise (DBSCAN), k-means and Apriori technique to detect outliers. Then, for the outliers repairing process after outliers detection, the proposed method uses a distance-based model to calculate the repairing cost of outliers, which describes the similarity between outlier and normal data. Besides, the Mahalanobis distance is employed in the repairing cost function to reduce the errors, which could implement precise outliers cleaning of measurement data in the distribution network. The test results for the simulated datasets with artificial errors verify that the superiority of the proposed outliers cleaning method for outliers detection and repairing.
In application/xml+jats format

Archived Files and Locations

application/pdf   2.7 MB
file_z5i5tw36hrduhmyqeqr5wx3dum
fjfsdata01prod.blob.core.windows.net (publisher)
web.archive.org (webarchive)

Web Captures

https://www.frontiersin.org/articles/10.3389/fenrg.2021.730058/full
2021-10-20 13:51:50 | 44 resources
webcapture_372awrxxsnhpnds5njewgfjs7e
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article-journal
Stage   published
Date   2021-10-13
Container Metadata
Open Access Publication
In DOAJ
In ISSN ROAD
In Keepers Registry
ISSN-L:  2296-598X
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: dc303f15-1e17-46a1-8aa8-62ff2bededae
API URL: JSON