Systems and methods for detecting, correcting, and validating bad data in data streams

摘要

In one aspect, a computer system for managing occurrences of data anomalies in a data stream is provided. The computer system includes a processor in communication with the data stream. The processor is programmed to receive a first data stream from a phasor measurement unit. The processor is also programmed to calculate at least one singular value associated with the first data stream. The processor is further programmed to detect a first data anomaly within the first data stream using the at least one singular value. The first data anomaly occurs during a first time segment. The processor is also programmed to indicate the first time segment as containing the first data anomaly.

主权项

1. A computer system for managing occurrences of data anomalies in a data stream, said computer system comprising a processor in communication with the data stream, said processor programmed to: receive a first data stream from a phasor measurement unit; calculate a plurality of singular values using the first data stream; detect a first data anomaly within the first data stream using the plurality of singular values, the first data anomaly occurring during a first time segment; indicate the first time segment as containing the first data anomaly; wherein said processor is further programmed to: determine a largest singular value from the plurality of singular values; determine a smallest singular value from the plurality of singular values; compute a condition number value as a ratio between the largest singular value and the smallest singular value; and detect the first data anomaly using the condition number value, thereby facilitating distinguishing a data anomaly condition from a transient condition.