| 主权项 |
1. A computer-implemented method for data quality monitoring, the method comprising:
measuring, by a computer, a data quality of loaded data relative to a predefined data quality metric, the measuring comprising:
identifying delta changes in at least one of the loaded data and data quality rules relative to a previous measurement of the data quality of the loaded data, wherein a delta change of the data quality rules comprises at least one change in at least one term of at least one data quality rule, said at least one data quality rule containing a concatenation of terms; andapplying a logical calculus defined in the data quality rules to the identified delta changes; applying the changed term to one of the loaded data and the delta change of the loaded data; creating a plurality of columnar data objects, with each of the loaded data; and caching intermediary results of application of each of the terms of the data quality rules to individual data columns, along a dependency path gained by a decomposition of the data quality rules into their individual terms and embodied as a tree structure; wherein the application of the data quality rules is performed in based on one of an initial data load and a delta data load. |
