SYSTEM AND A PROCESS FOR SEARCHING MASSIVE AMOUNTS OF TIME-SERIES PERFORMANCE DATA USING REGULAR EXPRESSIONS

摘要

A system to collect and analyze performance metric data recorded in time-series measurements, converted into unicode, and arranged into a special data structure. The performance metric data is collected by one or more probes running on machines about which data is being collected. The performance metric data is also organized into a special data structure. The data structure at the server where analysis is done has a directory for every day of performance metric data collected with a subdirectory for every resource type. Each subdirectory contain text files of performance metric data values measured for attributes in a group of attributes to which said text file is dedicated. Each attribute has its own section and the performance metric data values are recorded in time series as unicode hex numbers as a comma delimited list. Analysis of the performance metric data is done using regular expressions.

主权项

1. A computer programmed with at least an operating system and one or more programs structured to cooperate with said operating system to control said computer to perform a process comprising:
receiving time-series performance metric data from probes coupled to resources having one or more attributes to be monitored, said probes generating a separate time-series of performance metric data for each attribute; and encoding each said time-series of performance metric data into a corresponding time-series of Unicode characters, and storing each said time-series of Unicode characters in a non relational database conventional file system having a data structure which encodes the dimensions of each measurement in each time-series of performance metric data measurements in the structure of the non relational database conventional file system itself.