TRENDING ANALYSIS FOR STREAMS OF DOCUMENTS

摘要

An event of interest is identified as trending if the number of occurrences of the event in a stream of documents is increasing or decreasing significantly from normal levels. Such a determination is made by comparing a number of occurrences in a recent time period to a long term average. An average number of occurrences over a given time period, and its variance, can be computed from historical information. The current number of occurrences also is computed for the most recent time period. Events, for which the current number is significantly different from the average level, by considering the variance, have statistically significant changes.

主权项

1. A computer-implemented process comprising:
storing data in a storage medium describing an index of a plurality of documents, each document having an associated time, wherein the index includes, for a plurality of fields, a plurality of field values and indicia of documents having the field values; given a duration of time and an event of interest defined by one or more selected field values, determining with a processor a long-term average and a variance of a number of documents having the event of interest in the duration of time; determining with the processor a current number of documents having the event of interest in a current time period having the given duration; and computing with the processor a score for the event based on a comparison of the current number and the long-term average.